Jun 11 14:14:09.935748 ip-10-0-129-86 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 14:14:09.935757 ip-10-0-129-86 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 14:14:09.935764 ip-10-0-129-86 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 14:14:09.935915 ip-10-0-129-86 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 14:14:20.115841 ip-10-0-129-86 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 14:14:20.115862 ip-10-0-129-86 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e0c3dfd20d4b4d4e81e2863291b99107 -- Jun 11 14:17:00.776603 ip-10-0-129-86 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:17:01.148449 ip-10-0-129-86 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:01.148449 ip-10-0-129-86 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:17:01.148449 ip-10-0-129-86 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:01.148449 ip-10-0-129-86 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:17:01.148449 ip-10-0-129-86 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:17:01.150670 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.150580 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:17:01.157112 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157091 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.157112 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157112 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157116 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157119 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157124 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157127 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157130 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157133 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157136 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157139 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157142 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157144 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157147 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157150 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157153 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157156 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157158 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157161 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157163 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157166 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157169 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.157188 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157172 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157174 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157177 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157184 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157187 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157191 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157196 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157199 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157202 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157218 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157222 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157225 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157228 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157232 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157235 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157238 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157241 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157244 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157246 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.157718 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157249 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157252 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157254 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157257 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157259 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157262 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157265 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157267 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157270 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157272 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157275 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157277 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157280 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157282 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157286 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157290 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157293 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157296 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157298 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157301 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.158193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157304 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157307 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157309 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157312 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157315 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157318 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157320 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157323 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157325 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157328 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157331 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157334 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157337 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157340 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157343 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157346 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157349 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157353 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157356 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157360 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.158700 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157363 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157365 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157368 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157371 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157373 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157378 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157381 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157384 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157387 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157389 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157392 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157395 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157398 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157401 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157404 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157407 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157409 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157412 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.157415 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158170 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.159186 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158177 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158180 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158183 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158186 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158190 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158193 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158196 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158198 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158202 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158223 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158226 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158230 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158233 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158235 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158238 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158241 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158244 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158247 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158252 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.159782 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158256 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158259 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158263 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158266 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158269 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158271 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158275 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158278 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158281 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158284 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158288 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158292 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158296 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158299 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158303 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158306 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158309 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158312 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158315 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.160281 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158318 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158321 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158323 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158326 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158329 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158331 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158334 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158337 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158339 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158342 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158344 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158347 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158350 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158353 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158355 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158358 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158360 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158363 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158365 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.160738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158368 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158371 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158373 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158376 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158378 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158381 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158384 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158386 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158389 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158391 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158394 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158397 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158399 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158402 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158405 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158407 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158411 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158414 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158417 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158419 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.161245 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158422 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158424 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158427 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158430 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158433 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158436 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158439 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158441 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158444 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158447 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158449 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158452 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158454 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158458 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158461 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158464 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158484 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158487 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158491 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158494 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.161738 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158497 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158899 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158903 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158906 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158909 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158912 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158914 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158917 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158920 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158923 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158926 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158929 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158931 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158934 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158937 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158939 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158942 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158945 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158948 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158951 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.162250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158953 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158956 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158958 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158961 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158964 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158966 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158969 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158972 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158974 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158977 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158979 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158982 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158984 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158988 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158992 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158995 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.158998 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159001 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159004 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.162772 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159006 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159009 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159011 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159015 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159017 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159020 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159023 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159025 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159028 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159031 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159036 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159040 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159044 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159047 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159050 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159053 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159056 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159059 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159061 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159064 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.163250 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159067 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159070 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159072 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159075 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159078 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159081 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159083 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159086 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159092 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159095 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159097 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159100 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159103 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159105 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159108 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159110 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159113 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159117 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159120 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.163737 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159122 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159125 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159132 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159135 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159138 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159141 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159143 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159146 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159149 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159151 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159154 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159158 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159161 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159164 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159167 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159170 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159172 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159175 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159178 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.164193 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159180 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159183 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.159187 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159287 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159296 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159302 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159307 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159312 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159315 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159319 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159324 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159328 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159331 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159335 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159338 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159342 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159345 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159350 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159355 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159359 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159363 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159371 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159375 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:17:01.164660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159394 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159398 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159402 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159406 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159410 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159413 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159417 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159420 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159422 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159426 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159429 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159434 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159438 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159441 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159444 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159447 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159450 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159453 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159457 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159460 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159463 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159468 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159471 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159475 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:17:01.165230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159478 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159482 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159485 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159488 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159491 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159494 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159497 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159500 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159503 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159506 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159511 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159514 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159517 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159520 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159523 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159527 2574 flags.go:64] FLAG: --help="false" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159530 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159533 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159536 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159544 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159548 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159551 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159554 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:17:01.165815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159558 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159561 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159564 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159566 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159570 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159573 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159576 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159579 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159582 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159585 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159588 2574 flags.go:64] FLAG: --lock-file="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159591 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159594 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159597 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159603 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159606 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159609 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159612 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159615 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159618 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159621 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159624 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159629 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159632 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159636 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 14:17:01.166714 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159639 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159642 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159645 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159650 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159653 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159656 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159659 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159667 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159670 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159673 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159676 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159679 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159685 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159688 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159691 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159695 2574 flags.go:64] FLAG: --port="10250" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159698 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159701 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c90fad20f288c93" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159704 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159707 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159710 2574 flags.go:64] FLAG: --register-node="true" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159713 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159717 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159720 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:17:01.167835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159722 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159725 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159729 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159732 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159735 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159738 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159740 2574 flags.go:64] FLAG: --runonce="false" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159743 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159746 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159749 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159752 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159756 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159760 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159763 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159766 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159770 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159773 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159776 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159779 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159783 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159786 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159789 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159795 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159798 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159802 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:17:01.168730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159806 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159809 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159812 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159815 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159818 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159821 2574 flags.go:64] FLAG: --v="2" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159829 2574 flags.go:64] FLAG: --version="false" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159833 2574 flags.go:64] FLAG: --vmodule="" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159837 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.159840 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160006 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160021 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160025 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160028 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160032 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160036 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160038 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160041 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160044 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160047 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160049 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160052 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.169419 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160055 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160058 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160061 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160064 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160067 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160070 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160072 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160075 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160078 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160081 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160085 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160089 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160092 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160095 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160098 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160100 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160103 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160105 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160108 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160110 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.170531 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160115 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160121 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160124 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160127 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160130 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160133 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160136 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160139 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160141 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160144 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160147 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160150 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160152 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160155 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160158 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160161 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160163 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160166 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160168 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160171 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.171147 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160174 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160177 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160179 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160182 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160185 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160187 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160190 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160192 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160195 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160198 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160200 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160203 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160217 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160223 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160226 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160229 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160232 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160234 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160237 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.171962 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160240 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160243 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160245 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160248 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160250 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160253 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160256 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160259 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160261 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160264 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160266 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160269 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160274 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160277 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160280 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160283 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160286 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160289 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160292 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160295 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.172759 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160298 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160300 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160303 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160306 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160309 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160312 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160319 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.160322 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.161141 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.168438 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.168459 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.169281 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.169294 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169382 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169392 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.173293 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169398 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169405 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169411 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169416 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169420 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169425 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169429 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169434 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169438 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169442 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169446 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169450 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169454 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169459 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169464 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169468 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169480 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169485 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169489 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.173683 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169494 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169499 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169504 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169508 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169514 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169519 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169523 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169527 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169532 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169537 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169541 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169545 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169550 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169554 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169559 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169563 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169567 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169572 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169578 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169584 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.174381 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169592 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169597 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169602 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169607 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169611 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169616 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169621 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169625 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169629 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169633 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169638 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169643 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169647 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169652 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169656 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169660 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169664 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169669 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169673 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169678 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.174898 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169684 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169688 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169692 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169696 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169701 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169705 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169709 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169713 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169718 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169722 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169726 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169730 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169735 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169739 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169743 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169747 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169751 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169755 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169759 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.175547 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169764 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169768 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169772 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169776 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169781 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169785 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169789 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169793 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169797 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169801 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169805 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169809 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169814 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169819 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169823 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169827 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169831 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169835 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.176027 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.169839 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.169847 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170027 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170034 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170039 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170045 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170049 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170053 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170057 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170061 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170065 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170069 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170074 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170078 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170082 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:17:01.176562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170087 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170091 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170095 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170100 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170104 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170117 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170122 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170126 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170130 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170134 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170139 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170143 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170148 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170153 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170157 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170161 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170166 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170170 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170174 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:17:01.176984 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170178 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170183 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170187 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170192 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170196 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170200 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170222 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170227 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170230 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170234 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170239 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170244 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170249 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170253 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170256 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170260 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170264 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170267 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170272 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:17:01.177668 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170277 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170283 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170287 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170291 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170295 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170299 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170303 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170307 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170310 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170314 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170319 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170323 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170327 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170331 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170335 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170339 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170344 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170351 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170356 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170361 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:17:01.178333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170365 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170370 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170374 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170379 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170383 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170387 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170391 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170396 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170400 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170405 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170409 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170413 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170418 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170424 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170428 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170432 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170436 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170440 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170445 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170449 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170454 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:17:01.178805 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170458 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170463 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170467 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170471 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170475 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170479 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:01.170484 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.170492 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.170653 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.173836 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.175152 2574 server.go:1019] "Starting client certificate rotation" Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.175256 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.176114 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:17:01.179367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.179235 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:17:01.180531 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.180516 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:17:01.193653 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.193631 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:17:01.196082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.196069 2574 log.go:25] "Validated CRI v1 image API" Jun 11 14:17:01.197597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.197582 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:17:01.200045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.200024 2574 fs.go:135] Filesystem UUIDs: map[1b485c44-927f-4543-a9bd-c697914f3fc9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb530fb0-6548-4eb8-87d0-ef1d5fad3c6a:/dev/nvme0n1p4] Jun 11 14:17:01.200120 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.200044 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:17:01.202540 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.202524 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:17:01.205342 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.205234 2574 manager.go:216] Machine: {Timestamp:2026-06-11 14:17:01.203930753 +0000 UTC m=+0.305511893 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104057 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27eef94ef0dbb147b2d41dea7fcc80 SystemUUID:ec27eef9-4ef0-dbb1-47b2-d41dea7fcc80 BootID:e0c3dfd2-0d4b-4d4e-81e2-863291b99107 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:69:36:54:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:69:36:54:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:b7:6f:9c:c4:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:17:01.205342 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.205341 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:17:01.205446 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.205423 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:17:01.208132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208105 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:17:01.208282 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208134 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:17:01.208858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208848 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:17:01.208893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208861 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:17:01.208893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208869 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:17:01.208893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.208884 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:17:01.209676 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.209666 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:17:01.212337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212325 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:17:01.212460 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212451 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:17:01.212491 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212480 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:17:01.212521 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212493 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:17:01.212521 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212517 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:17:01.212572 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212531 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:17:01.212572 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212540 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:17:01.212942 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212930 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:17:01.213237 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.212950 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:17:01.218016 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.217991 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:17:01.219379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.219365 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:17:01.219430 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.219395 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:17:01.220102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220084 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:17:01.220102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220103 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220111 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220118 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220129 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220136 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220148 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220155 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220165 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220173 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220184 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:17:01.220308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220191 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:17:01.220890 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220879 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:17:01.220938 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.220893 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:17:01.222630 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.222609 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kpck" Jun 11 14:17:01.223007 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.222988 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:17:01.223173 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.223154 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:17:01.223237 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.223198 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:17:01.224378 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.224362 2574 server.go:1268] "Started kubelet" Jun 11 14:17:01.224476 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.224429 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:17:01.225140 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.225075 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:17:01.225256 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.225164 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:17:01.225658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.225642 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:17:01.225670 ip-10-0-129-86 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:17:01.226907 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.226890 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:17:01.230053 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.230036 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kpck" Jun 11 14:17:01.230752 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.230731 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:17:01.230892 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.230871 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.231008 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.230991 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:17:01.231467 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231449 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:17:01.231467 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231468 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:17:01.231592 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231449 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:17:01.231639 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.231591 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:17:01.231639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231624 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:17:01.231639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231632 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:17:01.231777 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231716 2574 factory.go:55] Registering systemd factory Jun 11 14:17:01.231777 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.231747 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:17:01.232038 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232023 2574 factory.go:153] Registering CRI-O factory Jun 11 14:17:01.232038 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232037 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 14:17:01.232199 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232082 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:17:01.232199 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232101 2574 factory.go:103] Registering Raw factory Jun 11 14:17:01.232199 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232114 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 14:17:01.232474 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.232460 2574 manager.go:349] Starting recovery of all containers Jun 11 14:17:01.237939 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.237774 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:01.240441 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.240417 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-86.ec2.internal\" not found" node="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.244420 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.244403 2574 manager.go:354] Recovery completed Jun 11 14:17:01.249260 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.249246 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.251225 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251193 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.251298 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251241 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.251298 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251252 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.251813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251797 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:17:01.251813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251811 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:17:01.251943 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251822 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.251943 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.251827 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:17:01.252574 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.252559 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.252667 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.252589 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.252667 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.252604 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.253042 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.253030 2574 policy_none.go:49] "None policy: Start" Jun 11 14:17:01.253082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.253047 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:17:01.253082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.253057 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:17:01.254069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.254058 2574 policy_none.go:47] "Start" Jun 11 14:17:01.285854 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.285830 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.285873 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.285889 2574 server.go:87] "Starting device plugin registration server" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.286157 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.286170 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.286285 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.286361 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.286370 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.286875 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.286922 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.292531 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.293594 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.293630 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.293650 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:17:01.294362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.293679 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:17:01.295576 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.295556 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:01.387120 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.387080 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.388282 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.388265 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.388390 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.388295 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.388390 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.388305 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.388390 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.388328 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.394559 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.394543 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.394643 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.394566 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-86.ec2.internal\": node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.394694 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.394656 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal"] Jun 11 14:17:01.394743 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.394730 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.397178 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.397162 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.397275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.397192 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.397275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.397220 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.398589 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.398541 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.398670 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.398653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.398722 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.398688 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.399317 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399298 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.399406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399327 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.399406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399337 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.399406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399298 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.399406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399401 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.399527 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.399414 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.400594 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.400581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.400636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.400611 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:17:01.401535 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.401519 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:17:01.401641 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.401548 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:17:01.401641 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.401561 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:17:01.409345 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.409325 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.416778 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.416759 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-86.ec2.internal\" not found" node="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.420741 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.420723 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-86.ec2.internal\" not found" node="ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.509791 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.509762 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.532992 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.532966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.533085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.532995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.533085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.533013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1fb63bb1df8db54b165336d4644dafb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"b1fb63bb1df8db54b165336d4644dafb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.610310 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.610267 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.633628 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.633698 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.633698 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1fb63bb1df8db54b165336d4644dafb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"b1fb63bb1df8db54b165336d4644dafb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.633698 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1fb63bb1df8db54b165336d4644dafb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"b1fb63bb1df8db54b165336d4644dafb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.633802 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.633802 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.633702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc5fb52b32051d0346300635b31e26cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"bc5fb52b32051d0346300635b31e26cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.710935 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.710856 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.721187 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.721159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.725511 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:01.725493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:01.811685 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.811633 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:01.912158 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:01.912106 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.012776 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.012689 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.040153 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.040116 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:02.113322 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.113289 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.174832 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.174801 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:17:02.175544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.174962 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:17:02.175544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.175002 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:17:02.175544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.175003 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:17:02.214255 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.214220 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.234615 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.234560 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:12:01 +0000 UTC" deadline="2028-03-05 13:59:37.57629197 +0000 UTC" Jun 11 14:17:02.234615 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.234607 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15191h42m35.341688453s" Jun 11 14:17:02.280104 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:02.280063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5fb52b32051d0346300635b31e26cb.slice/crio-e4600cb912c9e020d7be9f29e29b048681f2d227c1bad94fdea096eb3871419f WatchSource:0}: Error finding container e4600cb912c9e020d7be9f29e29b048681f2d227c1bad94fdea096eb3871419f: Status 404 returned error can't find the container with id e4600cb912c9e020d7be9f29e29b048681f2d227c1bad94fdea096eb3871419f Jun 11 14:17:02.280425 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:02.280400 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fb63bb1df8db54b165336d4644dafb.slice/crio-07a9f3bcb37f99ed8dea5a74b9bb4f2ed1f275cbbe0d51eafe3160fb53958422 WatchSource:0}: Error finding container 07a9f3bcb37f99ed8dea5a74b9bb4f2ed1f275cbbe0d51eafe3160fb53958422: Status 404 returned error can't find the container with id 07a9f3bcb37f99ed8dea5a74b9bb4f2ed1f275cbbe0d51eafe3160fb53958422 Jun 11 14:17:02.285306 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.285286 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:17:02.297646 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.297600 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" event={"ID":"b1fb63bb1df8db54b165336d4644dafb","Type":"ContainerStarted","Data":"07a9f3bcb37f99ed8dea5a74b9bb4f2ed1f275cbbe0d51eafe3160fb53958422"} Jun 11 14:17:02.298569 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.298548 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"bc5fb52b32051d0346300635b31e26cb","Type":"ContainerStarted","Data":"e4600cb912c9e020d7be9f29e29b048681f2d227c1bad94fdea096eb3871419f"} Jun 11 14:17:02.314848 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.314824 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.415351 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.415321 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.515903 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:02.515871 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 11 14:17:02.598936 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.598905 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:02.632075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.632048 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 11 14:17:02.642858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.642827 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:17:02.644973 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.644949 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 11 14:17:02.653403 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:02.653384 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:17:03.213299 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.213192 2574 apiserver.go:52] "Watching apiserver" Jun 11 14:17:03.223077 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.222389 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:17:03.223370 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.223339 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-7tsk6","kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr","openshift-image-registry/node-ca-2hw4r","openshift-multus/multus-75zn5","openshift-multus/multus-additional-cni-plugins-j7fcd","openshift-network-operator/iptables-alerter-x4jvj","openshift-ovn-kubernetes/ovnkube-node-6b2c6","kube-system/global-pull-secret-syncer-krlhg","kube-system/konnectivity-agent-nckc7","openshift-cluster-node-tuning-operator/tuned-x4cz7","openshift-dns/node-resolver-f2kk4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal","openshift-multus/network-metrics-daemon-kgcp5"] Jun 11 14:17:03.226433 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.226407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.228481 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.228456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.229475 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.229420 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c97gf\"" Jun 11 14:17:03.229475 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.229435 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.229647 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.229535 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:17:03.229647 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.229539 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.230741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.230578 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.230741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.230670 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.230741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.230669 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.231057 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.231037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2ch7l\"" Jun 11 14:17:03.231365 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.231351 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:17:03.232555 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.232532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:17:03.232668 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.232651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.233059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.233039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.233150 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.233128 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.233283 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.233270 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mw2mq\"" Jun 11 14:17:03.234974 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.234756 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:17:03.234974 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.234764 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.234974 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.234758 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.234974 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.234894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.235809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.235599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w4zcb\"" Jun 11 14:17:03.237105 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.237443 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237420 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:17:03.237550 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237525 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qt2bg\"" Jun 11 14:17:03.237628 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237596 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.237736 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237718 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.237815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.237783 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:17:03.239387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.239365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.239485 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.239438 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:03.239612 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.239551 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:17:03.239612 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.239590 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bqv77\"" Jun 11 14:17:03.239728 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.239658 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:17:03.240599 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.240581 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:17:03.241694 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.241676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.241790 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.241734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:03.244055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.243963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.244158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-host\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.244158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-serviceca\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.244158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-modprobe-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-run\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244173 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdqs5\" (UniqueName: \"kubernetes.io/projected/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-kube-api-access-cdqs5\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-registration-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-conf\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-device-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tn26\" (UniqueName: \"kubernetes.io/projected/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kube-api-access-7tn26\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67r6\" (UniqueName: \"kubernetes.io/projected/b64eaa29-5b0f-44f4-8745-89292784dd1e-kube-api-access-b67r6\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-socket-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-iptables-alerter-script\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysconfig\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-systemd\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-host-slash\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-kubernetes\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-sys\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-lib-modules\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-var-lib-kubelet\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.244708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-host\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.245045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-tmp\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.245045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-sys-fs\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.245045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.245045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5xd\" (UniqueName: \"kubernetes.io/projected/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-kube-api-access-zd5xd\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.245045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.244827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-tuned\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.246622 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.246416 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.246622 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.246448 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:17:03.246622 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.246516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:17:03.246808 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.246735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.247781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.247545 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.247781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.247552 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:17:03.247781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.247578 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gfdjm\"" Jun 11 14:17:03.247781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.247693 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:17:03.248969 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.248947 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6lnf\"" Jun 11 14:17:03.249064 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.248987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:03.249064 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.249042 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:17:03.249064 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.249054 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:03.249247 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.249160 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:17:03.251552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.251535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.253984 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.253962 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:17:03.254161 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.254140 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:17:03.254239 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.254143 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftc9j\"" Jun 11 14:17:03.273388 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.273361 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7nx7" Jun 11 14:17:03.280809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.280775 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7nx7" Jun 11 14:17:03.282760 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.282740 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:03.332658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.332630 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:17:03.345588 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-kubernetes\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-sys\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b59ab54-4cec-421d-b88f-299e804b4b0c-agent-certs\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-sys\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-kubernetes\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.345769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5xd\" (UniqueName: \"kubernetes.io/projected/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-kube-api-access-zd5xd\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-multus\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-system-cni-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-hostroot\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-systemd-units\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345890 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-modprobe-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-run\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.345988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-bin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-run\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-conf-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-env-overrides\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-modprobe-d\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74b8\" (UniqueName: \"kubernetes.io/projected/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-kube-api-access-l74b8\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdqs5\" (UniqueName: \"kubernetes.io/projected/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-kube-api-access-cdqs5\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.346107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-registration-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-netns\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b59ab54-4cec-421d-b88f-299e804b4b0c-konnectivity-ca\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-socket-dir-parent\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-registration-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55b28\" (UniqueName: \"kubernetes.io/projected/0252c30d-715a-4fe4-827f-de40c73a58f7-kube-api-access-55b28\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-systemd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-config\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-device-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-etc-kubernetes\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-device-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67r6\" (UniqueName: \"kubernetes.io/projected/b64eaa29-5b0f-44f4-8745-89292784dd1e-kube-api-access-b67r6\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-socket-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-iptables-alerter-script\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysconfig\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-systemd\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.346920 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346612 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cnibin\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-lib-modules\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysconfig\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-socket-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346715 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-systemd\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-var-lib-kubelet\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-lib-modules\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-var-lib-kubelet\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-tmp\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-sys-fs\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-system-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-kubelet-config\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-os-release\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfqzg\" (UniqueName: \"kubernetes.io/projected/609124a0-2b86-49a9-8fd6-2013db290ef1-kube-api-access-sfqzg\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.347696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.346922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-sys-fs\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjdg\" (UniqueName: \"kubernetes.io/projected/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-kube-api-access-5jjdg\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-ovn\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-tuned\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347090 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-os-release\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-kubelet\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2vd\" (UniqueName: \"kubernetes.io/projected/6e774368-db1d-433d-8481-3fb7305b949e-kube-api-access-vg2vd\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-iptables-alerter-script\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-etc-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-node-log\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-netd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-host\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-serviceca\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-slash\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.348406 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-host\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovn-node-metrics-cert\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/609124a0-2b86-49a9-8fd6-2013db290ef1-hosts-file\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609124a0-2b86-49a9-8fd6-2013db290ef1-tmp-dir\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-kubelet\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-log-socket\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-conf\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-cnibin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-cni-binary-copy\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-multus-daemon-config\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-multus-certs\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-serviceca\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-netns\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-sysctl-conf\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-var-lib-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tn26\" (UniqueName: \"kubernetes.io/projected/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kube-api-access-7tn26\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-k8s-cni-cncf-io\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-dbus\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-bin\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-script-lib\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.347998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-host\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64eaa29-5b0f-44f4-8745-89292784dd1e-host\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-host-slash\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.349977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.348195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-host-slash\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.350612 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.350586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-etc-tuned\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.350661 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.350643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64eaa29-5b0f-44f4-8745-89292784dd1e-tmp\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.354764 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.354732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67r6\" (UniqueName: \"kubernetes.io/projected/b64eaa29-5b0f-44f4-8745-89292784dd1e-kube-api-access-b67r6\") pod \"tuned-x4cz7\" (UID: \"b64eaa29-5b0f-44f4-8745-89292784dd1e\") " pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.354940 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.354922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5xd\" (UniqueName: \"kubernetes.io/projected/ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9-kube-api-access-zd5xd\") pod \"iptables-alerter-x4jvj\" (UID: \"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9\") " pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.355037 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.355018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdqs5\" (UniqueName: \"kubernetes.io/projected/dc8c7c54-ce79-4beb-8cb3-3bc19e194f77-kube-api-access-cdqs5\") pod \"node-ca-2hw4r\" (UID: \"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77\") " pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.355476 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.355441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tn26\" (UniqueName: \"kubernetes.io/projected/5c9385f7-656f-4f88-9961-9baa83ab3bd2-kube-api-access-7tn26\") pod \"aws-ebs-csi-driver-node-sgzgr\" (UID: \"5c9385f7-656f-4f88-9961-9baa83ab3bd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.447754 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.447724 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:03.448869 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-netns\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.448966 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b59ab54-4cec-421d-b88f-299e804b4b0c-konnectivity-ca\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.448966 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-socket-dir-parent\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-socket-dir-parent\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-netns\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.448989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55b28\" (UniqueName: \"kubernetes.io/projected/0252c30d-715a-4fe4-827f-de40c73a58f7-kube-api-access-55b28\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-systemd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-config\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-etc-kubernetes\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cnibin\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-systemd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-etc-kubernetes\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-system-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-system-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-kubelet-config\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-os-release\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-kubelet-config\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqzg\" (UniqueName: \"kubernetes.io/projected/609124a0-2b86-49a9-8fd6-2013db290ef1-kube-api-access-sfqzg\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjdg\" (UniqueName: \"kubernetes.io/projected/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-kube-api-access-5jjdg\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-ovn\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-os-release\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-os-release\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b59ab54-4cec-421d-b88f-299e804b4b0c-konnectivity-ca\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-kubelet\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-os-release\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2vd\" (UniqueName: \"kubernetes.io/projected/6e774368-db1d-433d-8481-3fb7305b949e-kube-api-access-vg2vd\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-ovn\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-kubelet\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cnibin\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-etc-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449593 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-etc-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-node-log\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-node-log\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-netd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449670 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.449960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-config\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-slash\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-netd\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovn-node-metrics-cert\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-slash\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/609124a0-2b86-49a9-8fd6-2013db290ef1-hosts-file\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609124a0-2b86-49a9-8fd6-2013db290ef1-tmp-dir\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.449785 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-kubelet\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-log-socket\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/609124a0-2b86-49a9-8fd6-2013db290ef1-hosts-file\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.449858 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:03.949836548 +0000 UTC m=+3.051417680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-log-socket\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-kubelet\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-cnibin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-cni-binary-copy\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-multus-daemon-config\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.450867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-cnibin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.449983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-multus-certs\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-netns\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-var-lib-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450075 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-multus-certs\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-k8s-cni-cncf-io\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/609124a0-2b86-49a9-8fd6-2013db290ef1-tmp-dir\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-var-lib-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-dbus\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-cni-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-run-k8s-cni-cncf-io\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-run-netns\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-bin\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-script-lib\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b199705d-1cf4-4ed5-9e52-e1172189a769-dbus\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.451597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-cni-bin\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450330 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b59ab54-4cec-421d-b88f-299e804b4b0c-agent-certs\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.450390 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-multus\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-system-cni-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-hostroot\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450519 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-cni-binary-copy\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-systemd-units\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-systemd-units\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e774368-db1d-433d-8481-3fb7305b949e-multus-daemon-config\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-bin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-run-openvswitch\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-conf-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-system-cni-dir\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-env-overrides\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-hostroot\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-multus\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.450682 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:03.95066178 +0000 UTC m=+3.052242903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74b8\" (UniqueName: \"kubernetes.io/projected/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-kube-api-access-l74b8\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovnkube-script-lib\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-host-var-lib-cni-bin\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.450911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e774368-db1d-433d-8481-3fb7305b949e-multus-conf-dir\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.451042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-env-overrides\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.451071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-binary-copy\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.452958 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.451482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.453460 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.453178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-ovn-node-metrics-cert\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.453460 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.453388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b59ab54-4cec-421d-b88f-299e804b4b0c-agent-certs\") pod \"konnectivity-agent-nckc7\" (UID: \"4b59ab54-4cec-421d-b88f-299e804b4b0c\") " pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.456594 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.456567 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:03.456594 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.456596 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:03.456769 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.456611 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:03.456769 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.456684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:03.95666525 +0000 UTC m=+3.058246391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:03.458792 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.458300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55b28\" (UniqueName: \"kubernetes.io/projected/0252c30d-715a-4fe4-827f-de40c73a58f7-kube-api-access-55b28\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.458792 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.458436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjdg\" (UniqueName: \"kubernetes.io/projected/9cd4ccc4-6a2d-4197-a51c-7bc2c120a678-kube-api-access-5jjdg\") pod \"multus-additional-cni-plugins-j7fcd\" (UID: \"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678\") " pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.458792 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.458727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfqzg\" (UniqueName: \"kubernetes.io/projected/609124a0-2b86-49a9-8fd6-2013db290ef1-kube-api-access-sfqzg\") pod \"node-resolver-f2kk4\" (UID: \"609124a0-2b86-49a9-8fd6-2013db290ef1\") " pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.459307 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.459291 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2vd\" (UniqueName: \"kubernetes.io/projected/6e774368-db1d-433d-8481-3fb7305b949e-kube-api-access-vg2vd\") pod \"multus-75zn5\" (UID: \"6e774368-db1d-433d-8481-3fb7305b949e\") " pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.459352 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.459291 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74b8\" (UniqueName: \"kubernetes.io/projected/b024e4d2-3c81-4ba3-986c-cbfe81bf883e-kube-api-access-l74b8\") pod \"ovnkube-node-6b2c6\" (UID: \"b024e4d2-3c81-4ba3-986c-cbfe81bf883e\") " pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.540424 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.540388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4jvj" Jun 11 14:17:03.545766 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.545743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" Jun 11 14:17:03.555546 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.555520 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" Jun 11 14:17:03.563392 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.563364 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2hw4r" Jun 11 14:17:03.569299 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.569268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75zn5" Jun 11 14:17:03.576102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.576078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" Jun 11 14:17:03.581945 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.581921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:03.588806 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.588781 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:03.594456 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.594431 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2kk4" Jun 11 14:17:03.955105 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.955064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:03.955322 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:03.955113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:03.955322 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.955250 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:03.955322 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.955321 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:04.955302085 +0000 UTC m=+4.056883193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:03.955490 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.955254 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:03.955490 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:03.955406 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:04.955389401 +0000 UTC m=+4.056970508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:04.055690 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.055659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:04.055859 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.055816 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:04.055859 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.055841 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:04.055859 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.055853 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:04.056035 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.055913 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:05.055895735 +0000 UTC m=+4.157476864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:04.085045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.085011 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:17:04.130797 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.130582 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd4ccc4_6a2d_4197_a51c_7bc2c120a678.slice/crio-f37a726ca9ba492bf89bb4445d1df09a39a4677a9f00d60346a62923d35687a8 WatchSource:0}: Error finding container f37a726ca9ba492bf89bb4445d1df09a39a4677a9f00d60346a62923d35687a8: Status 404 returned error can't find the container with id f37a726ca9ba492bf89bb4445d1df09a39a4677a9f00d60346a62923d35687a8 Jun 11 14:17:04.131838 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.131808 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b59ab54_4cec_421d_b88f_299e804b4b0c.slice/crio-7a8149077ef04b0b9c4c10e9f7d998a729f10f2d212554a9478cabad9d5ef633 WatchSource:0}: Error finding container 7a8149077ef04b0b9c4c10e9f7d998a729f10f2d212554a9478cabad9d5ef633: Status 404 returned error can't find the container with id 7a8149077ef04b0b9c4c10e9f7d998a729f10f2d212554a9478cabad9d5ef633 Jun 11 14:17:04.133065 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.132932 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb024e4d2_3c81_4ba3_986c_cbfe81bf883e.slice/crio-168ab2980f41053a799190539131eeab04e1697833e822409dfa71728909256f WatchSource:0}: Error finding container 168ab2980f41053a799190539131eeab04e1697833e822409dfa71728909256f: Status 404 returned error can't find the container with id 168ab2980f41053a799190539131eeab04e1697833e822409dfa71728909256f Jun 11 14:17:04.138383 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.138360 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea96eeca_e4d0_4dc3_95e1_5b577a84cfb9.slice/crio-5aa92383fbf05fe8840f97c530655ff58e95345065ca3f02d36e0a90627b6027 WatchSource:0}: Error finding container 5aa92383fbf05fe8840f97c530655ff58e95345065ca3f02d36e0a90627b6027: Status 404 returned error can't find the container with id 5aa92383fbf05fe8840f97c530655ff58e95345065ca3f02d36e0a90627b6027 Jun 11 14:17:04.139333 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.139310 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64eaa29_5b0f_44f4_8745_89292784dd1e.slice/crio-e3fe0215f1ffc4599877be6ceda8db81024f7f40df181543ec912806862e26c1 WatchSource:0}: Error finding container e3fe0215f1ffc4599877be6ceda8db81024f7f40df181543ec912806862e26c1: Status 404 returned error can't find the container with id e3fe0215f1ffc4599877be6ceda8db81024f7f40df181543ec912806862e26c1 Jun 11 14:17:04.159996 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.159958 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e774368_db1d_433d_8481_3fb7305b949e.slice/crio-f7aa0d82139c416dc47b5ed798b9956778c669123e6b9ec4a214aaf7515ed526 WatchSource:0}: Error finding container f7aa0d82139c416dc47b5ed798b9956778c669123e6b9ec4a214aaf7515ed526: Status 404 returned error can't find the container with id f7aa0d82139c416dc47b5ed798b9956778c669123e6b9ec4a214aaf7515ed526 Jun 11 14:17:04.160921 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.160896 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9385f7_656f_4f88_9961_9baa83ab3bd2.slice/crio-4a30fd9914f6fc493f927b39ef6788261255a89d01996118b1a97dd5e6661795 WatchSource:0}: Error finding container 4a30fd9914f6fc493f927b39ef6788261255a89d01996118b1a97dd5e6661795: Status 404 returned error can't find the container with id 4a30fd9914f6fc493f927b39ef6788261255a89d01996118b1a97dd5e6661795 Jun 11 14:17:04.161749 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.161665 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609124a0_2b86_49a9_8fd6_2013db290ef1.slice/crio-e34a29b0a6bd4cfc8580aa3ec4685281c957095d355a23b92bab63a7afdaf60f WatchSource:0}: Error finding container e34a29b0a6bd4cfc8580aa3ec4685281c957095d355a23b92bab63a7afdaf60f: Status 404 returned error can't find the container with id e34a29b0a6bd4cfc8580aa3ec4685281c957095d355a23b92bab63a7afdaf60f Jun 11 14:17:04.163403 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:04.163350 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8c7c54_ce79_4beb_8cb3_3bc19e194f77.slice/crio-b0f90706364c4beb2bd0dd9b8d92eb2d26c2c71ea3c8d282294ad9b9da1808a5 WatchSource:0}: Error finding container b0f90706364c4beb2bd0dd9b8d92eb2d26c2c71ea3c8d282294ad9b9da1808a5: Status 404 returned error can't find the container with id b0f90706364c4beb2bd0dd9b8d92eb2d26c2c71ea3c8d282294ad9b9da1808a5 Jun 11 14:17:04.284327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.284293 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:12:03 +0000 UTC" deadline="2027-12-07 04:28:01.189793938 +0000 UTC" Jun 11 14:17:04.284327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.284323 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13046h10m56.905475882s" Jun 11 14:17:04.303546 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.303513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2hw4r" event={"ID":"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77","Type":"ContainerStarted","Data":"b0f90706364c4beb2bd0dd9b8d92eb2d26c2c71ea3c8d282294ad9b9da1808a5"} Jun 11 14:17:04.305130 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.305106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2kk4" event={"ID":"609124a0-2b86-49a9-8fd6-2013db290ef1","Type":"ContainerStarted","Data":"e34a29b0a6bd4cfc8580aa3ec4685281c957095d355a23b92bab63a7afdaf60f"} Jun 11 14:17:04.307984 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.307963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" event={"ID":"b64eaa29-5b0f-44f4-8745-89292784dd1e","Type":"ContainerStarted","Data":"e3fe0215f1ffc4599877be6ceda8db81024f7f40df181543ec912806862e26c1"} Jun 11 14:17:04.310247 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.310202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4jvj" event={"ID":"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9","Type":"ContainerStarted","Data":"5aa92383fbf05fe8840f97c530655ff58e95345065ca3f02d36e0a90627b6027"} Jun 11 14:17:04.311132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.311112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nckc7" event={"ID":"4b59ab54-4cec-421d-b88f-299e804b4b0c","Type":"ContainerStarted","Data":"7a8149077ef04b0b9c4c10e9f7d998a729f10f2d212554a9478cabad9d5ef633"} Jun 11 14:17:04.312047 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.312023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerStarted","Data":"f37a726ca9ba492bf89bb4445d1df09a39a4677a9f00d60346a62923d35687a8"} Jun 11 14:17:04.316816 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.316782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" event={"ID":"b1fb63bb1df8db54b165336d4644dafb","Type":"ContainerStarted","Data":"dc0700254e9c5479314b844624583220012b20bd081ad8c01352935958ed6cf7"} Jun 11 14:17:04.318191 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.318166 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75zn5" event={"ID":"6e774368-db1d-433d-8481-3fb7305b949e","Type":"ContainerStarted","Data":"f7aa0d82139c416dc47b5ed798b9956778c669123e6b9ec4a214aaf7515ed526"} Jun 11 14:17:04.320046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.320023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" event={"ID":"5c9385f7-656f-4f88-9961-9baa83ab3bd2","Type":"ContainerStarted","Data":"4a30fd9914f6fc493f927b39ef6788261255a89d01996118b1a97dd5e6661795"} Jun 11 14:17:04.324316 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.324294 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"168ab2980f41053a799190539131eeab04e1697833e822409dfa71728909256f"} Jun 11 14:17:04.331242 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.331169 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" podStartSLOduration=2.331151473 podStartE2EDuration="2.331151473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:04.330932104 +0000 UTC m=+3.432513235" watchObservedRunningTime="2026-06-11 14:17:04.331151473 +0000 UTC m=+3.432732604" Jun 11 14:17:04.963372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.963333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:04.963562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:04.963400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:04.963633 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.963563 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:04.963633 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.963623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:06.963603978 +0000 UTC m=+6.065185094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:04.964052 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.964031 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:04.964155 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:04.964086 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:06.96407027 +0000 UTC m=+6.065651382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:05.064598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.064488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:05.064781 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.064667 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:05.064781 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.064694 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:05.064781 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.064707 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:05.064781 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.064763 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:07.064744614 +0000 UTC m=+6.166325729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:05.284658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.284549 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:12:03 +0000 UTC" deadline="2028-02-17 23:35:03.320519638 +0000 UTC" Jun 11 14:17:05.284658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.284610 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14793h17m58.035914733s" Jun 11 14:17:05.294863 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.294833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:05.295015 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.294962 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:05.295411 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.295386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:05.295564 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.295540 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:05.297438 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.297398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:05.297549 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:05.297495 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:05.337139 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.336775 2574 generic.go:356] "Generic (PLEG): container finished" podID="bc5fb52b32051d0346300635b31e26cb" containerID="82e431b41565a8e09cf8327e74af8d81306635659a49f0221f1557edd678e4f6" exitCode=0 Jun 11 14:17:05.337139 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:05.336887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"bc5fb52b32051d0346300635b31e26cb","Type":"ContainerDied","Data":"82e431b41565a8e09cf8327e74af8d81306635659a49f0221f1557edd678e4f6"} Jun 11 14:17:06.356490 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:06.356452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"bc5fb52b32051d0346300635b31e26cb","Type":"ContainerStarted","Data":"95304d9cb208d55c4596fb171c04831ed770d583be6abf79eb7d4a6e5626ac8d"} Jun 11 14:17:06.373651 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:06.373578 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" podStartSLOduration=4.37355695 podStartE2EDuration="4.37355695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:06.373003684 +0000 UTC m=+5.474584815" watchObservedRunningTime="2026-06-11 14:17:06.37355695 +0000 UTC m=+5.475138081" Jun 11 14:17:06.989022 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:06.988982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:06.989198 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:06.989072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:06.989198 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:06.989186 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:06.989389 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:06.989268 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:10.989248886 +0000 UTC m=+10.090829997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:06.989474 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:06.989451 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:06.989553 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:06.989530 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:10.989511163 +0000 UTC m=+10.091092287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:07.089891 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:07.089857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:07.090121 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.090065 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:07.090121 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.090085 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:07.090121 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.090099 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:07.090364 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.090159 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:11.090138911 +0000 UTC m=+10.191720020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:07.294021 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:07.293992 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:07.294180 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.294092 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:07.294308 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:07.294289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:07.294404 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.294383 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:07.294532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:07.294466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:07.294642 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:07.294572 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:09.297987 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:09.297947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:09.298482 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:09.298075 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:09.298547 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:09.298509 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:09.298798 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:09.298607 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:09.298798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:09.298670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:09.298798 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:09.298766 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:11.023289 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.023237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:11.023753 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.023302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:11.023753 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.023422 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:11.023753 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.023424 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:11.023753 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.023488 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:19.023467835 +0000 UTC m=+18.125048964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:11.023753 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.023509 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:19.023497505 +0000 UTC m=+18.125078614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:11.125095 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.124406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:11.125095 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.124629 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:11.125095 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.124652 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:11.125095 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.124667 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:11.125095 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.124727 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:19.124709047 +0000 UTC m=+18.226290161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.294789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.294897 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.295259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.295360 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:11.295405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:11.295497 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:11.295466 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:13.294885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:13.294999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:13.295127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:13.295235 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:13.295300 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:13.295380 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:13.295381 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:15.294000 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:15.293967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:15.294000 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:15.293988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:15.294524 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:15.293967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:15.294524 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:15.294105 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:15.294524 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:15.294203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:15.294524 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:15.294303 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:17.294552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:17.294442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:17.294552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:17.294467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:17.294552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:17.294443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:17.295091 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:17.294576 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:17.295091 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:17.294660 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:17.295091 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:17.294736 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:19.090764 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.090719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:19.091423 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.090808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:19.091423 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.090874 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:19.091423 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.090899 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:19.091423 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.090970 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:35.090948261 +0000 UTC m=+34.192529370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:19.091423 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.090984 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:35.090977609 +0000 UTC m=+34.192558717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:19.192000 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.191965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:19.192169 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.192150 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:19.192237 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.192176 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:19.192237 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.192190 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:19.192313 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.192271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:35.192250559 +0000 UTC m=+34.293831675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:19.294825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.294791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:19.295012 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.294804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:19.295012 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.294924 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:19.295012 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:19.294934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:19.295176 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.295034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:19.295176 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:19.295110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:21.295507 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:21.295480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:21.295930 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:21.295573 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:21.295930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:21.295577 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:21.295930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:21.295615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:21.295930 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:21.295673 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:21.295930 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:21.295758 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:23.294624 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.294355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:23.295304 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:23.294732 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:23.295304 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.294837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:23.295304 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:23.294934 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:23.295304 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.295059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:23.295304 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:23.295150 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:23.389739 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.389528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2hw4r" event={"ID":"dc8c7c54-ce79-4beb-8cb3-3bc19e194f77","Type":"ContainerStarted","Data":"7a0de225529f036a6b83541a1abcefd5cea994300e6a8661ead6d1f81fc10b20"} Jun 11 14:17:23.391108 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.391079 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2kk4" event={"ID":"609124a0-2b86-49a9-8fd6-2013db290ef1","Type":"ContainerStarted","Data":"5fb551ff7538c6c7efb3f0c2131785b638ab9bc4f4998bb2550902c3547251ff"} Jun 11 14:17:23.392771 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.392742 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" event={"ID":"b64eaa29-5b0f-44f4-8745-89292784dd1e","Type":"ContainerStarted","Data":"529e3879e568cdaf4ab062ee6f62c7457beb0b243220a8a05d734beda2990e40"} Jun 11 14:17:23.394258 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.394235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nckc7" event={"ID":"4b59ab54-4cec-421d-b88f-299e804b4b0c","Type":"ContainerStarted","Data":"263d2d9df5713bf11b4cebe4b087a5548e382ba76d51d8e6ed5376a5ceb40df1"} Jun 11 14:17:23.395856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.395833 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="af14897c2b4c7bb8882d50e02e7f2328c6534ed75f70d4105921771ab1fa570a" exitCode=0 Jun 11 14:17:23.395953 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.395875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"af14897c2b4c7bb8882d50e02e7f2328c6534ed75f70d4105921771ab1fa570a"} Jun 11 14:17:23.397473 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.397416 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75zn5" event={"ID":"6e774368-db1d-433d-8481-3fb7305b949e","Type":"ContainerStarted","Data":"45fefc92b604172b268fae8f273bcca7bb4b0713b7b579a64c840f9cc723bd47"} Jun 11 14:17:23.399043 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.399012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" event={"ID":"5c9385f7-656f-4f88-9961-9baa83ab3bd2","Type":"ContainerStarted","Data":"1a6156ce9031f05cf1b5b4534b5000da4c45765b6d14ca0ee5354cfa3a6d83b2"} Jun 11 14:17:23.404911 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.404859 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2hw4r" podStartSLOduration=3.612083425 podStartE2EDuration="22.404843502s" totalImagesPullingTime="18.792760077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:23.404735635 +0000 UTC m=+22.506316766" watchObservedRunningTime="2026-06-11 14:17:23.404843502 +0000 UTC m=+22.506424633" Jun 11 14:17:23.418424 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.418379 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f2kk4" podStartSLOduration=3.601116489 podStartE2EDuration="22.418364454s" totalImagesPullingTime="18.817247965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:23.417804575 +0000 UTC m=+22.519385704" watchObservedRunningTime="2026-06-11 14:17:23.418364454 +0000 UTC m=+22.519945584" Jun 11 14:17:23.433851 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.433804 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x4cz7" podStartSLOduration=3.607901842 podStartE2EDuration="22.433789056s" totalImagesPullingTime="18.825887214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:23.433286385 +0000 UTC m=+22.534867515" watchObservedRunningTime="2026-06-11 14:17:23.433789056 +0000 UTC m=+22.535370185" Jun 11 14:17:23.449671 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.449551 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-75zn5" podStartSLOduration=3.6268222740000002 podStartE2EDuration="22.449534199s" totalImagesPullingTime="18.822711925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:23.449267151 +0000 UTC m=+22.550848283" watchObservedRunningTime="2026-06-11 14:17:23.449534199 +0000 UTC m=+22.551115328" Jun 11 14:17:23.484802 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:23.484757 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nckc7" podStartSLOduration=3.658712989 podStartE2EDuration="22.484740451s" totalImagesPullingTime="18.826027462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:23.484741801 +0000 UTC m=+22.586322932" watchObservedRunningTime="2026-06-11 14:17:23.484740451 +0000 UTC m=+22.586321582" Jun 11 14:17:24.403881 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.403847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:17:24.404520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404250 2574 generic.go:356] "Generic (PLEG): container finished" podID="b024e4d2-3c81-4ba3-986c-cbfe81bf883e" containerID="297955ee263cbe6d4fc25199964166c29a36c057051d9505222796644edeed4f" exitCode=1 Jun 11 14:17:24.404520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404287 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"2e5f752970d5f7cd93665f4e42ad5f9a23088d89dfe56e340478942b24482493"} Jun 11 14:17:24.404520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404432 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"5d386daae292606df3d16dd0f729e5211544bbf0bbc4c824716657d0b4013bff"} Jun 11 14:17:24.404520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"5b1767ca59a8b0ff42050b870477b84b07c97a1d81b510f99d3a9a187755b0e0"} Jun 11 14:17:24.404520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"6b70ee34919c1f199b96aa8e4f1ffdb526f4ac0cdbcd36ad4918fdf10c2406e8"} Jun 11 14:17:24.404717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerDied","Data":"297955ee263cbe6d4fc25199964166c29a36c057051d9505222796644edeed4f"} Jun 11 14:17:24.404717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.404627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"423ac59bfcc76402125da2f0dcedfd442979c40d02a1dabb0920dded68ef6bd9"} Jun 11 14:17:24.692931 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:24.692777 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:17:25.294023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.293994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:25.294314 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.293994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:25.294314 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.294002 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:25.294314 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:25.294165 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:25.294314 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:25.294202 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:25.294314 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:25.294282 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:25.297011 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.296920 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:17:24.692923343Z","UUID":"8b289b4f-c9b0-4581-95ff-5a8fabc299c2","Handler":null,"Name":"","Endpoint":""} Jun 11 14:17:25.298548 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.298528 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:17:25.298665 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.298569 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:17:25.408477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.408440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" event={"ID":"5c9385f7-656f-4f88-9961-9baa83ab3bd2","Type":"ContainerStarted","Data":"8102d83e4780712a03bf9b0b1353a48ce5ebb038290e2e6afbff81270eb558f0"} Jun 11 14:17:25.409691 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.409667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4jvj" event={"ID":"ea96eeca-e4d0-4dc3-95e1-5b577a84cfb9","Type":"ContainerStarted","Data":"7a8c7c51969f294eea835e99ad91945e2e3170419ed6156fff3cae0e9ddaec33"} Jun 11 14:17:25.424372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:25.424322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x4jvj" podStartSLOduration=5.5932394500000004 podStartE2EDuration="24.424307061s" totalImagesPullingTime="18.831067611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:25.423810418 +0000 UTC m=+24.525391547" watchObservedRunningTime="2026-06-11 14:17:25.424307061 +0000 UTC m=+24.525888192" Jun 11 14:17:26.201374 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.201334 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:26.201976 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.201953 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:26.413964 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.413910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" event={"ID":"5c9385f7-656f-4f88-9961-9baa83ab3bd2","Type":"ContainerStarted","Data":"860a3e4c2627093a1ef92681da573f57fca08a18a9d696f911313bc3f124c3ee"} Jun 11 14:17:26.416837 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.416817 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:17:26.417234 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.417202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"d1a05309b2092c3334255ca5ad0261f65df51bb4b47558015292a4f9de64e102"} Jun 11 14:17:26.417537 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.417519 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:26.417941 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.417919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nckc7" Jun 11 14:17:26.430094 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:26.430056 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgzgr" podStartSLOduration=4.392831473 podStartE2EDuration="25.430044095s" totalImagesPullingTime="21.037212622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:26.429433286 +0000 UTC m=+25.531014417" watchObservedRunningTime="2026-06-11 14:17:26.430044095 +0000 UTC m=+25.531625282" Jun 11 14:17:27.294738 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:27.294709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:27.294907 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:27.294753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:27.294907 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:27.294709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:27.294907 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:27.294829 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:27.295059 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:27.294904 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:27.295059 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:27.294990 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:28.425626 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:28.425390 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:17:28.426299 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:28.425959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"9b232dc6bec833fb0fd38c408637783d21819ec2ee5afe00dc3bfde8de836458"} Jun 11 14:17:28.426457 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:28.426441 2574 scope.go:117] "RemoveContainer" containerID="297955ee263cbe6d4fc25199964166c29a36c057051d9505222796644edeed4f" Jun 11 14:17:29.294466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.294429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:29.294681 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.294428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:29.294681 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.294438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:29.294681 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:29.294574 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:29.294853 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:29.294703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:29.294853 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:29.294784 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:29.433296 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.433266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:17:29.433812 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.433699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" event={"ID":"b024e4d2-3c81-4ba3-986c-cbfe81bf883e","Type":"ContainerStarted","Data":"c5a8a6cd03a0c60f3d099b9d0dd15192e553d04b4a6398d7619b004ba22b42e6"} Jun 11 14:17:29.433948 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.433916 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:29.434018 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.433992 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:29.434055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.434038 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:29.451606 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.451577 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:29.452170 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.452146 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:17:29.462318 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:29.462268 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" podStartSLOduration=9.293059852 podStartE2EDuration="28.462253669s" totalImagesPullingTime="19.169193817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:29.46097671 +0000 UTC m=+28.562557839" watchObservedRunningTime="2026-06-11 14:17:29.462253669 +0000 UTC m=+28.563834799" Jun 11 14:17:30.519096 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.519058 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krlhg"] Jun 11 14:17:30.519478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.519160 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:30.519478 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:30.519276 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:30.522529 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.522479 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgcp5"] Jun 11 14:17:30.522704 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.522647 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:30.522779 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:30.522756 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:30.523166 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.523144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tsk6"] Jun 11 14:17:30.523279 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:30.523249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:30.523360 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:30.523339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:31.439379 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:31.439341 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="d33e04c32acce8775afc6b31b907ac6737127d3f94cdfd7ea00f6b8377329db8" exitCode=0 Jun 11 14:17:31.439584 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:31.439430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"d33e04c32acce8775afc6b31b907ac6737127d3f94cdfd7ea00f6b8377329db8"} Jun 11 14:17:32.294547 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:32.294521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:32.295176 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:32.294553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:32.295176 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:32.294553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:32.295176 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:32.294634 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:32.295176 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:32.294726 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:32.295176 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:32.294794 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:33.446222 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:33.446167 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="e4f3ebb8a7e8dc35a9f885d2a3b348560063f986df3f1707b18c140d9a47fd2d" exitCode=0 Jun 11 14:17:33.446772 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:33.446242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"e4f3ebb8a7e8dc35a9f885d2a3b348560063f986df3f1707b18c140d9a47fd2d"} Jun 11 14:17:34.294473 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:34.294442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:34.294638 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:34.294537 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:34.294638 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:34.294545 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:34.294638 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:34.294566 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:34.294751 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:34.294640 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:34.294751 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:34.294707 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:34.450426 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:34.450391 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="4c08a83e8539bd0dcac436e0b9baa78a8bdf21f7d1e88c3e384d54f08968d36b" exitCode=0 Jun 11 14:17:34.450426 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:34.450430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"4c08a83e8539bd0dcac436e0b9baa78a8bdf21f7d1e88c3e384d54f08968d36b"} Jun 11 14:17:35.110439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:35.110403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:35.110617 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:35.110458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:35.110617 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.110585 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:35.110617 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.110591 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:35.110751 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.110647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret podName:b199705d-1cf4-4ed5-9e52-e1172189a769 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:07.11062811 +0000 UTC m=+66.212209219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret") pod "global-pull-secret-syncer-krlhg" (UID: "b199705d-1cf4-4ed5-9e52-e1172189a769") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:17:35.110751 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.110664 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:07.110655929 +0000 UTC m=+66.212237036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:17:35.211740 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:35.211699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:35.211889 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.211849 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:17:35.211889 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.211876 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:17:35.211889 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.211887 2574 projected.go:196] Error preparing data for projected volume kube-api-access-t4k6z for pod openshift-network-diagnostics/network-check-target-7tsk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:35.212024 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:35.211940 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z podName:cdd51a64-1671-4c5f-b315-06f18c97ba01 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:07.211925756 +0000 UTC m=+66.313506865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t4k6z" (UniqueName: "kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z") pod "network-check-target-7tsk6" (UID: "cdd51a64-1671-4c5f-b315-06f18c97ba01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:17:36.294691 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.294648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:36.294691 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.294674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:36.294691 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.294674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:36.295293 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:36.294772 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tsk6" podUID="cdd51a64-1671-4c5f-b315-06f18c97ba01" Jun 11 14:17:36.295293 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:36.294857 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krlhg" podUID="b199705d-1cf4-4ed5-9e52-e1172189a769" Jun 11 14:17:36.295293 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:36.294937 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:17:36.765962 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.765731 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeReady" Jun 11 14:17:36.766131 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.766072 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:17:36.814900 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.814859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmznc"] Jun 11 14:17:36.818998 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.818969 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4dr9d"] Jun 11 14:17:36.819170 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.819060 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:36.821559 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.821530 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:17:36.821705 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.821688 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:17:36.821769 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.821705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw4vr\"" Jun 11 14:17:36.823392 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.823375 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:36.824848 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.824829 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmznc"] Jun 11 14:17:36.827639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.827389 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:17:36.827639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.827615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:17:36.827827 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.827793 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqzqr\"" Jun 11 14:17:36.827827 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.827821 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:17:36.838456 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.838399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dr9d"] Jun 11 14:17:36.925777 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzmg7\" (UniqueName: \"kubernetes.io/projected/734fc394-a2e7-4254-8826-39aaa2b4e153-kube-api-access-pzmg7\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:36.925982 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/734fc394-a2e7-4254-8826-39aaa2b4e153-config-volume\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:36.925982 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/734fc394-a2e7-4254-8826-39aaa2b4e153-tmp-dir\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:36.925982 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:36.925982 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11327480-d2b8-4673-b2d2-85e6dea0157c-cert\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:36.926231 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:36.925998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4w9c\" (UniqueName: \"kubernetes.io/projected/11327480-d2b8-4673-b2d2-85e6dea0157c-kube-api-access-p4w9c\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.027046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/734fc394-a2e7-4254-8826-39aaa2b4e153-config-volume\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.027046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/734fc394-a2e7-4254-8826-39aaa2b4e153-tmp-dir\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.027294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.027294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11327480-d2b8-4673-b2d2-85e6dea0157c-cert\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.027294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4w9c\" (UniqueName: \"kubernetes.io/projected/11327480-d2b8-4673-b2d2-85e6dea0157c-kube-api-access-p4w9c\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.027294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzmg7\" (UniqueName: \"kubernetes.io/projected/734fc394-a2e7-4254-8826-39aaa2b4e153-kube-api-access-pzmg7\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.027294 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:37.027227 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:37.027517 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:37.027323 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:37.527300246 +0000 UTC m=+36.628881357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:37.027517 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/734fc394-a2e7-4254-8826-39aaa2b4e153-tmp-dir\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.027692 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.027669 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/734fc394-a2e7-4254-8826-39aaa2b4e153-config-volume\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.031709 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.031687 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11327480-d2b8-4673-b2d2-85e6dea0157c-cert\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.037840 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.037816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4w9c\" (UniqueName: \"kubernetes.io/projected/11327480-d2b8-4673-b2d2-85e6dea0157c-kube-api-access-p4w9c\") pod \"ingress-canary-4dr9d\" (UID: \"11327480-d2b8-4673-b2d2-85e6dea0157c\") " pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.038082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.038061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzmg7\" (UniqueName: \"kubernetes.io/projected/734fc394-a2e7-4254-8826-39aaa2b4e153-kube-api-access-pzmg7\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.136424 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.136338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dr9d" Jun 11 14:17:37.532631 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:37.532547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:37.533063 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:37.532717 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:37.533063 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:37.532800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:38.532777393 +0000 UTC m=+37.634358503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:38.294300 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.294267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:17:38.294478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.294268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:17:38.294478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.294268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:17:38.297239 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.297199 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:17:38.297239 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.297230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:17:38.298296 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.298274 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rmvh\"" Jun 11 14:17:38.298402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.298328 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mz2g\"" Jun 11 14:17:38.298459 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.298398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:17:38.298459 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.298418 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:17:38.531245 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.531201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dr9d"] Jun 11 14:17:38.541545 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:38.541518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:38.541893 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:38.541665 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:38.541893 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:38.541725 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:40.541709434 +0000 UTC m=+39.643290561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:38.601112 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:38.601026 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11327480_d2b8_4673_b2d2_85e6dea0157c.slice/crio-36212092dad716c1fe8bd236d719e876c9f3de3eca50c970f2eb9a720fd932e0 WatchSource:0}: Error finding container 36212092dad716c1fe8bd236d719e876c9f3de3eca50c970f2eb9a720fd932e0: Status 404 returned error can't find the container with id 36212092dad716c1fe8bd236d719e876c9f3de3eca50c970f2eb9a720fd932e0 Jun 11 14:17:39.466298 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:39.466049 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="9234eafb9989e7a58ce9c9dc775e82f8ad4716701b1564a4ec4427ebf2e31dad" exitCode=0 Jun 11 14:17:39.466520 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:39.466122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"9234eafb9989e7a58ce9c9dc775e82f8ad4716701b1564a4ec4427ebf2e31dad"} Jun 11 14:17:39.467725 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:39.467694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dr9d" event={"ID":"11327480-d2b8-4673-b2d2-85e6dea0157c","Type":"ContainerStarted","Data":"36212092dad716c1fe8bd236d719e876c9f3de3eca50c970f2eb9a720fd932e0"} Jun 11 14:17:40.472896 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:40.472862 2574 generic.go:356] "Generic (PLEG): container finished" podID="9cd4ccc4-6a2d-4197-a51c-7bc2c120a678" containerID="b56331885ea9372de35630542d5d0009a10fa228b42f26227120c63d62d4235b" exitCode=0 Jun 11 14:17:40.473374 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:40.472903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerDied","Data":"b56331885ea9372de35630542d5d0009a10fa228b42f26227120c63d62d4235b"} Jun 11 14:17:40.555926 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:40.555895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:40.556138 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:40.556119 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:40.556221 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:40.556195 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:44.556178716 +0000 UTC m=+43.657759823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:41.478272 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:41.478237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" event={"ID":"9cd4ccc4-6a2d-4197-a51c-7bc2c120a678","Type":"ContainerStarted","Data":"5eb7fa60a3293da258f2859afead2d52a3889dda73d45d84b13110b873b6efc0"} Jun 11 14:17:41.500805 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:41.500753 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j7fcd" podStartSLOduration=8.708119517 podStartE2EDuration="40.500739581s" totalImagesPullingTime="31.792620064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:41.499118791 +0000 UTC m=+40.600699921" watchObservedRunningTime="2026-06-11 14:17:41.500739581 +0000 UTC m=+40.602320710" Jun 11 14:17:42.481673 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:42.481633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dr9d" event={"ID":"11327480-d2b8-4673-b2d2-85e6dea0157c","Type":"ContainerStarted","Data":"920ee7c74779f68f470c9d9689bdf62dcc939ac9f33341cb1615911bfbe6ba3a"} Jun 11 14:17:42.496744 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:42.496687 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4dr9d" podStartSLOduration=3.701501303 podStartE2EDuration="6.496669022s" totalImagesPullingTime="2.795167719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:17:42.495938466 +0000 UTC m=+41.597519595" watchObservedRunningTime="2026-06-11 14:17:42.496669022 +0000 UTC m=+41.598250152" Jun 11 14:17:44.587651 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:44.587612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:44.588070 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:44.587733 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:44.588070 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:44.587785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:17:52.587772034 +0000 UTC m=+51.689353142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:52.645013 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:52.644974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:17:52.645474 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:52.645103 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:17:52.645474 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:17:52.645157 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:08.645144051 +0000 UTC m=+67.746725159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:17:57.043574 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.043542 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc"] Jun 11 14:17:57.045967 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.045951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.048323 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.048299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 14:17:57.048323 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.048307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 14:17:57.049306 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.049287 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 14:17:57.049306 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.049297 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 14:17:57.049483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.049362 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dd6p5\"" Jun 11 14:17:57.056154 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.056133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc"] Jun 11 14:17:57.076839 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.076807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09f13179-92a0-49b6-9d7d-729f07482fed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.076990 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.076861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frwnx\" (UniqueName: \"kubernetes.io/projected/09f13179-92a0-49b6-9d7d-729f07482fed-kube-api-access-frwnx\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.177797 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.177758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09f13179-92a0-49b6-9d7d-729f07482fed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.177994 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.177834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frwnx\" (UniqueName: \"kubernetes.io/projected/09f13179-92a0-49b6-9d7d-729f07482fed-kube-api-access-frwnx\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.181338 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.181315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09f13179-92a0-49b6-9d7d-729f07482fed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.185925 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.185893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frwnx\" (UniqueName: \"kubernetes.io/projected/09f13179-92a0-49b6-9d7d-729f07482fed-kube-api-access-frwnx\") pod \"managed-serviceaccount-addon-agent-57566d967b-d4fpc\" (UID: \"09f13179-92a0-49b6-9d7d-729f07482fed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.365166 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.365053 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:17:57.488231 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.488182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc"] Jun 11 14:17:57.491919 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:17:57.491893 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09f13179_92a0_49b6_9d7d_729f07482fed.slice/crio-2ddf17fc67f9fd7254c081911b468894a5ee9a4c2c279febdcf5d721a9b6e692 WatchSource:0}: Error finding container 2ddf17fc67f9fd7254c081911b468894a5ee9a4c2c279febdcf5d721a9b6e692: Status 404 returned error can't find the container with id 2ddf17fc67f9fd7254c081911b468894a5ee9a4c2c279febdcf5d721a9b6e692 Jun 11 14:17:57.517440 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:17:57.517408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerStarted","Data":"2ddf17fc67f9fd7254c081911b468894a5ee9a4c2c279febdcf5d721a9b6e692"} Jun 11 14:18:00.527332 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:00.527296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerStarted","Data":"0c3d2a3321d90a656e800addea8ada362018637126ac0aa297a1ca55390833a6"} Jun 11 14:18:00.542093 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:00.542042 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" podStartSLOduration=1.086589901 podStartE2EDuration="3.542027906s" totalImagesPullingTime="2.455438005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:00.541751381 +0000 UTC m=+59.643332525" watchObservedRunningTime="2026-06-11 14:18:00.542027906 +0000 UTC m=+59.643609057" Jun 11 14:18:01.450649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:01.450613 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6b2c6" Jun 11 14:18:07.143963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.143914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:18:07.143963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.143969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:18:07.146772 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.146746 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:18:07.146879 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.146860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:18:07.154738 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:07.154717 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:18:07.154793 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:07.154785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:19:11.154769537 +0000 UTC m=+130.256350645 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : secret "metrics-daemon-secret" not found Jun 11 14:18:07.156835 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.156808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b199705d-1cf4-4ed5-9e52-e1172189a769-original-pull-secret\") pod \"global-pull-secret-syncer-krlhg\" (UID: \"b199705d-1cf4-4ed5-9e52-e1172189a769\") " pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:18:07.244977 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.244941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:18:07.248419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.248396 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:18:07.257838 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.257818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:18:07.268392 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.268355 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4k6z\" (UniqueName: \"kubernetes.io/projected/cdd51a64-1671-4c5f-b315-06f18c97ba01-kube-api-access-t4k6z\") pod \"network-check-target-7tsk6\" (UID: \"cdd51a64-1671-4c5f-b315-06f18c97ba01\") " pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:18:07.413757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.413673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krlhg" Jun 11 14:18:07.420789 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.420762 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4rmvh\"" Jun 11 14:18:07.448724 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.430326 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:18:07.563303 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.563256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krlhg"] Jun 11 14:18:07.566835 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:18:07.566802 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb199705d_1cf4_4ed5_9e52_e1172189a769.slice/crio-aaa2610345a2c752977ac45c1898a8f451eca819242fead0a26e08205556f53e WatchSource:0}: Error finding container aaa2610345a2c752977ac45c1898a8f451eca819242fead0a26e08205556f53e: Status 404 returned error can't find the container with id aaa2610345a2c752977ac45c1898a8f451eca819242fead0a26e08205556f53e Jun 11 14:18:07.580386 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:07.580359 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tsk6"] Jun 11 14:18:07.583967 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:18:07.583947 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd51a64_1671_4c5f_b315_06f18c97ba01.slice/crio-94be0a8c2e8dcd8a46ae2edc5857a2a1f14b1320de4b53d6315ca0dfd9185d42 WatchSource:0}: Error finding container 94be0a8c2e8dcd8a46ae2edc5857a2a1f14b1320de4b53d6315ca0dfd9185d42: Status 404 returned error can't find the container with id 94be0a8c2e8dcd8a46ae2edc5857a2a1f14b1320de4b53d6315ca0dfd9185d42 Jun 11 14:18:08.548293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:08.548251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krlhg" event={"ID":"b199705d-1cf4-4ed5-9e52-e1172189a769","Type":"ContainerStarted","Data":"aaa2610345a2c752977ac45c1898a8f451eca819242fead0a26e08205556f53e"} Jun 11 14:18:08.549502 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:08.549477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tsk6" event={"ID":"cdd51a64-1671-4c5f-b315-06f18c97ba01","Type":"ContainerStarted","Data":"94be0a8c2e8dcd8a46ae2edc5857a2a1f14b1320de4b53d6315ca0dfd9185d42"} Jun 11 14:18:08.655357 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:08.655319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:18:08.655544 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:08.655477 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:08.655608 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:08.655553 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:18:40.6555334 +0000 UTC m=+99.757114511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:18:13.564609 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:13.564569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krlhg" event={"ID":"b199705d-1cf4-4ed5-9e52-e1172189a769","Type":"ContainerStarted","Data":"255d7b4ed7dec013d833021118ea0efd5db3f50114a31b4ece52cb2da4634efa"} Jun 11 14:18:13.565955 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:13.565922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tsk6" event={"ID":"cdd51a64-1671-4c5f-b315-06f18c97ba01","Type":"ContainerStarted","Data":"031738e09e1b6a37b5dcd87a6cf89719d5e98ab5639f1f44e4b888c6779bacc1"} Jun 11 14:18:13.566056 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:13.565991 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:18:13.579278 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:13.579231 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-krlhg" podStartSLOduration=67.384614275 podStartE2EDuration="1m12.579197356s" totalImagesPullingTime="5.194583081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:13.57917024 +0000 UTC m=+72.680751383" watchObservedRunningTime="2026-06-11 14:18:13.579197356 +0000 UTC m=+72.680778476" Jun 11 14:18:13.593670 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:13.593529 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tsk6" podStartSLOduration=67.415119661 podStartE2EDuration="1m12.593512064s" totalImagesPullingTime="5.178392403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:18:13.592939907 +0000 UTC m=+72.694521037" watchObservedRunningTime="2026-06-11 14:18:13.593512064 +0000 UTC m=+72.695093196" Jun 11 14:18:40.685689 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:40.685638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:18:40.686074 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:40.685787 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:18:40.686074 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:18:40.685853 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:19:44.685834416 +0000 UTC m=+163.787415525 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:18:44.570795 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:18:44.570762 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tsk6" Jun 11 14:19:11.181864 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:19:11.181813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:19:11.182334 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:11.181939 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:19:11.182334 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:11.182017 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs podName:0252c30d-715a-4fe4-827f-de40c73a58f7 nodeName:}" failed. No retries permitted until 2026-06-11 14:21:13.182001351 +0000 UTC m=+252.283582459 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs") pod "network-metrics-daemon-kgcp5" (UID: "0252c30d-715a-4fe4-827f-de40c73a58f7") : secret "metrics-daemon-secret" not found Jun 11 14:19:39.831595 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:39.831543 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hmznc" podUID="734fc394-a2e7-4254-8826-39aaa2b4e153" Jun 11 14:19:40.768510 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:19:40.768484 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmznc" Jun 11 14:19:41.306844 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:41.306791 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kgcp5" podUID="0252c30d-715a-4fe4-827f-de40c73a58f7" Jun 11 14:19:44.711448 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:19:44.711388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:19:44.711852 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:44.711536 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:19:44.711852 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:19:44.711600 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls podName:734fc394-a2e7-4254-8826-39aaa2b4e153 nodeName:}" failed. No retries permitted until 2026-06-11 14:21:46.711583596 +0000 UTC m=+285.813164704 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls") pod "dns-default-hmznc" (UID: "734fc394-a2e7-4254-8826-39aaa2b4e153") : secret "dns-default-metrics-tls" not found Jun 11 14:19:54.294914 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:19:54.294823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:20:00.814147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:00.814112 2574 generic.go:356] "Generic (PLEG): container finished" podID="09f13179-92a0-49b6-9d7d-729f07482fed" containerID="0c3d2a3321d90a656e800addea8ada362018637126ac0aa297a1ca55390833a6" exitCode=255 Jun 11 14:20:00.814558 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:00.814160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerDied","Data":"0c3d2a3321d90a656e800addea8ada362018637126ac0aa297a1ca55390833a6"} Jun 11 14:20:00.819656 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:00.819636 2574 scope.go:117] "RemoveContainer" containerID="0c3d2a3321d90a656e800addea8ada362018637126ac0aa297a1ca55390833a6" Jun 11 14:20:01.819108 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:01.819077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerStarted","Data":"c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c"} Jun 11 14:20:31.515366 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.515331 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:20:31.517166 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.517148 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76b6cc4cf9-8cxgp"] Jun 11 14:20:31.517338 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.517318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.518546 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.518528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.523301 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.523278 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 14:20:31.523757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.523439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 14:20:31.523757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.523286 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lzk8r\"" Jun 11 14:20:31.523757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.523576 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 14:20:31.523757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.523668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 14:20:31.524280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.524234 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 14:20:31.524280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.524266 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7pxhm\"" Jun 11 14:20:31.524516 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.524475 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:20:31.524588 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.524548 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:20:31.524975 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.524742 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 14:20:31.530278 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.530250 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 14:20:31.533134 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.533102 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 14:20:31.543451 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.543425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:20:31.546883 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.546860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b6cc4cf9-8cxgp"] Jun 11 14:20:31.607758 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.607725 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n"] Jun 11 14:20:31.609422 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.609407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" Jun 11 14:20:31.611922 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.611899 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:20:31.612059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.611902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 14:20:31.612059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.612041 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g6mqr\"" Jun 11 14:20:31.614450 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614499 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.614499 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614524 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdm5w\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhnw\" (UniqueName: \"kubernetes.io/projected/0425a27f-ec46-410e-8ca7-64c890d286d6-kube-api-access-zmhnw\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.614586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614583 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614755 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614755 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-stats-auth\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.614755 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.614887 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-default-certificate\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.614887 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.614790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.628842 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.628807 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n"] Jun 11 14:20:31.715145 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715145 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdm5w\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhnw\" (UniqueName: \"kubernetes.io/projected/0425a27f-ec46-410e-8ca7-64c890d286d6-kube-api-access-zmhnw\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.715303 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.715324 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b49c7f9-4mfw2: secret "image-registry-tls" not found Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.715300 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715434 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.715420 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:32.215397017 +0000 UTC m=+211.316978124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : secret "router-metrics-certs-default" not found Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.715531 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls podName:a335f452-1e16-4042-a665-6bea384296ae nodeName:}" failed. No retries permitted until 2026-06-11 14:20:32.215518759 +0000 UTC m=+211.317099867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls") pod "image-registry-597b49c7f9-4mfw2" (UID: "a335f452-1e16-4042-a665-6bea384296ae") : secret "image-registry-tls" not found Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-stats-auth\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-default-certificate\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.715997 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.715681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9mgd\" (UniqueName: \"kubernetes.io/projected/64c7fc19-3b5e-4369-8473-814dffbe2128-kube-api-access-c9mgd\") pod \"volume-data-source-validator-78dd696465-rsh5n\" (UID: \"64c7fc19-3b5e-4369-8473-814dffbe2128\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" Jun 11 14:20:31.716353 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.716018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.716353 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:31.716132 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:32.216116287 +0000 UTC m=+211.317697400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:31.716466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.716435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.718312 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.718286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.718626 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.718606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-default-certificate\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.718671 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.718606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-stats-auth\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.718671 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.718638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.724148 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.724125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhnw\" (UniqueName: \"kubernetes.io/projected/0425a27f-ec46-410e-8ca7-64c890d286d6-kube-api-access-zmhnw\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:31.727291 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.727266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.727885 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.727863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdm5w\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:31.816640 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.816604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9mgd\" (UniqueName: \"kubernetes.io/projected/64c7fc19-3b5e-4369-8473-814dffbe2128-kube-api-access-c9mgd\") pod \"volume-data-source-validator-78dd696465-rsh5n\" (UID: \"64c7fc19-3b5e-4369-8473-814dffbe2128\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" Jun 11 14:20:31.824595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.824572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9mgd\" (UniqueName: \"kubernetes.io/projected/64c7fc19-3b5e-4369-8473-814dffbe2128-kube-api-access-c9mgd\") pod \"volume-data-source-validator-78dd696465-rsh5n\" (UID: \"64c7fc19-3b5e-4369-8473-814dffbe2128\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" Jun 11 14:20:31.918266 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:31.918226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" Jun 11 14:20:32.039790 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:32.039758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n"] Jun 11 14:20:32.044101 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:20:32.044034 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c7fc19_3b5e_4369_8473_814dffbe2128.slice/crio-a1a35d46b5f6843a9e34ad4f4175b8ca564ab4bc8c55f7960aac8dbd4efe54e1 WatchSource:0}: Error finding container a1a35d46b5f6843a9e34ad4f4175b8ca564ab4bc8c55f7960aac8dbd4efe54e1: Status 404 returned error can't find the container with id a1a35d46b5f6843a9e34ad4f4175b8ca564ab4bc8c55f7960aac8dbd4efe54e1 Jun 11 14:20:32.220522 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:32.220418 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:32.220522 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:32.220474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:32.220522 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:32.220505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220586 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220598 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:33.220580718 +0000 UTC m=+212.322161826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220608 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220620 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b49c7f9-4mfw2: secret "image-registry-tls" not found Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220634 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:33.220621401 +0000 UTC m=+212.322202509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : secret "router-metrics-certs-default" not found Jun 11 14:20:32.220745 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:32.220657 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls podName:a335f452-1e16-4042-a665-6bea384296ae nodeName:}" failed. No retries permitted until 2026-06-11 14:20:33.220642851 +0000 UTC m=+212.322223959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls") pod "image-registry-597b49c7f9-4mfw2" (UID: "a335f452-1e16-4042-a665-6bea384296ae") : secret "image-registry-tls" not found Jun 11 14:20:32.907689 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:32.907654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" event={"ID":"64c7fc19-3b5e-4369-8473-814dffbe2128","Type":"ContainerStarted","Data":"a1a35d46b5f6843a9e34ad4f4175b8ca564ab4bc8c55f7960aac8dbd4efe54e1"} Jun 11 14:20:33.231181 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:33.231082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:33.231181 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:33.231136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:33.231181 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:33.231184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231255 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:35.23129954 +0000 UTC m=+214.332880648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : secret "router-metrics-certs-default" not found Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231316 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231330 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:35.231321954 +0000 UTC m=+214.332903062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231332 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b49c7f9-4mfw2: secret "image-registry-tls" not found Jun 11 14:20:33.231419 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:33.231373 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls podName:a335f452-1e16-4042-a665-6bea384296ae nodeName:}" failed. No retries permitted until 2026-06-11 14:20:35.231358511 +0000 UTC m=+214.332939636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls") pod "image-registry-597b49c7f9-4mfw2" (UID: "a335f452-1e16-4042-a665-6bea384296ae") : secret "image-registry-tls" not found Jun 11 14:20:33.915715 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:33.915674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" event={"ID":"64c7fc19-3b5e-4369-8473-814dffbe2128","Type":"ContainerStarted","Data":"8f5b7cae2c24bea71556f0bb198c7d9eafd9f94a6d2c387c8ba9fbb3c9c3b533"} Jun 11 14:20:33.932292 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:33.932228 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-rsh5n" podStartSLOduration=1.971100026 podStartE2EDuration="2.932198237s" totalImagesPullingTime="961.098211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:20:33.931355077 +0000 UTC m=+213.032936210" watchObservedRunningTime="2026-06-11 14:20:33.932198237 +0000 UTC m=+213.033779367" Jun 11 14:20:35.246048 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:35.246007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:35.246078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:35.246108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246184 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246202 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246230 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b49c7f9-4mfw2: secret "image-registry-tls" not found Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246288 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:39.246272741 +0000 UTC m=+218.347853849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : secret "router-metrics-certs-default" not found Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246303 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:39.246297247 +0000 UTC m=+218.347878355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:35.246503 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:35.246318 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls podName:a335f452-1e16-4042-a665-6bea384296ae nodeName:}" failed. No retries permitted until 2026-06-11 14:20:39.246312154 +0000 UTC m=+218.347893261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls") pod "image-registry-597b49c7f9-4mfw2" (UID: "a335f452-1e16-4042-a665-6bea384296ae") : secret "image-registry-tls" not found Jun 11 14:20:38.947773 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:38.947743 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2kk4_609124a0-2b86-49a9-8fd6-2013db290ef1/dns-node-resolver/0.log" Jun 11 14:20:39.278066 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.277962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:39.278066 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.278020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:39.278066 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.278051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278141 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278153 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b49c7f9-4mfw2: secret "image-registry-tls" not found Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278143 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:47.278121773 +0000 UTC m=+226.379702881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278196 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls podName:a335f452-1e16-4042-a665-6bea384296ae nodeName:}" failed. No retries permitted until 2026-06-11 14:20:47.278183746 +0000 UTC m=+226.379764854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls") pod "image-registry-597b49c7f9-4mfw2" (UID: "a335f452-1e16-4042-a665-6bea384296ae") : secret "image-registry-tls" not found Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278194 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 14:20:39.278362 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:39.278283 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:20:47.278267769 +0000 UTC m=+226.379848877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : secret "router-metrics-certs-default" not found Jun 11 14:20:39.545517 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.545487 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2hw4r_dc8c7c54-ce79-4beb-8cb3-3bc19e194f77/node-ca/0.log" Jun 11 14:20:39.749416 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.749383 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-95z4q"] Jun 11 14:20:39.751245 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.751229 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.754175 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.754142 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 14:20:39.754334 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.754229 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 14:20:39.754334 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.754259 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 14:20:39.754334 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.754144 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 14:20:39.755346 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.755328 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-59llg\"" Jun 11 14:20:39.766439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.766415 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-95z4q"] Jun 11 14:20:39.883843 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.883746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xb8h\" (UniqueName: \"kubernetes.io/projected/89b8be72-c629-4691-86af-e94fcf5b898e-kube-api-access-2xb8h\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.883999 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.883911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/89b8be72-c629-4691-86af-e94fcf5b898e-signing-key\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.883999 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.883943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/89b8be72-c629-4691-86af-e94fcf5b898e-signing-cabundle\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.984775 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.984725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/89b8be72-c629-4691-86af-e94fcf5b898e-signing-cabundle\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.984775 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.984778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xb8h\" (UniqueName: \"kubernetes.io/projected/89b8be72-c629-4691-86af-e94fcf5b898e-kube-api-access-2xb8h\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.985189 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.984993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/89b8be72-c629-4691-86af-e94fcf5b898e-signing-key\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.985410 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.985391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/89b8be72-c629-4691-86af-e94fcf5b898e-signing-cabundle\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.987272 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.987253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/89b8be72-c629-4691-86af-e94fcf5b898e-signing-key\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:39.994264 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:39.994233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xb8h\" (UniqueName: \"kubernetes.io/projected/89b8be72-c629-4691-86af-e94fcf5b898e-kube-api-access-2xb8h\") pod \"service-ca-7d74d578b8-95z4q\" (UID: \"89b8be72-c629-4691-86af-e94fcf5b898e\") " pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:40.063259 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:40.063219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" Jun 11 14:20:40.188580 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:40.188538 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-95z4q"] Jun 11 14:20:40.191457 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:20:40.191431 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b8be72_c629_4691_86af_e94fcf5b898e.slice/crio-7e984162bc50c6793ca6fce4c9729a175993b9083bc37b55ac5669e9b85c60d6 WatchSource:0}: Error finding container 7e984162bc50c6793ca6fce4c9729a175993b9083bc37b55ac5669e9b85c60d6: Status 404 returned error can't find the container with id 7e984162bc50c6793ca6fce4c9729a175993b9083bc37b55ac5669e9b85c60d6 Jun 11 14:20:40.345251 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:40.345226 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dr9d_11327480-d2b8-4673-b2d2-85e6dea0157c/serve-healthcheck-canary/0.log" Jun 11 14:20:40.938094 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:40.938057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" event={"ID":"89b8be72-c629-4691-86af-e94fcf5b898e","Type":"ContainerStarted","Data":"7e984162bc50c6793ca6fce4c9729a175993b9083bc37b55ac5669e9b85c60d6"} Jun 11 14:20:41.942200 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:41.942166 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" event={"ID":"89b8be72-c629-4691-86af-e94fcf5b898e","Type":"ContainerStarted","Data":"f08303a6b740fdb043c5c28a2c6ef84656c5487451e0dfedb52d0e8ecf39a0af"} Jun 11 14:20:41.967757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:41.967704 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-95z4q" podStartSLOduration=1.346248298 podStartE2EDuration="2.967688219s" totalImagesPullingTime="1.621439921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:20:41.964293933 +0000 UTC m=+221.065875070" watchObservedRunningTime="2026-06-11 14:20:41.967688219 +0000 UTC m=+221.069269357" Jun 11 14:20:47.347046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.347009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:47.347523 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.347058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:47.347523 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.347106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:47.347523 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:20:47.347229 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle podName:0425a27f-ec46-410e-8ca7-64c890d286d6 nodeName:}" failed. No retries permitted until 2026-06-11 14:21:03.34720128 +0000 UTC m=+242.448782391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle") pod "router-default-76b6cc4cf9-8cxgp" (UID: "0425a27f-ec46-410e-8ca7-64c890d286d6") : configmap references non-existent config key: service-ca.crt Jun 11 14:20:47.349683 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.349654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"image-registry-597b49c7f9-4mfw2\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:47.349825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.349654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0425a27f-ec46-410e-8ca7-64c890d286d6-metrics-certs\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:20:47.427952 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.427912 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:47.592819 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.592785 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:20:47.596417 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:20:47.596391 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda335f452_1e16_4042_a665_6bea384296ae.slice/crio-1de7208d3c3bcad8a3c3eb7af8e6f323769fde3cc9a01372e8f307aa29153c10 WatchSource:0}: Error finding container 1de7208d3c3bcad8a3c3eb7af8e6f323769fde3cc9a01372e8f307aa29153c10: Status 404 returned error can't find the container with id 1de7208d3c3bcad8a3c3eb7af8e6f323769fde3cc9a01372e8f307aa29153c10 Jun 11 14:20:47.964111 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.964024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" event={"ID":"a335f452-1e16-4042-a665-6bea384296ae","Type":"ContainerStarted","Data":"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286"} Jun 11 14:20:47.964111 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.964077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" event={"ID":"a335f452-1e16-4042-a665-6bea384296ae","Type":"ContainerStarted","Data":"1de7208d3c3bcad8a3c3eb7af8e6f323769fde3cc9a01372e8f307aa29153c10"} Jun 11 14:20:47.964376 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:47.964140 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:20:48.000128 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:20:48.000069 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" podStartSLOduration=17.000049686 podStartE2EDuration="17.000049686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:20:47.997254578 +0000 UTC m=+227.098835710" watchObservedRunningTime="2026-06-11 14:20:48.000049686 +0000 UTC m=+227.101630805" Jun 11 14:21:03.365461 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:03.365413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:03.366038 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:03.366016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0425a27f-ec46-410e-8ca7-64c890d286d6-service-ca-bundle\") pod \"router-default-76b6cc4cf9-8cxgp\" (UID: \"0425a27f-ec46-410e-8ca7-64c890d286d6\") " pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:03.635350 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:03.635265 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7pxhm\"" Jun 11 14:21:03.642973 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:03.642945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:03.778836 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:03.778802 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b6cc4cf9-8cxgp"] Jun 11 14:21:03.782056 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:03.782027 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0425a27f_ec46_410e_8ca7_64c890d286d6.slice/crio-af9c79bd690ba669e08dc746a1a7ce91a1822e8a9e0f211d712afa386ddc73be WatchSource:0}: Error finding container af9c79bd690ba669e08dc746a1a7ce91a1822e8a9e0f211d712afa386ddc73be: Status 404 returned error can't find the container with id af9c79bd690ba669e08dc746a1a7ce91a1822e8a9e0f211d712afa386ddc73be Jun 11 14:21:04.013416 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.013337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" event={"ID":"0425a27f-ec46-410e-8ca7-64c890d286d6","Type":"ContainerStarted","Data":"f003679969be60186e17dbb3be964315f86421d8cab477a380000d56318a0b17"} Jun 11 14:21:04.013416 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.013385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" event={"ID":"0425a27f-ec46-410e-8ca7-64c890d286d6","Type":"ContainerStarted","Data":"af9c79bd690ba669e08dc746a1a7ce91a1822e8a9e0f211d712afa386ddc73be"} Jun 11 14:21:04.034402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.034345 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" podStartSLOduration=33.034329245 podStartE2EDuration="33.034329245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:04.032730764 +0000 UTC m=+243.134311893" watchObservedRunningTime="2026-06-11 14:21:04.034329245 +0000 UTC m=+243.135910375" Jun 11 14:21:04.463677 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.463642 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xj2l9"] Jun 11 14:21:04.466884 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.466865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.470552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.470529 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:21:04.471170 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.471151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cgdf\"" Jun 11 14:21:04.471684 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.471663 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:21:04.471767 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.471703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:21:04.471940 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.471928 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:21:04.486646 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.486611 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:21:04.490981 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.490848 2574 patch_prober.go:28] interesting pod/image-registry-597b49c7f9-4mfw2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:04.490981 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.490911 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:04.491513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.491490 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xj2l9"] Jun 11 14:21:04.575297 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.575262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09143d69-38ea-4350-b8a4-5636cd5081a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.575479 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.575333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09143d69-38ea-4350-b8a4-5636cd5081a4-crio-socket\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.575479 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.575374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sct8p\" (UniqueName: \"kubernetes.io/projected/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-api-access-sct8p\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.575479 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.575428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.575479 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.575449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09143d69-38ea-4350-b8a4-5636cd5081a4-data-volume\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.578201 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.578172 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f5fc7fc85-gd74h"] Jun 11 14:21:04.580929 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.580907 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.643665 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.643627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:04.646058 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.646033 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:04.653430 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.653404 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5fc7fc85-gd74h"] Jun 11 14:21:04.677415 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.677366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-registry-certificates\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.677678 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.677659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.677793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.677779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09143d69-38ea-4350-b8a4-5636cd5081a4-data-volume\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.677917 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.677900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-image-registry-private-configuration\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678029 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09143d69-38ea-4350-b8a4-5636cd5081a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.678132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-installation-pull-secrets\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678287 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da635b33-2f18-4f58-9b22-43927c928499-ca-trust-extracted\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678391 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-bound-sa-token\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678515 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-trusted-ca\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678618 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-registry-tls\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678716 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09143d69-38ea-4350-b8a4-5636cd5081a4-crio-socket\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.678817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9bg\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-kube-api-access-rh9bg\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.678915 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.678903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sct8p\" (UniqueName: \"kubernetes.io/projected/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-api-access-sct8p\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.679473 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.679426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09143d69-38ea-4350-b8a4-5636cd5081a4-crio-socket\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.680116 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.680092 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09143d69-38ea-4350-b8a4-5636cd5081a4-data-volume\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.680347 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.680324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.682078 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.682056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09143d69-38ea-4350-b8a4-5636cd5081a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.688453 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.688432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sct8p\" (UniqueName: \"kubernetes.io/projected/09143d69-38ea-4350-b8a4-5636cd5081a4-kube-api-access-sct8p\") pod \"insights-runtime-extractor-xj2l9\" (UID: \"09143d69-38ea-4350-b8a4-5636cd5081a4\") " pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.775423 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.775332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xj2l9" Jun 11 14:21:04.779438 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9bg\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-kube-api-access-rh9bg\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779512 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-registry-certificates\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779557 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-image-registry-private-configuration\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779767 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-installation-pull-secrets\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da635b33-2f18-4f58-9b22-43927c928499-ca-trust-extracted\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-bound-sa-token\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-trusted-ca\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.779960 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.779911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-registry-tls\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.780436 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.780396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da635b33-2f18-4f58-9b22-43927c928499-ca-trust-extracted\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.780565 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.780491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-registry-certificates\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.781414 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.781384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da635b33-2f18-4f58-9b22-43927c928499-trusted-ca\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.782607 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.782583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-registry-tls\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.782688 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.782644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-installation-pull-secrets\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.782729 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.782683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da635b33-2f18-4f58-9b22-43927c928499-image-registry-private-configuration\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.797545 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.797515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-bound-sa-token\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.798505 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.798481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9bg\" (UniqueName: \"kubernetes.io/projected/da635b33-2f18-4f58-9b22-43927c928499-kube-api-access-rh9bg\") pod \"image-registry-7f5fc7fc85-gd74h\" (UID: \"da635b33-2f18-4f58-9b22-43927c928499\") " pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.889710 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.889666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:04.933256 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:04.933200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xj2l9"] Jun 11 14:21:04.936678 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:04.936647 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09143d69_38ea_4350_b8a4_5636cd5081a4.slice/crio-57d884338238fe071cfb260eb5843c5a1af6ba89082f27749eb430b70b6b14a6 WatchSource:0}: Error finding container 57d884338238fe071cfb260eb5843c5a1af6ba89082f27749eb430b70b6b14a6: Status 404 returned error can't find the container with id 57d884338238fe071cfb260eb5843c5a1af6ba89082f27749eb430b70b6b14a6 Jun 11 14:21:05.018483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:05.018447 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xj2l9" event={"ID":"09143d69-38ea-4350-b8a4-5636cd5081a4","Type":"ContainerStarted","Data":"c4deea181d834bafc7d4764f017232f1f9506daa3045d7559b7cd4cec1813ed0"} Jun 11 14:21:05.018665 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:05.018515 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xj2l9" event={"ID":"09143d69-38ea-4350-b8a4-5636cd5081a4","Type":"ContainerStarted","Data":"57d884338238fe071cfb260eb5843c5a1af6ba89082f27749eb430b70b6b14a6"} Jun 11 14:21:05.018665 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:05.018625 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:05.019912 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:05.019892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76b6cc4cf9-8cxgp" Jun 11 14:21:05.044471 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:05.044440 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5fc7fc85-gd74h"] Jun 11 14:21:05.048276 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:05.048251 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda635b33_2f18_4f58_9b22_43927c928499.slice/crio-8d1b71d1df4b32048f3aaccd04adcc310e840153a7333a6b507354b6e226270a WatchSource:0}: Error finding container 8d1b71d1df4b32048f3aaccd04adcc310e840153a7333a6b507354b6e226270a: Status 404 returned error can't find the container with id 8d1b71d1df4b32048f3aaccd04adcc310e840153a7333a6b507354b6e226270a Jun 11 14:21:06.023942 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:06.023841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" event={"ID":"da635b33-2f18-4f58-9b22-43927c928499","Type":"ContainerStarted","Data":"45f596718df7d3c2fa9e91d38b509df47b6c97e244d63e8a6ec21003071ae1c9"} Jun 11 14:21:06.023942 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:06.023892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" event={"ID":"da635b33-2f18-4f58-9b22-43927c928499","Type":"ContainerStarted","Data":"8d1b71d1df4b32048f3aaccd04adcc310e840153a7333a6b507354b6e226270a"} Jun 11 14:21:06.024441 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:06.023959 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:06.025717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:06.025694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xj2l9" event={"ID":"09143d69-38ea-4350-b8a4-5636cd5081a4","Type":"ContainerStarted","Data":"d5a5f22d0b467192da97f0402b30def6500b03ce97e2c6a4cd13a9c2b4640949"} Jun 11 14:21:06.053284 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:06.053229 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podStartSLOduration=2.05319112 podStartE2EDuration="2.05319112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:06.05293178 +0000 UTC m=+245.154512911" watchObservedRunningTime="2026-06-11 14:21:06.05319112 +0000 UTC m=+245.154772249" Jun 11 14:21:08.033969 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:08.033884 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xj2l9" event={"ID":"09143d69-38ea-4350-b8a4-5636cd5081a4","Type":"ContainerStarted","Data":"762adb13cc8c980df1dc2a0cc9d18dd1890479ebbe8d61b352f55bd03fb1f34d"} Jun 11 14:21:13.246288 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.246229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:21:13.248496 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.248474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0252c30d-715a-4fe4-827f-de40c73a58f7-metrics-certs\") pod \"network-metrics-daemon-kgcp5\" (UID: \"0252c30d-715a-4fe4-827f-de40c73a58f7\") " pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:21:13.498703 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.498613 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2mz2g\"" Jun 11 14:21:13.506893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.506871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgcp5" Jun 11 14:21:13.636363 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.636312 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xj2l9" podStartSLOduration=7.011081798 podStartE2EDuration="9.636290301s" totalImagesPullingTime="2.625208503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:21:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:08.064334603 +0000 UTC m=+247.165915734" watchObservedRunningTime="2026-06-11 14:21:13.636290301 +0000 UTC m=+252.737871431" Jun 11 14:21:13.636963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:13.636947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgcp5"] Jun 11 14:21:13.639955 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:13.639930 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0252c30d_715a_4fe4_827f_de40c73a58f7.slice/crio-df562127cca3d27d53ae5973ee9ce74b65110950c1dcb299f316ba3b16ef8cf0 WatchSource:0}: Error finding container df562127cca3d27d53ae5973ee9ce74b65110950c1dcb299f316ba3b16ef8cf0: Status 404 returned error can't find the container with id df562127cca3d27d53ae5973ee9ce74b65110950c1dcb299f316ba3b16ef8cf0 Jun 11 14:21:14.055037 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.054993 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgcp5" event={"ID":"0252c30d-715a-4fe4-827f-de40c73a58f7","Type":"ContainerStarted","Data":"df562127cca3d27d53ae5973ee9ce74b65110950c1dcb299f316ba3b16ef8cf0"} Jun 11 14:21:14.491786 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.491680 2574 patch_prober.go:28] interesting pod/image-registry-597b49c7f9-4mfw2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:14.491786 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.491747 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:14.825480 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.823873 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn"] Jun 11 14:21:14.827585 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.827563 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.834684 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.834498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 14:21:14.834837 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.834727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:21:14.835082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.834898 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:21:14.836789 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.836767 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 14:21:14.837051 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.836961 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:21:14.837811 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.837648 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k4rck\"" Jun 11 14:21:14.842273 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.840308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:21:14.844703 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.844679 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nfv4d"] Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859524 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhzr9\" (UniqueName: \"kubernetes.io/projected/97414da9-76ba-4e47-b236-a8834023405d-kube-api-access-fhzr9\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.859847 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.859652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97414da9-76ba-4e47-b236-a8834023405d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.863098 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.863065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.879332 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.876422 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn"] Jun 11 14:21:14.880310 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.879808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8wt2r\"" Jun 11 14:21:14.880310 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.880080 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:21:14.880310 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.880101 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:21:14.880540 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.880374 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:21:14.960268 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-tls\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960268 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-root\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-metrics-client-ca\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-sys\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960424 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prz29\" (UniqueName: \"kubernetes.io/projected/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-kube-api-access-prz29\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhzr9\" (UniqueName: \"kubernetes.io/projected/97414da9-76ba-4e47-b236-a8834023405d-kube-api-access-fhzr9\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-textfile\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:21:14.960604 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:21:14.960687 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls podName:97414da9-76ba-4e47-b236-a8834023405d nodeName:}" failed. No retries permitted until 2026-06-11 14:21:15.460667385 +0000 UTC m=+254.562248504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-mkhzn" (UID: "97414da9-76ba-4e47-b236-a8834023405d") : secret "kube-state-metrics-tls" not found Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97414da9-76ba-4e47-b236-a8834023405d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.960874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.960749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-wtmp\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:14.961396 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.961373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.961532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.961509 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.961665 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.961647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97414da9-76ba-4e47-b236-a8834023405d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.963808 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.963781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:14.983621 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:14.983591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhzr9\" (UniqueName: \"kubernetes.io/projected/97414da9-76ba-4e47-b236-a8834023405d-kube-api-access-fhzr9\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:15.060624 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.060591 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgcp5" event={"ID":"0252c30d-715a-4fe4-827f-de40c73a58f7","Type":"ContainerStarted","Data":"d8442345ebc0677963a2d73a57ab276803cef16b03e18ec1de0a310d1bd485a1"} Jun 11 14:21:15.060781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.060641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgcp5" event={"ID":"0252c30d-715a-4fe4-827f-de40c73a58f7","Type":"ContainerStarted","Data":"b7921f6b8fd1db11a50cda66d910e3783af9ebfb7f0010549dae318edb7dbbdf"} Jun 11 14:21:15.061030 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-textfile\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061103 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-wtmp\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061191 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-wtmp\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061255 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-tls\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061255 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-root\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061324 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-metrics-client-ca\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061324 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-sys\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061324 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prz29\" (UniqueName: \"kubernetes.io/projected/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-kube-api-access-prz29\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-root\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-textfile\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061727 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-sys\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061873 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-metrics-client-ca\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.061936 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.061916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.063646 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.063627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.063646 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.063624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-node-exporter-tls\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.072924 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.072905 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prz29\" (UniqueName: \"kubernetes.io/projected/ec198a6f-6cc2-4168-9522-c9a97a52a9c2-kube-api-access-prz29\") pod \"node-exporter-nfv4d\" (UID: \"ec198a6f-6cc2-4168-9522-c9a97a52a9c2\") " pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.085191 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.085144 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kgcp5" podStartSLOduration=253.147128789 podStartE2EDuration="4m14.085129767s" totalImagesPullingTime="938.000978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:15.083226954 +0000 UTC m=+254.184808084" watchObservedRunningTime="2026-06-11 14:21:15.085129767 +0000 UTC m=+254.186710896" Jun 11 14:21:15.180231 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.180181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfv4d" Jun 11 14:21:15.193020 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:15.192991 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec198a6f_6cc2_4168_9522_c9a97a52a9c2.slice/crio-c6b8330229c36cea62463b21b8dd5f56a4e540088b593a9bf94f149cfb6362ba WatchSource:0}: Error finding container c6b8330229c36cea62463b21b8dd5f56a4e540088b593a9bf94f149cfb6362ba: Status 404 returned error can't find the container with id c6b8330229c36cea62463b21b8dd5f56a4e540088b593a9bf94f149cfb6362ba Jun 11 14:21:15.464280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.464170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:15.466523 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.466502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97414da9-76ba-4e47-b236-a8834023405d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mkhzn\" (UID: \"97414da9-76ba-4e47-b236-a8834023405d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:15.743134 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.743046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" Jun 11 14:21:15.948147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:15.948123 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn"] Jun 11 14:21:16.065737 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:16.065690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfv4d" event={"ID":"ec198a6f-6cc2-4168-9522-c9a97a52a9c2","Type":"ContainerStarted","Data":"c6b8330229c36cea62463b21b8dd5f56a4e540088b593a9bf94f149cfb6362ba"} Jun 11 14:21:16.127918 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:16.127882 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97414da9_76ba_4e47_b236_a8834023405d.slice/crio-6632e510ff366a683597a7aea1fbc3f11b738eded70ee273d4ed49ec01bc7622 WatchSource:0}: Error finding container 6632e510ff366a683597a7aea1fbc3f11b738eded70ee273d4ed49ec01bc7622: Status 404 returned error can't find the container with id 6632e510ff366a683597a7aea1fbc3f11b738eded70ee273d4ed49ec01bc7622 Jun 11 14:21:17.070831 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:17.070794 2574 generic.go:356] "Generic (PLEG): container finished" podID="ec198a6f-6cc2-4168-9522-c9a97a52a9c2" containerID="148a7abfde64faa844ecfc047dd81cf7cf787c8f634b256cfb1ca4061f0fd3bb" exitCode=0 Jun 11 14:21:17.071274 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:17.070882 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfv4d" event={"ID":"ec198a6f-6cc2-4168-9522-c9a97a52a9c2","Type":"ContainerDied","Data":"148a7abfde64faa844ecfc047dd81cf7cf787c8f634b256cfb1ca4061f0fd3bb"} Jun 11 14:21:17.072015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:17.071997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" event={"ID":"97414da9-76ba-4e47-b236-a8834023405d","Type":"ContainerStarted","Data":"6632e510ff366a683597a7aea1fbc3f11b738eded70ee273d4ed49ec01bc7622"} Jun 11 14:21:18.083048 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.083003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfv4d" event={"ID":"ec198a6f-6cc2-4168-9522-c9a97a52a9c2","Type":"ContainerStarted","Data":"0441e522cd7bb88aaf2dff715fc2538b716d7292b0c86b96895606b3c2f3d658"} Jun 11 14:21:18.083663 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.083094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfv4d" event={"ID":"ec198a6f-6cc2-4168-9522-c9a97a52a9c2","Type":"ContainerStarted","Data":"dc7002ba977c30feb40ffbb698cf1fcd9e8fa084330ee9a1ee8ff0c4e4516fbf"} Jun 11 14:21:18.085147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.085122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" event={"ID":"97414da9-76ba-4e47-b236-a8834023405d","Type":"ContainerStarted","Data":"431488b1f3b9a19fc199d636ae586bfbf5d25e5f73659a0ba022edbc0a899141"} Jun 11 14:21:18.085318 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.085174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" event={"ID":"97414da9-76ba-4e47-b236-a8834023405d","Type":"ContainerStarted","Data":"95d3ffe34cd13bce72e95bdcf44e7fa960eeec39ff5282540912676e352b5b98"} Jun 11 14:21:18.085318 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.085201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" event={"ID":"97414da9-76ba-4e47-b236-a8834023405d","Type":"ContainerStarted","Data":"8775c10ba889b152613feae4282079df0f6af8d928d0e95460f2914afe293e58"} Jun 11 14:21:18.132837 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:18.132772 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nfv4d" podStartSLOduration=3.090020156 podStartE2EDuration="4.13274982s" totalImagesPullingTime="977.618842ms" totalInitContainerRuntime="65.110822ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:18.13192459 +0000 UTC m=+257.233505722" watchObservedRunningTime="2026-06-11 14:21:18.13274982 +0000 UTC m=+257.234330951" Jun 11 14:21:19.366889 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.366816 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mkhzn" podStartSLOduration=4.073164612 podStartE2EDuration="5.366797648s" totalImagesPullingTime="1.293633036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:18.199589545 +0000 UTC m=+257.301170676" watchObservedRunningTime="2026-06-11 14:21:19.366797648 +0000 UTC m=+258.468378777" Jun 11 14:21:19.367382 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.367178 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-ffb48fbf4-dqjmb"] Jun 11 14:21:19.370411 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.370391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.375435 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.375409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e8ftgv1u708gr\"" Jun 11 14:21:19.375613 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.375587 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 14:21:19.375717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.375700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 14:21:19.375851 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.375837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xllkw\"" Jun 11 14:21:19.375901 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.375852 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 14:21:19.400927 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.400889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.400927 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.400929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-client-certs\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.401168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.400956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-tls\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.401168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.401036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddcae661-1229-499d-bfaf-e229fe256b01-audit-log\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.401168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.401081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-metrics-server-audit-profiles\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.401168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.401112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-client-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.401168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.401161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjv8k\" (UniqueName: \"kubernetes.io/projected/ddcae661-1229-499d-bfaf-e229fe256b01-kube-api-access-kjv8k\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.407863 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.407839 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 14:21:19.408748 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.408724 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ffb48fbf4-dqjmb"] Jun 11 14:21:19.502149 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv8k\" (UniqueName: \"kubernetes.io/projected/ddcae661-1229-499d-bfaf-e229fe256b01-kube-api-access-kjv8k\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-client-certs\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-tls\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddcae661-1229-499d-bfaf-e229fe256b01-audit-log\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-metrics-server-audit-profiles\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502627 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-client-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.502865 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.502840 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddcae661-1229-499d-bfaf-e229fe256b01-audit-log\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.503035 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.503014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.503420 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.503398 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddcae661-1229-499d-bfaf-e229fe256b01-metrics-server-audit-profiles\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.504801 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.504774 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-tls\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.504890 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.504817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-client-ca-bundle\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.504928 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.504893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddcae661-1229-499d-bfaf-e229fe256b01-secret-metrics-server-client-certs\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.524476 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.524450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjv8k\" (UniqueName: \"kubernetes.io/projected/ddcae661-1229-499d-bfaf-e229fe256b01-kube-api-access-kjv8k\") pod \"metrics-server-ffb48fbf4-dqjmb\" (UID: \"ddcae661-1229-499d-bfaf-e229fe256b01\") " pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.679978 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.679874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:19.829709 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:19.829685 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ffb48fbf4-dqjmb"] Jun 11 14:21:19.831973 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:19.831949 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcae661_1229_499d_bfaf_e229fe256b01.slice/crio-63c31dde7f5c1addfcdb92a0ef5dc97d4831a208c43979d0b92f12a1f84ba420 WatchSource:0}: Error finding container 63c31dde7f5c1addfcdb92a0ef5dc97d4831a208c43979d0b92f12a1f84ba420: Status 404 returned error can't find the container with id 63c31dde7f5c1addfcdb92a0ef5dc97d4831a208c43979d0b92f12a1f84ba420 Jun 11 14:21:20.094057 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.094028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" event={"ID":"ddcae661-1229-499d-bfaf-e229fe256b01","Type":"ContainerStarted","Data":"63c31dde7f5c1addfcdb92a0ef5dc97d4831a208c43979d0b92f12a1f84ba420"} Jun 11 14:21:20.122259 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.122226 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-854596449b-tcn9k"] Jun 11 14:21:20.126435 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.126418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.133595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.133564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 14:21:20.133595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.133563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 14:21:20.134243 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.134224 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 14:21:20.134367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.134350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q6b5t\"" Jun 11 14:21:20.137744 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.137727 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 14:21:20.141077 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.141061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 14:21:20.150112 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.150097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 14:21:20.166461 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.166426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854596449b-tcn9k"] Jun 11 14:21:20.208378 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-serving-certs-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208378 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-metrics-client-ca\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-federate-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208795 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwxq\" (UniqueName: \"kubernetes.io/projected/09fb3e58-5663-491f-a98a-dd02ebbd66e2-kube-api-access-fkwxq\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.208795 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.208688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310080 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310080 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-serving-certs-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-metrics-client-ca\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-federate-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.310610 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.310405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwxq\" (UniqueName: \"kubernetes.io/projected/09fb3e58-5663-491f-a98a-dd02ebbd66e2-kube-api-access-fkwxq\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.311028 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.311001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-serving-certs-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.311147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.311081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-metrics-client-ca\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.311395 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.311365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.312725 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.312696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.312725 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.312721 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.312901 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.312808 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-telemeter-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.312953 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.312918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/09fb3e58-5663-491f-a98a-dd02ebbd66e2-federate-client-tls\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.326784 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.326755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwxq\" (UniqueName: \"kubernetes.io/projected/09fb3e58-5663-491f-a98a-dd02ebbd66e2-kube-api-access-fkwxq\") pod \"telemeter-client-854596449b-tcn9k\" (UID: \"09fb3e58-5663-491f-a98a-dd02ebbd66e2\") " pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.436131 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.436049 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" Jun 11 14:21:20.600223 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:20.600172 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-854596449b-tcn9k"] Jun 11 14:21:20.603416 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:20.603379 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fb3e58_5663_491f_a98a_dd02ebbd66e2.slice/crio-20b7f93eb66407a19c3756d66901ebdf7da6fda227a609b2f833771709e06f03 WatchSource:0}: Error finding container 20b7f93eb66407a19c3756d66901ebdf7da6fda227a609b2f833771709e06f03: Status 404 returned error can't find the container with id 20b7f93eb66407a19c3756d66901ebdf7da6fda227a609b2f833771709e06f03 Jun 11 14:21:21.101324 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:21.101239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" event={"ID":"09fb3e58-5663-491f-a98a-dd02ebbd66e2","Type":"ContainerStarted","Data":"20b7f93eb66407a19c3756d66901ebdf7da6fda227a609b2f833771709e06f03"} Jun 11 14:21:22.107790 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:22.107669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" event={"ID":"ddcae661-1229-499d-bfaf-e229fe256b01","Type":"ContainerStarted","Data":"6aed94d17bddf853418945160b0acad4ca3d9648c735243e04ef0bd9a0f292f2"} Jun 11 14:21:22.151503 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:22.151366 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" podStartSLOduration=1.31921556 podStartE2EDuration="3.15134421s" totalImagesPullingTime="1.83212865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:22.150959334 +0000 UTC m=+261.252540465" watchObservedRunningTime="2026-06-11 14:21:22.15134421 +0000 UTC m=+261.252925341" Jun 11 14:21:23.113766 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:23.113730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" event={"ID":"09fb3e58-5663-491f-a98a-dd02ebbd66e2","Type":"ContainerStarted","Data":"e07424ca368dba08ab11fe7244be3e28aa56beea924e87ddcf88162362e8fb96"} Jun 11 14:21:24.119096 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.119062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" event={"ID":"09fb3e58-5663-491f-a98a-dd02ebbd66e2","Type":"ContainerStarted","Data":"9321e6374b548e1860c9bb1ed4819a55b9594b6ce61df77cad8fead128f6181b"} Jun 11 14:21:24.119494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.119120 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" event={"ID":"09fb3e58-5663-491f-a98a-dd02ebbd66e2","Type":"ContainerStarted","Data":"e4191f9c06c2f7b703b523da0e4d479a87dca71c43d8c34d5afb5a136602a14d"} Jun 11 14:21:24.164404 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.164347 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-854596449b-tcn9k" podStartSLOduration=1.380998486 podStartE2EDuration="4.164332294s" totalImagesPullingTime="2.783333808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:24.159722738 +0000 UTC m=+263.261303870" watchObservedRunningTime="2026-06-11 14:21:24.164332294 +0000 UTC m=+263.265913424" Jun 11 14:21:24.491397 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.491316 2574 patch_prober.go:28] interesting pod/image-registry-597b49c7f9-4mfw2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:24.491397 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.491365 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:24.894602 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.894568 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:24.894757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:24.894619 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:25.836963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.836931 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:21:25.839162 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.839141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.847553 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.847534 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 14:21:25.847844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.847829 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 14:21:25.847893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.847829 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 14:21:25.847893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.847872 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 14:21:25.848429 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.848415 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 14:21:25.848649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.848635 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 14:21:25.848705 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.848692 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 14:21:25.853229 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.853186 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fhxfk\"" Jun 11 14:21:25.862839 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.862814 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:21:25.869551 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.869652 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq498\" (UniqueName: \"kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.869721 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.869757 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.869790 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.869831 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.869804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq498\" (UniqueName: \"kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.970844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.970820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.971439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.971412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.971576 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.971440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.971576 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.971489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.973287 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.973266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.973369 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.973271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:25.982930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:25.982908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq498\" (UniqueName: \"kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498\") pod \"console-6dbc85676c-dwxsn\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:26.147955 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:26.147855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:26.273595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:26.273562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:21:26.276431 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:26.276402 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb347eb67_0ccf_4b68_baf3_aa7e09773d9c.slice/crio-86f65c53e46ac397846d0ba630dbf31405c5e557d3ad9487b35cf5d75d313e9e WatchSource:0}: Error finding container 86f65c53e46ac397846d0ba630dbf31405c5e557d3ad9487b35cf5d75d313e9e: Status 404 returned error can't find the container with id 86f65c53e46ac397846d0ba630dbf31405c5e557d3ad9487b35cf5d75d313e9e Jun 11 14:21:27.034328 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:27.034294 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:27.034706 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:27.034350 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:27.131992 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:27.131952 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbc85676c-dwxsn" event={"ID":"b347eb67-0ccf-4b68-baf3-aa7e09773d9c","Type":"ContainerStarted","Data":"86f65c53e46ac397846d0ba630dbf31405c5e557d3ad9487b35cf5d75d313e9e"} Jun 11 14:21:29.506540 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.506501 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" containerID="cri-o://6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286" gracePeriod=30 Jun 11 14:21:29.750017 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.749988 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:21:29.806953 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.806923 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.806953 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.806957 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.806983 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807129 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807345 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807179 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807345 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807268 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807345 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807305 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807490 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807349 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdm5w\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w\") pod \"a335f452-1e16-4042-a665-6bea384296ae\" (UID: \"a335f452-1e16-4042-a665-6bea384296ae\") " Jun 11 14:21:29.807631 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807580 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:21:29.807999 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.807973 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:21:29.809592 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.809552 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:21:29.809696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.809646 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:21:29.809763 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.809746 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:21:29.809818 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.809765 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:21:29.809884 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.809869 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w" (OuterVolumeSpecName: "kube-api-access-qdm5w") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "kube-api-access-qdm5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:21:29.816388 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.816362 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a335f452-1e16-4042-a665-6bea384296ae" (UID: "a335f452-1e16-4042-a665-6bea384296ae"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908503 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-registry-tls\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908537 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-trusted-ca\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908546 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdm5w\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-kube-api-access-qdm5w\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908555 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-installation-pull-secrets\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908563 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a335f452-1e16-4042-a665-6bea384296ae-bound-sa-token\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908572 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a335f452-1e16-4042-a665-6bea384296ae-ca-trust-extracted\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908581 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a335f452-1e16-4042-a665-6bea384296ae-image-registry-private-configuration\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:29.908591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:29.908589 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a335f452-1e16-4042-a665-6bea384296ae-registry-certificates\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:21:30.144953 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.144921 2574 generic.go:356] "Generic (PLEG): container finished" podID="a335f452-1e16-4042-a665-6bea384296ae" containerID="6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286" exitCode=0 Jun 11 14:21:30.145102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.144966 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" Jun 11 14:21:30.145102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.145007 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" event={"ID":"a335f452-1e16-4042-a665-6bea384296ae","Type":"ContainerDied","Data":"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286"} Jun 11 14:21:30.145102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.145094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b49c7f9-4mfw2" event={"ID":"a335f452-1e16-4042-a665-6bea384296ae","Type":"ContainerDied","Data":"1de7208d3c3bcad8a3c3eb7af8e6f323769fde3cc9a01372e8f307aa29153c10"} Jun 11 14:21:30.145266 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.145120 2574 scope.go:117] "RemoveContainer" containerID="6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286" Jun 11 14:21:30.146624 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.146601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbc85676c-dwxsn" event={"ID":"b347eb67-0ccf-4b68-baf3-aa7e09773d9c","Type":"ContainerStarted","Data":"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664"} Jun 11 14:21:30.154749 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.154731 2574 scope.go:117] "RemoveContainer" containerID="6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286" Jun 11 14:21:30.155082 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:21:30.155060 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286\": container with ID starting with 6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286 not found: ID does not exist" containerID="6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286" Jun 11 14:21:30.155150 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.155094 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286"} err="failed to get container status \"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286\": rpc error: code = NotFound desc = could not find container \"6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286\": container with ID starting with 6755dde0c006285f878c1a05cb814c355a059ace3c7d4034a8a4ea6bfc2a8286 not found: ID does not exist" Jun 11 14:21:30.175856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.175759 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dbc85676c-dwxsn" podStartSLOduration=2.117969746 podStartE2EDuration="5.175742042s" totalImagesPullingTime="3.057772296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:30.174803505 +0000 UTC m=+269.276384659" watchObservedRunningTime="2026-06-11 14:21:30.175742042 +0000 UTC m=+269.277323173" Jun 11 14:21:30.205317 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.205284 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:21:30.207051 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:30.207025 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-597b49c7f9-4mfw2"] Jun 11 14:21:31.299145 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:31.299110 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a335f452-1e16-4042-a665-6bea384296ae" path="/var/lib/kubelet/pods/a335f452-1e16-4042-a665-6bea384296ae/volumes" Jun 11 14:21:34.894362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:34.894331 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:34.894842 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:34.894381 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:35.015525 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.015489 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:21:35.015753 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.015742 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" Jun 11 14:21:35.015828 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.015756 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" Jun 11 14:21:35.015828 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.015811 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a335f452-1e16-4042-a665-6bea384296ae" containerName="registry" Jun 11 14:21:35.024586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.024558 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.033928 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.033865 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 14:21:35.035656 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.035633 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:21:35.156533 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156533 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqr8\" (UniqueName: \"kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.156750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.156717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.257752 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.257963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.257963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqr8\" (UniqueName: \"kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.257963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.257963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258179 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258179 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.257987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258661 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.258635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258773 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.258679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258834 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.258774 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.258889 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.258847 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.260337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.260319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.260496 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.260473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.266777 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.266754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqr8\" (UniqueName: \"kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8\") pod \"console-7fd4f6d599-vmnkq\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.334730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.334682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:35.487868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:35.487814 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:21:35.490488 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:35.490461 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132e20a3_3458_46d1_883f_430acf004865.slice/crio-7e1de273451806aa96ffbe32eaee14437b94ea88a96b1e356d9434b266f8b165 WatchSource:0}: Error finding container 7e1de273451806aa96ffbe32eaee14437b94ea88a96b1e356d9434b266f8b165: Status 404 returned error can't find the container with id 7e1de273451806aa96ffbe32eaee14437b94ea88a96b1e356d9434b266f8b165 Jun 11 14:21:36.148849 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.148802 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:36.149361 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.148880 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:36.150229 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.150193 2574 patch_prober.go:28] interesting pod/console-6dbc85676c-dwxsn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 14:21:36.150299 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.150249 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dbc85676c-dwxsn" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 14:21:36.168535 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.168500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4f6d599-vmnkq" event={"ID":"132e20a3-3458-46d1-883f-430acf004865","Type":"ContainerStarted","Data":"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937"} Jun 11 14:21:36.168692 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.168557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4f6d599-vmnkq" event={"ID":"132e20a3-3458-46d1-883f-430acf004865","Type":"ContainerStarted","Data":"7e1de273451806aa96ffbe32eaee14437b94ea88a96b1e356d9434b266f8b165"} Jun 11 14:21:36.206944 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:36.206891 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd4f6d599-vmnkq" podStartSLOduration=2.206875643 podStartE2EDuration="2.206875643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:36.205765697 +0000 UTC m=+275.307346827" watchObservedRunningTime="2026-06-11 14:21:36.206875643 +0000 UTC m=+275.308456772" Jun 11 14:21:37.033718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:37.033682 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:37.033924 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:37.033741 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:39.680574 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:39.680534 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:39.680969 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:39.680598 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:43.769349 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:21:43.769303 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hmznc" podUID="734fc394-a2e7-4254-8826-39aaa2b4e153" Jun 11 14:21:44.200601 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.200575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:44.893866 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.893831 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:44.894287 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.893885 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:44.894287 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.893938 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:21:44.894486 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.894465 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"45f596718df7d3c2fa9e91d38b509df47b6c97e244d63e8a6ec21003071ae1c9"} pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 14:21:44.898162 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.898134 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:44.898321 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:44.898180 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:45.335166 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:45.335114 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:45.335385 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:45.335197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:21:45.336719 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:45.336692 2574 patch_prober.go:28] interesting pod/console-7fd4f6d599-vmnkq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 14:21:45.336834 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:45.336742 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7fd4f6d599-vmnkq" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 14:21:46.148825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.148786 2574 patch_prober.go:28] interesting pod/console-6dbc85676c-dwxsn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 14:21:46.149268 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.148846 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6dbc85676c-dwxsn" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 14:21:46.764163 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.764114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:46.766468 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.766441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/734fc394-a2e7-4254-8826-39aaa2b4e153-metrics-tls\") pod \"dns-default-hmznc\" (UID: \"734fc394-a2e7-4254-8826-39aaa2b4e153\") " pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:46.905149 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.905118 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw4vr\"" Jun 11 14:21:46.912689 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:46.912664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:47.064266 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:47.064238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmznc"] Jun 11 14:21:47.066145 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:21:47.066115 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fc394_a2e7_4254_8826_39aaa2b4e153.slice/crio-196715466e3a1b2ec977061c21b68bd0a20b5061fcc71a97ffa74cc04f09d1ec WatchSource:0}: Error finding container 196715466e3a1b2ec977061c21b68bd0a20b5061fcc71a97ffa74cc04f09d1ec: Status 404 returned error can't find the container with id 196715466e3a1b2ec977061c21b68bd0a20b5061fcc71a97ffa74cc04f09d1ec Jun 11 14:21:47.211947 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:47.211912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmznc" event={"ID":"734fc394-a2e7-4254-8826-39aaa2b4e153","Type":"ContainerStarted","Data":"196715466e3a1b2ec977061c21b68bd0a20b5061fcc71a97ffa74cc04f09d1ec"} Jun 11 14:21:49.220876 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:49.220842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmznc" event={"ID":"734fc394-a2e7-4254-8826-39aaa2b4e153","Type":"ContainerStarted","Data":"544459e55152151779b20c3afaee96508144f6d2ef5b72bc14c7c134bbe9695f"} Jun 11 14:21:49.221333 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:49.220900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmznc" event={"ID":"734fc394-a2e7-4254-8826-39aaa2b4e153","Type":"ContainerStarted","Data":"c096f52cc5ddfbca93a445ef633a2f09bdf25e30954fa7284b7e7be3553cc5c3"} Jun 11 14:21:49.221333 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:49.220967 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:49.243301 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:49.243250 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmznc" podStartSLOduration=251.302666774 podStartE2EDuration="4m13.243232906s" totalImagesPullingTime="1.940566132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:21:49.241170288 +0000 UTC m=+288.342751421" watchObservedRunningTime="2026-06-11 14:21:49.243232906 +0000 UTC m=+288.344814054" Jun 11 14:21:51.404254 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:51.404225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-state-metrics/0.log" Jun 11 14:21:51.604687 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:51.604657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-rbac-proxy-main/0.log" Jun 11 14:21:51.805462 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:51.805432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-rbac-proxy-self/0.log" Jun 11 14:21:52.010458 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:52.010433 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-ffb48fbf4-dqjmb_ddcae661-1229-499d-bfaf-e229fe256b01/metrics-server/0.log" Jun 11 14:21:53.005827 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:53.005800 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/init-textfile/0.log" Jun 11 14:21:53.207135 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:53.207112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/node-exporter/0.log" Jun 11 14:21:53.403302 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:53.403274 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/kube-rbac-proxy/0.log" Jun 11 14:21:54.898119 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:54.898081 2574 patch_prober.go:28] interesting pod/image-registry-7f5fc7fc85-gd74h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:21:54.898604 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:54.898137 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:21:55.335805 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:55.335765 2574 patch_prober.go:28] interesting pod/console-7fd4f6d599-vmnkq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 14:21:55.335986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:55.335833 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7fd4f6d599-vmnkq" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 14:21:56.153116 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:56.153085 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:56.157044 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:56.157018 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:21:56.804562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:56.804532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/telemeter-client/0.log" Jun 11 14:21:57.009439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:57.009408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/reload/0.log" Jun 11 14:21:57.205809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:57.205738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/kube-rbac-proxy/0.log" Jun 11 14:21:59.205046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.205020 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dbc85676c-dwxsn_b347eb67-0ccf-4b68-baf3-aa7e09773d9c/console/0.log" Jun 11 14:21:59.227478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.227444 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmznc" Jun 11 14:21:59.404562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.404531 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fd4f6d599-vmnkq_132e20a3-3458-46d1-883f-430acf004865/console/0.log" Jun 11 14:21:59.686279 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.686252 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:59.690171 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.690148 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-ffb48fbf4-dqjmb" Jun 11 14:21:59.803874 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:21:59.803848 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmznc_734fc394-a2e7-4254-8826-39aaa2b4e153/dns/0.log" Jun 11 14:22:00.003465 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:00.003389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmznc_734fc394-a2e7-4254-8826-39aaa2b4e153/kube-rbac-proxy/0.log" Jun 11 14:22:01.257550 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.257467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:22:01.258189 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.258164 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:22:01.263294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.263273 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:22:01.268435 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.268411 2574 generic.go:356] "Generic (PLEG): container finished" podID="09f13179-92a0-49b6-9d7d-729f07482fed" containerID="c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c" exitCode=255 Jun 11 14:22:01.268544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.268459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerDied","Data":"c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c"} Jun 11 14:22:01.268544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.268493 2574 scope.go:117] "RemoveContainer" containerID="0c3d2a3321d90a656e800addea8ada362018637126ac0aa297a1ca55390833a6" Jun 11 14:22:01.274667 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.274648 2574 scope.go:117] "RemoveContainer" containerID="c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c" Jun 11 14:22:01.274828 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:22:01.274810 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-57566d967b-d4fpc_open-cluster-management-agent-addon(09f13179-92a0-49b6-9d7d-729f07482fed)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" podUID="09f13179-92a0-49b6-9d7d-729f07482fed" Jun 11 14:22:01.404068 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.404040 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2kk4_609124a0-2b86-49a9-8fd6-2013db290ef1/dns-node-resolver/0.log" Jun 11 14:22:01.603694 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:01.603655 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5fc7fc85-gd74h_da635b33-2f18-4f58-9b22-43927c928499/registry/0.log" Jun 11 14:22:02.003816 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:02.003719 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2hw4r_dc8c7c54-ce79-4beb-8cb3-3bc19e194f77/node-ca/0.log" Jun 11 14:22:02.603719 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:02.603698 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b6cc4cf9-8cxgp_0425a27f-ec46-410e-8ca7-64c890d286d6/router/0.log" Jun 11 14:22:02.803724 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:02.803696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dr9d_11327480-d2b8-4673-b2d2-85e6dea0157c/serve-healthcheck-canary/0.log" Jun 11 14:22:04.903784 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:04.903748 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:22:05.339854 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:05.339816 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:22:05.343930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:05.343892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:22:05.398661 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:05.398621 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:22:07.365814 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:07.365780 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" Jun 11 14:22:07.371878 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:07.371856 2574 scope.go:117] "RemoveContainer" containerID="c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c" Jun 11 14:22:07.372033 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:22:07.372015 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-57566d967b-d4fpc_open-cluster-management-agent-addon(09f13179-92a0-49b6-9d7d-729f07482fed)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" podUID="09f13179-92a0-49b6-9d7d-729f07482fed" Jun 11 14:22:09.913633 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:09.913584 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" podUID="da635b33-2f18-4f58-9b22-43927c928499" containerName="registry" containerID="cri-o://45f596718df7d3c2fa9e91d38b509df47b6c97e244d63e8a6ec21003071ae1c9" gracePeriod=30 Jun 11 14:22:11.311682 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:11.311650 2574 generic.go:356] "Generic (PLEG): container finished" podID="da635b33-2f18-4f58-9b22-43927c928499" containerID="45f596718df7d3c2fa9e91d38b509df47b6c97e244d63e8a6ec21003071ae1c9" exitCode=0 Jun 11 14:22:11.312067 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:11.311717 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" event={"ID":"da635b33-2f18-4f58-9b22-43927c928499","Type":"ContainerDied","Data":"45f596718df7d3c2fa9e91d38b509df47b6c97e244d63e8a6ec21003071ae1c9"} Jun 11 14:22:11.312067 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:11.311751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" event={"ID":"da635b33-2f18-4f58-9b22-43927c928499","Type":"ContainerStarted","Data":"d1ed907d89409907b82a8b0b1f6b9fcd6c1c44e1a82fafd7b944714a92ef45d4"} Jun 11 14:22:11.312067 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:11.311832 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:22:21.296295 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:21.296263 2574 scope.go:117] "RemoveContainer" containerID="c84989ccf94e3a5cc4a08ac6124664180164bfe48779a411a67e396b40372c1c" Jun 11 14:22:22.355531 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:22.355494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57566d967b-d4fpc" event={"ID":"09f13179-92a0-49b6-9d7d-729f07482fed","Type":"ContainerStarted","Data":"71f7ce6b06a5f4d109e71720defb13459c9d2510c94446496649d42cc09913f9"} Jun 11 14:22:30.424759 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.424695 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dbc85676c-dwxsn" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" containerID="cri-o://d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664" gracePeriod=15 Jun 11 14:22:30.666564 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.666536 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:22:30.743595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.743506 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.743595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.743545 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.743595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.743592 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq498\" (UniqueName: \"kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.743833 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.743612 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.743833 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.743645 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.744483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.744235 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert\") pod \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\" (UID: \"b347eb67-0ccf-4b68-baf3-aa7e09773d9c\") " Jun 11 14:22:30.744483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.744256 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config" (OuterVolumeSpecName: "console-config") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:22:30.744483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.744250 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:22:30.744855 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.744812 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:22:30.745261 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.745239 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:30.745380 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.745367 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-oauth-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:30.745464 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.745453 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-service-ca\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:30.747300 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.747131 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:22:30.747300 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.747231 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498" (OuterVolumeSpecName: "kube-api-access-mq498") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "kube-api-access-mq498". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:22:30.750654 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.750626 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b347eb67-0ccf-4b68-baf3-aa7e09773d9c" (UID: "b347eb67-0ccf-4b68-baf3-aa7e09773d9c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:22:30.846327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.846289 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq498\" (UniqueName: \"kubernetes.io/projected/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-kube-api-access-mq498\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:30.846327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.846323 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-oauth-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:30.846327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:30.846332 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b347eb67-0ccf-4b68-baf3-aa7e09773d9c-console-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:22:31.388285 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.388243 2574 generic.go:356] "Generic (PLEG): container finished" podID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerID="d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664" exitCode=0 Jun 11 14:22:31.388452 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.388304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbc85676c-dwxsn" event={"ID":"b347eb67-0ccf-4b68-baf3-aa7e09773d9c","Type":"ContainerDied","Data":"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664"} Jun 11 14:22:31.388452 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.388348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbc85676c-dwxsn" event={"ID":"b347eb67-0ccf-4b68-baf3-aa7e09773d9c","Type":"ContainerDied","Data":"86f65c53e46ac397846d0ba630dbf31405c5e557d3ad9487b35cf5d75d313e9e"} Jun 11 14:22:31.388452 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.388369 2574 scope.go:117] "RemoveContainer" containerID="d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664" Jun 11 14:22:31.388452 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.388308 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbc85676c-dwxsn" Jun 11 14:22:31.396534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.396511 2574 scope.go:117] "RemoveContainer" containerID="d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664" Jun 11 14:22:31.396841 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:22:31.396813 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664\": container with ID starting with d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664 not found: ID does not exist" containerID="d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664" Jun 11 14:22:31.396904 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.396851 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664"} err="failed to get container status \"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664\": rpc error: code = NotFound desc = could not find container \"d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664\": container with ID starting with d3c81c33be86d885504c903ddf2aae66b9e9dd2f3cbb683cbc01e597a1e37664 not found: ID does not exist" Jun 11 14:22:31.405110 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.405085 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:22:31.409001 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:31.408975 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dbc85676c-dwxsn"] Jun 11 14:22:32.320087 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:32.320055 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5fc7fc85-gd74h" Jun 11 14:22:33.298529 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:33.298498 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" path="/var/lib/kubelet/pods/b347eb67-0ccf-4b68-baf3-aa7e09773d9c/volumes" Jun 11 14:22:35.528091 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.528058 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:22:35.528532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.528332 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" Jun 11 14:22:35.528532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.528344 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" Jun 11 14:22:35.528532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.528399 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b347eb67-0ccf-4b68-baf3-aa7e09773d9c" containerName="console" Jun 11 14:22:35.533276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.533251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.544414 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.544386 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:22:35.685641 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685641 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9pp\" (UniqueName: \"kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.685965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.685880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786678 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786678 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786858 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9pp\" (UniqueName: \"kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.786930 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.786900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.787182 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.787157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.787500 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.787468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.787576 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.787511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.787741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.787724 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.787865 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.787839 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.789453 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.789429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.789777 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.789759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.798016 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.797988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9pp\" (UniqueName: \"kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp\") pod \"console-6654688866-62qx5\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.843039 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.843006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:35.977530 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:35.977495 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:22:35.981074 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:22:35.981045 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f32747d_644b_4c82_898f_a4b92ba9066a.slice/crio-c94db2d4cb01e757fc1d187b3721f2b020405b1cb61f3e5547296117385b5447 WatchSource:0}: Error finding container c94db2d4cb01e757fc1d187b3721f2b020405b1cb61f3e5547296117385b5447: Status 404 returned error can't find the container with id c94db2d4cb01e757fc1d187b3721f2b020405b1cb61f3e5547296117385b5447 Jun 11 14:22:36.409069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:36.408967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6654688866-62qx5" event={"ID":"4f32747d-644b-4c82-898f-a4b92ba9066a","Type":"ContainerStarted","Data":"8aed11e29fbc8f287b41922b810c0832523f379c6c3a2766f0250ca955bfe3e5"} Jun 11 14:22:36.409069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:36.409018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6654688866-62qx5" event={"ID":"4f32747d-644b-4c82-898f-a4b92ba9066a","Type":"ContainerStarted","Data":"c94db2d4cb01e757fc1d187b3721f2b020405b1cb61f3e5547296117385b5447"} Jun 11 14:22:36.427625 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:36.427571 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6654688866-62qx5" podStartSLOduration=1.427557156 podStartE2EDuration="1.427557156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:22:36.425618471 +0000 UTC m=+335.527199612" watchObservedRunningTime="2026-06-11 14:22:36.427557156 +0000 UTC m=+335.529138285" Jun 11 14:22:37.259896 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.259864 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:22:37.263910 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.263884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.267135 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267104 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 14:22:37.267294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267137 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ql2wd\"" Jun 11 14:22:37.267294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267150 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 14:22:37.267294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 14:22:37.267294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267183 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 14:22:37.267294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267272 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 14:22:37.267622 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 14:22:37.267678 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267659 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 14:22:37.267733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.267664 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 14:22:37.272750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.272729 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 14:22:37.285901 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.285874 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:22:37.399056 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-config-out\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399056 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp42h\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-kube-api-access-bp42h\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-config-volume\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.399630 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.399377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-web-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500633 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500633 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp42h\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-kube-api-access-bp42h\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500892 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-config-volume\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500892 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500892 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500892 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.500892 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.500963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.501018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-web-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.501048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-config-out\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.501081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.501119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.501698 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.501675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.502880 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.502855 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.503837 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.503810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.503936 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.503891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504072 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-config-volume\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504072 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504072 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504286 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504110 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504286 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-web-config\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.504640 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.504620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.505363 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.505340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38df735e-ae9f-4330-aeb9-22ed5439802a-config-out\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.505885 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.505867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38df735e-ae9f-4330-aeb9-22ed5439802a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.509932 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.509872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp42h\" (UniqueName: \"kubernetes.io/projected/38df735e-ae9f-4330-aeb9-22ed5439802a-kube-api-access-bp42h\") pod \"alertmanager-main-0\" (UID: \"38df735e-ae9f-4330-aeb9-22ed5439802a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.574507 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.574467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 14:22:37.716134 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:37.716099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 14:22:37.719582 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:22:37.719557 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38df735e_ae9f_4330_aeb9_22ed5439802a.slice/crio-e6a804202c3da733aea5695f97faf822e04f3d9de5a57b0e97b77e56a46e72d1 WatchSource:0}: Error finding container e6a804202c3da733aea5695f97faf822e04f3d9de5a57b0e97b77e56a46e72d1: Status 404 returned error can't find the container with id e6a804202c3da733aea5695f97faf822e04f3d9de5a57b0e97b77e56a46e72d1 Jun 11 14:22:38.417848 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:38.417807 2574 generic.go:356] "Generic (PLEG): container finished" podID="38df735e-ae9f-4330-aeb9-22ed5439802a" containerID="b8aabc881d53b39bfd65ea88c092eb006577542ed2c806f10437ab0b15cbc7ef" exitCode=0 Jun 11 14:22:38.418240 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:38.417855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerDied","Data":"b8aabc881d53b39bfd65ea88c092eb006577542ed2c806f10437ab0b15cbc7ef"} Jun 11 14:22:38.418240 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:38.417962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"e6a804202c3da733aea5695f97faf822e04f3d9de5a57b0e97b77e56a46e72d1"} Jun 11 14:22:38.419135 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:38.419119 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:22:40.427832 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:40.427799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"91f981d0dd1163c8adf574a03712eaec1cb3fb42e08c7ac722766dd27d663bfe"} Jun 11 14:22:40.428280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:40.427870 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"d8338816f9941ca441f5d0b1ac4c3288078285883bc92ac572c1d114a57644af"} Jun 11 14:22:40.428280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:40.427898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"f331ec1bac7c684a473c516d3e1c818c776ee44e0f09f2931ca989963301c104"} Jun 11 14:22:40.428280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:40.427922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"1e04e6ded1dc055413dda5080874298c90b5cc86b5e8a2c83f89d559aca304dc"} Jun 11 14:22:40.428280 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:40.427954 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"ec08e59caf87c0f77c4e3898af4a310268af199b58a3a89e87bc68a2e018f77d"} Jun 11 14:22:41.435059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:41.435028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38df735e-ae9f-4330-aeb9-22ed5439802a","Type":"ContainerStarted","Data":"d1b8d94385fa01668b9667297c80a9565e65599eb25e438c6c76ebfa4af3632c"} Jun 11 14:22:41.466057 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:41.465996 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.953008326 podStartE2EDuration="4.465971059s" totalImagesPullingTime="2.496842612s" totalInitContainerRuntime="16.120121ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:22:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:22:41.464563741 +0000 UTC m=+340.566144883" watchObservedRunningTime="2026-06-11 14:22:41.465971059 +0000 UTC m=+340.567552194" Jun 11 14:22:45.843764 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:45.843713 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:45.844235 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:45.843795 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:45.848889 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:45.848864 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:46.458674 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:46.458639 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:22:46.511475 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:22:46.511444 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:23:11.535327 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.535283 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fd4f6d599-vmnkq" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" containerID="cri-o://38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937" gracePeriod=15 Jun 11 14:23:11.783411 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.783381 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:23:11.875037 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.874997 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875048 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875106 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875141 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875181 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875233 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875533 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875289 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqqr8\" (UniqueName: \"kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8\") pod \"132e20a3-3458-46d1-883f-430acf004865\" (UID: \"132e20a3-3458-46d1-883f-430acf004865\") " Jun 11 14:23:11.875632 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875600 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config" (OuterVolumeSpecName: "console-config") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:23:11.875696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875625 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca" (OuterVolumeSpecName: "service-ca") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:23:11.875696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875614 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:23:11.875696 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.875609 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:23:11.877293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.877185 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:23:11.877293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.877293 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8" (OuterVolumeSpecName: "kube-api-access-dqqr8") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "kube-api-access-dqqr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:23:11.877501 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.877486 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "132e20a3-3458-46d1-883f-430acf004865" (UID: "132e20a3-3458-46d1-883f-430acf004865"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:23:11.976717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976681 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-service-ca\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976709 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-console-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976721 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-trusted-ca-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976945 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976730 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-oauth-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976945 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976741 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqqr8\" (UniqueName: \"kubernetes.io/projected/132e20a3-3458-46d1-883f-430acf004865-kube-api-access-dqqr8\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976945 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976749 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/132e20a3-3458-46d1-883f-430acf004865-console-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:11.976945 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:11.976759 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/132e20a3-3458-46d1-883f-430acf004865-oauth-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:23:12.560318 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.560276 2574 generic.go:356] "Generic (PLEG): container finished" podID="132e20a3-3458-46d1-883f-430acf004865" containerID="38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937" exitCode=0 Jun 11 14:23:12.560735 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.560322 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4f6d599-vmnkq" event={"ID":"132e20a3-3458-46d1-883f-430acf004865","Type":"ContainerDied","Data":"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937"} Jun 11 14:23:12.560735 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.560330 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4f6d599-vmnkq" Jun 11 14:23:12.560735 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.560372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4f6d599-vmnkq" event={"ID":"132e20a3-3458-46d1-883f-430acf004865","Type":"ContainerDied","Data":"7e1de273451806aa96ffbe32eaee14437b94ea88a96b1e356d9434b266f8b165"} Jun 11 14:23:12.560735 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.560399 2574 scope.go:117] "RemoveContainer" containerID="38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937" Jun 11 14:23:12.568805 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.568787 2574 scope.go:117] "RemoveContainer" containerID="38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937" Jun 11 14:23:12.569067 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:23:12.569050 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937\": container with ID starting with 38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937 not found: ID does not exist" containerID="38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937" Jun 11 14:23:12.569135 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.569080 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937"} err="failed to get container status \"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937\": rpc error: code = NotFound desc = could not find container \"38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937\": container with ID starting with 38663283b38433a395008136c5b4bfe9431f5bf1274c8a9a4d04eb9bf93d8937 not found: ID does not exist" Jun 11 14:23:12.596517 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.596486 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:23:12.605553 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:12.605522 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd4f6d599-vmnkq"] Jun 11 14:23:13.299346 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:13.299315 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="132e20a3-3458-46d1-883f-430acf004865" path="/var/lib/kubelet/pods/132e20a3-3458-46d1-883f-430acf004865/volumes" Jun 11 14:23:39.077922 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.077883 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9"] Jun 11 14:23:39.078603 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.078337 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" Jun 11 14:23:39.078603 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.078356 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" Jun 11 14:23:39.078603 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.078461 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="132e20a3-3458-46d1-883f-430acf004865" containerName="console" Jun 11 14:23:39.081599 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.081577 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.084364 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.084341 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:23:39.084364 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.084357 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:23:39.084517 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.084350 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:23:39.094386 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.094358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9"] Jun 11 14:23:39.112562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.112529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.112562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.112566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.112806 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.112586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqn7\" (UniqueName: \"kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.213750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.213693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.213750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.213758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.214031 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.213786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqn7\" (UniqueName: \"kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.214116 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.214092 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.214175 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.214117 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.222911 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.222881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqn7\" (UniqueName: \"kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.391157 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.391067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:23:39.527652 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.527624 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9"] Jun 11 14:23:39.530001 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:23:39.529970 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17734499_7546_4274_8e70_0fdb613c4f2a.slice/crio-d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572 WatchSource:0}: Error finding container d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572: Status 404 returned error can't find the container with id d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572 Jun 11 14:23:39.665305 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:39.665195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" event={"ID":"17734499-7546-4274-8e70-0fdb613c4f2a","Type":"ContainerStarted","Data":"d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572"} Jun 11 14:23:49.713043 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:49.712951 2574 generic.go:356] "Generic (PLEG): container finished" podID="17734499-7546-4274-8e70-0fdb613c4f2a" containerID="fedf4af6cb32b7d4b2e745847e91a2d78426900d5b0097194fa6e6652cfeeb76" exitCode=0 Jun 11 14:23:49.713043 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:49.712995 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" event={"ID":"17734499-7546-4274-8e70-0fdb613c4f2a","Type":"ContainerDied","Data":"fedf4af6cb32b7d4b2e745847e91a2d78426900d5b0097194fa6e6652cfeeb76"} Jun 11 14:23:50.718817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:50.718785 2574 generic.go:356] "Generic (PLEG): container finished" podID="17734499-7546-4274-8e70-0fdb613c4f2a" containerID="0f9b38b1afab3508fd3562e11ce7f412a6384fed035876094001254c3a57bafc" exitCode=0 Jun 11 14:23:50.719265 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:50.718865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" event={"ID":"17734499-7546-4274-8e70-0fdb613c4f2a","Type":"ContainerDied","Data":"0f9b38b1afab3508fd3562e11ce7f412a6384fed035876094001254c3a57bafc"} Jun 11 14:23:58.758137 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:58.758097 2574 generic.go:356] "Generic (PLEG): container finished" podID="17734499-7546-4274-8e70-0fdb613c4f2a" containerID="74fd5ad4be0e8fb32cb7816dadca20b14317d3477cd2d931a37a83585c04b5bb" exitCode=0 Jun 11 14:23:58.758584 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:58.758182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" event={"ID":"17734499-7546-4274-8e70-0fdb613c4f2a","Type":"ContainerDied","Data":"74fd5ad4be0e8fb32cb7816dadca20b14317d3477cd2d931a37a83585c04b5bb"} Jun 11 14:23:59.887351 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:23:59.887321 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:24:00.004597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.004557 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpqn7\" (UniqueName: \"kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7\") pod \"17734499-7546-4274-8e70-0fdb613c4f2a\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " Jun 11 14:24:00.004794 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.004632 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util\") pod \"17734499-7546-4274-8e70-0fdb613c4f2a\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " Jun 11 14:24:00.004794 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.004666 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle\") pod \"17734499-7546-4274-8e70-0fdb613c4f2a\" (UID: \"17734499-7546-4274-8e70-0fdb613c4f2a\") " Jun 11 14:24:00.005362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.005337 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle" (OuterVolumeSpecName: "bundle") pod "17734499-7546-4274-8e70-0fdb613c4f2a" (UID: "17734499-7546-4274-8e70-0fdb613c4f2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:00.006815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.006795 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7" (OuterVolumeSpecName: "kube-api-access-vpqn7") pod "17734499-7546-4274-8e70-0fdb613c4f2a" (UID: "17734499-7546-4274-8e70-0fdb613c4f2a"). InnerVolumeSpecName "kube-api-access-vpqn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:24:00.009003 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.008976 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util" (OuterVolumeSpecName: "util") pod "17734499-7546-4274-8e70-0fdb613c4f2a" (UID: "17734499-7546-4274-8e70-0fdb613c4f2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:00.105894 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.105841 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:00.105894 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.105886 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17734499-7546-4274-8e70-0fdb613c4f2a-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:00.105894 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.105897 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpqn7\" (UniqueName: \"kubernetes.io/projected/17734499-7546-4274-8e70-0fdb613c4f2a-kube-api-access-vpqn7\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:00.768671 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.768642 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" Jun 11 14:24:00.768840 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.768671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg2bz9" event={"ID":"17734499-7546-4274-8e70-0fdb613c4f2a","Type":"ContainerDied","Data":"d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572"} Jun 11 14:24:00.768840 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:00.768718 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d210e5119c34801c152aa4e529588a3fba9ee39373c7d2383d765a141a202572" Jun 11 14:24:07.032993 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.032955 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm"] Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033269 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="util" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033281 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="util" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033289 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="pull" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033295 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="pull" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033302 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="extract" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033308 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="extract" Jun 11 14:24:07.033477 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.033364 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="17734499-7546-4274-8e70-0fdb613c4f2a" containerName="extract" Jun 11 14:24:07.065803 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.065758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm"] Jun 11 14:24:07.065978 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.065834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.069300 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.069259 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mg8h8\"" Jun 11 14:24:07.069300 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.069283 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:24:07.069527 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.069407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 14:24:07.166492 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.166447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmnm\" (UniqueName: \"kubernetes.io/projected/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-kube-api-access-pxmnm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.166492 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.166496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.267485 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.267441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmnm\" (UniqueName: \"kubernetes.io/projected/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-kube-api-access-pxmnm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.267485 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.267482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.267876 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.267861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.276744 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.276716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmnm\" (UniqueName: \"kubernetes.io/projected/6ba2fb13-6a11-4f15-982e-155e8b59a2f6-kube-api-access-pxmnm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-w4xxm\" (UID: \"6ba2fb13-6a11-4f15-982e-155e8b59a2f6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.375494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.375440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" Jun 11 14:24:07.551001 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.550914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm"] Jun 11 14:24:07.554032 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:24:07.553999 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba2fb13_6a11_4f15_982e_155e8b59a2f6.slice/crio-77e2add27d4761884d9fc0151c8f556f160bfe9a2f35c0707a8cdc75f5b187b5 WatchSource:0}: Error finding container 77e2add27d4761884d9fc0151c8f556f160bfe9a2f35c0707a8cdc75f5b187b5: Status 404 returned error can't find the container with id 77e2add27d4761884d9fc0151c8f556f160bfe9a2f35c0707a8cdc75f5b187b5 Jun 11 14:24:07.798505 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:07.798464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" event={"ID":"6ba2fb13-6a11-4f15-982e-155e8b59a2f6","Type":"ContainerStarted","Data":"77e2add27d4761884d9fc0151c8f556f160bfe9a2f35c0707a8cdc75f5b187b5"} Jun 11 14:24:10.813921 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:10.813862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" event={"ID":"6ba2fb13-6a11-4f15-982e-155e8b59a2f6","Type":"ContainerStarted","Data":"057fe0ed6831595043531d9374568eab6ba272fc8c8fb4f996cb7a03cf2df4ee"} Jun 11 14:24:10.866717 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:10.866634 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-w4xxm" podStartSLOduration=1.58473283 podStartE2EDuration="3.866615861s" totalImagesPullingTime="2.281883031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:10.865434275 +0000 UTC m=+429.967015405" watchObservedRunningTime="2026-06-11 14:24:10.866615861 +0000 UTC m=+429.968196992" Jun 11 14:24:11.901845 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.901810 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq"] Jun 11 14:24:11.904106 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.904087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:11.907480 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.907458 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:24:11.908631 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.908613 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:24:11.908721 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.908670 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:24:11.932996 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:11.932963 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq"] Jun 11 14:24:12.010439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.010397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.010608 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.010459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psz6f\" (UniqueName: \"kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.010608 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.010506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.110966 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.110927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.111146 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.110978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psz6f\" (UniqueName: \"kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.111146 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.111010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.111393 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.111375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.111469 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.111399 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.151505 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.151460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psz6f\" (UniqueName: \"kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.213838 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.213743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:12.360921 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.360887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq"] Jun 11 14:24:12.363983 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:24:12.363954 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode562017a_89bd_4e60_b4a7_43acaa31567c.slice/crio-2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198 WatchSource:0}: Error finding container 2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198: Status 404 returned error can't find the container with id 2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198 Jun 11 14:24:12.823794 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.823759 2574 generic.go:356] "Generic (PLEG): container finished" podID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerID="2e0fc7bfde1f9ad5d26ff9af85b66eb0bfc05fea87c4fe6bb6ef7de2a1f68816" exitCode=0 Jun 11 14:24:12.823979 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.823825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" event={"ID":"e562017a-89bd-4e60-b4a7-43acaa31567c","Type":"ContainerDied","Data":"2e0fc7bfde1f9ad5d26ff9af85b66eb0bfc05fea87c4fe6bb6ef7de2a1f68816"} Jun 11 14:24:12.823979 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:12.823867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" event={"ID":"e562017a-89bd-4e60-b4a7-43acaa31567c","Type":"ContainerStarted","Data":"2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198"} Jun 11 14:24:13.200641 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.200601 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9"] Jun 11 14:24:13.203100 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.203074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.205579 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.205553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:24:13.205713 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.205688 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:24:13.205834 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.205815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8nn52\"" Jun 11 14:24:13.216045 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.216020 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9"] Jun 11 14:24:13.321495 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.321454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.321649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.321498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqpsd\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-kube-api-access-qqpsd\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.423085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.422995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.423085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.423052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqpsd\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-kube-api-access-qqpsd\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.430729 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.430695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.430856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.430822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqpsd\" (UniqueName: \"kubernetes.io/projected/677822f0-4816-4cc4-abd4-8f6cb7574bce-kube-api-access-qqpsd\") pod \"cert-manager-webhook-7dc76cbb94-wv6n9\" (UID: \"677822f0-4816-4cc4-abd4-8f6cb7574bce\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.512763 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.512709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:13.645188 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.645070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9"] Jun 11 14:24:13.647815 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:24:13.647786 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod677822f0_4816_4cc4_abd4_8f6cb7574bce.slice/crio-7786e009232a54131cda09bfda4b9924900f4f529426ee99483d5e08df8588d7 WatchSource:0}: Error finding container 7786e009232a54131cda09bfda4b9924900f4f529426ee99483d5e08df8588d7: Status 404 returned error can't find the container with id 7786e009232a54131cda09bfda4b9924900f4f529426ee99483d5e08df8588d7 Jun 11 14:24:13.830219 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:13.830184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" event={"ID":"677822f0-4816-4cc4-abd4-8f6cb7574bce","Type":"ContainerStarted","Data":"7786e009232a54131cda09bfda4b9924900f4f529426ee99483d5e08df8588d7"} Jun 11 14:24:16.846708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:16.846665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" event={"ID":"677822f0-4816-4cc4-abd4-8f6cb7574bce","Type":"ContainerStarted","Data":"998543cc3875de503f2f1289fb5562c698e385efa86709a8c6a0a3fa30b60f40"} Jun 11 14:24:16.847230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:16.846796 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:16.848366 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:16.848342 2574 generic.go:356] "Generic (PLEG): container finished" podID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerID="1ad4ede498910d4e2088b848fd90bd8d428c3d17eddd3935b3d120d3a908ca9e" exitCode=0 Jun 11 14:24:16.848448 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:16.848392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" event={"ID":"e562017a-89bd-4e60-b4a7-43acaa31567c","Type":"ContainerDied","Data":"1ad4ede498910d4e2088b848fd90bd8d428c3d17eddd3935b3d120d3a908ca9e"} Jun 11 14:24:16.865932 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:16.865876 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" podStartSLOduration=1.201291616 podStartE2EDuration="3.865858067s" totalImagesPullingTime="2.664566451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:16.864000947 +0000 UTC m=+435.965582078" watchObservedRunningTime="2026-06-11 14:24:16.865858067 +0000 UTC m=+435.967439200" Jun 11 14:24:17.854506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:17.854464 2574 generic.go:356] "Generic (PLEG): container finished" podID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerID="9df53e9d96e891e767a8ccf311e7aa268f4899c4be9e86f1b716159d53efade6" exitCode=0 Jun 11 14:24:17.854917 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:17.854555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" event={"ID":"e562017a-89bd-4e60-b4a7-43acaa31567c","Type":"ContainerDied","Data":"9df53e9d96e891e767a8ccf311e7aa268f4899c4be9e86f1b716159d53efade6"} Jun 11 14:24:18.994279 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:18.994252 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:19.079179 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.079148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util\") pod \"e562017a-89bd-4e60-b4a7-43acaa31567c\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " Jun 11 14:24:19.079376 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.079187 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psz6f\" (UniqueName: \"kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f\") pod \"e562017a-89bd-4e60-b4a7-43acaa31567c\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " Jun 11 14:24:19.079376 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.079267 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle\") pod \"e562017a-89bd-4e60-b4a7-43acaa31567c\" (UID: \"e562017a-89bd-4e60-b4a7-43acaa31567c\") " Jun 11 14:24:19.079692 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.079665 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle" (OuterVolumeSpecName: "bundle") pod "e562017a-89bd-4e60-b4a7-43acaa31567c" (UID: "e562017a-89bd-4e60-b4a7-43acaa31567c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:19.081291 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.081252 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f" (OuterVolumeSpecName: "kube-api-access-psz6f") pod "e562017a-89bd-4e60-b4a7-43acaa31567c" (UID: "e562017a-89bd-4e60-b4a7-43acaa31567c"). InnerVolumeSpecName "kube-api-access-psz6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:24:19.083657 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.083636 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util" (OuterVolumeSpecName: "util") pod "e562017a-89bd-4e60-b4a7-43acaa31567c" (UID: "e562017a-89bd-4e60-b4a7-43acaa31567c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:19.180055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.179965 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:19.180055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.179996 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e562017a-89bd-4e60-b4a7-43acaa31567c-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:19.180055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.180005 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psz6f\" (UniqueName: \"kubernetes.io/projected/e562017a-89bd-4e60-b4a7-43acaa31567c-kube-api-access-psz6f\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:19.865265 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.865199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" event={"ID":"e562017a-89bd-4e60-b4a7-43acaa31567c","Type":"ContainerDied","Data":"2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198"} Jun 11 14:24:19.865265 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.865259 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcbnpq" Jun 11 14:24:19.865470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:19.865287 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2231dd9b72fc966d7990e8db839f3590752725ecb689853a42428378b1232198" Jun 11 14:24:22.857174 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:22.857093 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wv6n9" Jun 11 14:24:37.179498 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179462 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx"] Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179782 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="extract" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179793 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="extract" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179805 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="pull" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179810 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="pull" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179826 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="util" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179832 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="util" Jun 11 14:24:37.179895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.179879 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e562017a-89bd-4e60-b4a7-43acaa31567c" containerName="extract" Jun 11 14:24:37.183085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.183067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.185583 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.185561 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:24:37.185716 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.185605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:24:37.186563 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.186546 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:24:37.191373 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.191346 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx"] Jun 11 14:24:37.226442 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.226391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.226621 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.226486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f4tl\" (UniqueName: \"kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.226621 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.226526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.326970 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.326925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.327171 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.327007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f4tl\" (UniqueName: \"kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.327171 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.327055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.327354 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.327332 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.327429 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.327407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.335911 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.335885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f4tl\" (UniqueName: \"kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.493124 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.493035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:37.624561 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.624488 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx"] Jun 11 14:24:37.627145 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:24:37.627107 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a63e98_898c_40dd_a992_582406c23ce3.slice/crio-799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d WatchSource:0}: Error finding container 799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d: Status 404 returned error can't find the container with id 799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d Jun 11 14:24:37.951867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.951837 2574 generic.go:356] "Generic (PLEG): container finished" podID="86a63e98-898c-40dd-a992-582406c23ce3" containerID="7133bd6c22bd7394807aacf2d3d99bcf535a42258735118a1f0bf22b58ced883" exitCode=0 Jun 11 14:24:37.952056 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.951934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" event={"ID":"86a63e98-898c-40dd-a992-582406c23ce3","Type":"ContainerDied","Data":"7133bd6c22bd7394807aacf2d3d99bcf535a42258735118a1f0bf22b58ced883"} Jun 11 14:24:37.952056 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:37.951983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" event={"ID":"86a63e98-898c-40dd-a992-582406c23ce3","Type":"ContainerStarted","Data":"799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d"} Jun 11 14:24:38.958304 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:38.958221 2574 generic.go:356] "Generic (PLEG): container finished" podID="86a63e98-898c-40dd-a992-582406c23ce3" containerID="3c70ec2e3c6c848af3e367bf62aced432d3df3a18ea85a0ccdfb9ab1cf79a93a" exitCode=0 Jun 11 14:24:38.958818 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:38.958305 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" event={"ID":"86a63e98-898c-40dd-a992-582406c23ce3","Type":"ContainerDied","Data":"3c70ec2e3c6c848af3e367bf62aced432d3df3a18ea85a0ccdfb9ab1cf79a93a"} Jun 11 14:24:39.964575 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:39.964541 2574 generic.go:356] "Generic (PLEG): container finished" podID="86a63e98-898c-40dd-a992-582406c23ce3" containerID="d12040324f55220a1f93bf4187155cf72de7e6732e002c1607377ae7cc6c3145" exitCode=0 Jun 11 14:24:39.964971 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:39.964627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" event={"ID":"86a63e98-898c-40dd-a992-582406c23ce3","Type":"ContainerDied","Data":"d12040324f55220a1f93bf4187155cf72de7e6732e002c1607377ae7cc6c3145"} Jun 11 14:24:41.105424 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.105395 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:41.160876 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.160839 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f4tl\" (UniqueName: \"kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl\") pod \"86a63e98-898c-40dd-a992-582406c23ce3\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " Jun 11 14:24:41.161027 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.160898 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle\") pod \"86a63e98-898c-40dd-a992-582406c23ce3\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " Jun 11 14:24:41.161027 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.160964 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util\") pod \"86a63e98-898c-40dd-a992-582406c23ce3\" (UID: \"86a63e98-898c-40dd-a992-582406c23ce3\") " Jun 11 14:24:41.161818 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.161784 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle" (OuterVolumeSpecName: "bundle") pod "86a63e98-898c-40dd-a992-582406c23ce3" (UID: "86a63e98-898c-40dd-a992-582406c23ce3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:41.163033 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.163000 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl" (OuterVolumeSpecName: "kube-api-access-7f4tl") pod "86a63e98-898c-40dd-a992-582406c23ce3" (UID: "86a63e98-898c-40dd-a992-582406c23ce3"). InnerVolumeSpecName "kube-api-access-7f4tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:24:41.167821 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.167780 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util" (OuterVolumeSpecName: "util") pod "86a63e98-898c-40dd-a992-582406c23ce3" (UID: "86a63e98-898c-40dd-a992-582406c23ce3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:24:41.262164 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.262079 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f4tl\" (UniqueName: \"kubernetes.io/projected/86a63e98-898c-40dd-a992-582406c23ce3-kube-api-access-7f4tl\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:41.262164 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.262111 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:41.262164 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.262121 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86a63e98-898c-40dd-a992-582406c23ce3-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:24:41.974760 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.974668 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" event={"ID":"86a63e98-898c-40dd-a992-582406c23ce3","Type":"ContainerDied","Data":"799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d"} Jun 11 14:24:41.974760 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.974689 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnnrbx" Jun 11 14:24:41.974760 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:41.974718 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="799ee237e87b32d06064c2e9124ebf3b73d4a285750d3dae6b11f658199d533d" Jun 11 14:24:49.971240 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971190 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5"] Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971506 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="pull" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971517 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="pull" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971534 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="util" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971540 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="util" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971546 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="extract" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971551 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="extract" Jun 11 14:24:49.971636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.971599 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a63e98-898c-40dd-a992-582406c23ce3" containerName="extract" Jun 11 14:24:49.975879 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.975855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:49.978627 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.978599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:24:49.978797 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.978678 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xq4s9\"" Jun 11 14:24:49.978863 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.978849 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:24:49.979058 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.979045 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:24:49.979288 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:49.979276 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:24:50.002246 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.002187 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5"] Jun 11 14:24:50.036377 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.036343 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.036377 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.036383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.036599 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.036419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.036599 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.036508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pg5n\" (UniqueName: \"kubernetes.io/projected/982da782-3935-4635-95ad-9460aa159630-kube-api-access-7pg5n\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.036599 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.036547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137468 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137468 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137774 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137774 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pg5n\" (UniqueName: \"kubernetes.io/projected/982da782-3935-4635-95ad-9460aa159630-kube-api-access-7pg5n\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137774 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.137943 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.137866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-manifests\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.139829 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.139806 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/982da782-3935-4635-95ad-9460aa159630-tmp\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.140059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.140040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-webhook-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.140159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.140136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/982da782-3935-4635-95ad-9460aa159630-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.145598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.145570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pg5n\" (UniqueName: \"kubernetes.io/projected/982da782-3935-4635-95ad-9460aa159630-kube-api-access-7pg5n\") pod \"opendatahub-operator-controller-manager-85855677f7-c59c5\" (UID: \"982da782-3935-4635-95ad-9460aa159630\") " pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.286172 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.286074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:50.426187 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:50.426160 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5"] Jun 11 14:24:50.430164 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:24:50.430133 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982da782_3935_4635_95ad_9460aa159630.slice/crio-d16357ebad862e4757c1516cd6b1360e1c1a9222fcbdcd112af540286c789890 WatchSource:0}: Error finding container d16357ebad862e4757c1516cd6b1360e1c1a9222fcbdcd112af540286c789890: Status 404 returned error can't find the container with id d16357ebad862e4757c1516cd6b1360e1c1a9222fcbdcd112af540286c789890 Jun 11 14:24:51.015176 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:51.015143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" event={"ID":"982da782-3935-4635-95ad-9460aa159630","Type":"ContainerStarted","Data":"d16357ebad862e4757c1516cd6b1360e1c1a9222fcbdcd112af540286c789890"} Jun 11 14:24:54.032831 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:54.032795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" event={"ID":"982da782-3935-4635-95ad-9460aa159630","Type":"ContainerStarted","Data":"96f5e4183609245b111c9154bd9554c752374a251a5e154b73a556d1395710ae"} Jun 11 14:24:55.039421 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:55.039378 2574 generic.go:356] "Generic (PLEG): container finished" podID="982da782-3935-4635-95ad-9460aa159630" containerID="96f5e4183609245b111c9154bd9554c752374a251a5e154b73a556d1395710ae" exitCode=0 Jun 11 14:24:55.039884 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:55.039467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" event={"ID":"982da782-3935-4635-95ad-9460aa159630","Type":"ContainerDied","Data":"96f5e4183609245b111c9154bd9554c752374a251a5e154b73a556d1395710ae"} Jun 11 14:24:56.046193 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:56.046157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" event={"ID":"982da782-3935-4635-95ad-9460aa159630","Type":"ContainerStarted","Data":"3b7065d35e3d4862ebc131312d1faf83abbdf561d1ed32fb50d03fbda2150525"} Jun 11 14:24:56.046605 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:56.046255 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:24:56.070412 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:24:56.070357 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" podStartSLOduration=2.847936094 podStartE2EDuration="7.07034094s" totalImagesPullingTime="3.264540498s" totalInitContainerRuntime="957.864348ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:24:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:24:56.067619496 +0000 UTC m=+475.169200628" watchObservedRunningTime="2026-06-11 14:24:56.07034094 +0000 UTC m=+475.171922113" Jun 11 14:25:07.053596 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.053566 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85855677f7-c59c5" Jun 11 14:25:07.633224 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.633175 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b"] Jun 11 14:25:07.642038 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.642012 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.644478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.644457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 14:25:07.644844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.644824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 14:25:07.645593 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.645574 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8s4b2\"" Jun 11 14:25:07.645679 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.645661 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:25:07.645724 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.645683 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 14:25:07.645765 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.645683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 14:25:07.649436 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.649411 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b"] Jun 11 14:25:07.700178 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.700127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0747584-32b0-42a9-9c7b-f07c69c6673b-manager-config\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.700178 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.700191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7npw\" (UniqueName: \"kubernetes.io/projected/f0747584-32b0-42a9-9c7b-f07c69c6673b-kube-api-access-q7npw\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.700419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.700273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-metrics-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.700419 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.700326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.800692 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.800659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.800877 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.800714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0747584-32b0-42a9-9c7b-f07c69c6673b-manager-config\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.800877 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.800751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7npw\" (UniqueName: \"kubernetes.io/projected/f0747584-32b0-42a9-9c7b-f07c69c6673b-kube-api-access-q7npw\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.800877 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.800782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-metrics-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.801400 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.801373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0747584-32b0-42a9-9c7b-f07c69c6673b-manager-config\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.803294 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.803260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.803410 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.803315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0747584-32b0-42a9-9c7b-f07c69c6673b-metrics-cert\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.809928 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.809898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7npw\" (UniqueName: \"kubernetes.io/projected/f0747584-32b0-42a9-9c7b-f07c69c6673b-kube-api-access-q7npw\") pod \"lws-controller-manager-5b69d76555-4gm5b\" (UID: \"f0747584-32b0-42a9-9c7b-f07c69c6673b\") " pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:07.952180 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:07.952081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:08.115687 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:08.115656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b"] Jun 11 14:25:08.122226 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:25:08.122185 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0747584_32b0_42a9_9c7b_f07c69c6673b.slice/crio-a990c0f9c4edf56c058342b986b7310041d94d061874d5ccfa81c87e8551331b WatchSource:0}: Error finding container a990c0f9c4edf56c058342b986b7310041d94d061874d5ccfa81c87e8551331b: Status 404 returned error can't find the container with id a990c0f9c4edf56c058342b986b7310041d94d061874d5ccfa81c87e8551331b Jun 11 14:25:09.108836 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:09.108792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" event={"ID":"f0747584-32b0-42a9-9c7b-f07c69c6673b","Type":"ContainerStarted","Data":"a990c0f9c4edf56c058342b986b7310041d94d061874d5ccfa81c87e8551331b"} Jun 11 14:25:10.115150 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.115112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" event={"ID":"f0747584-32b0-42a9-9c7b-f07c69c6673b","Type":"ContainerStarted","Data":"130882329f8f5328f35f8a9322a22578e3000f9ee2e92ed0bab30eccf8cce5d1"} Jun 11 14:25:10.115597 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.115184 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:10.155400 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.155346 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" podStartSLOduration=1.7240536560000002 podStartE2EDuration="3.155328004s" totalImagesPullingTime="1.431274348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:10.154638559 +0000 UTC m=+489.256219688" watchObservedRunningTime="2026-06-11 14:25:10.155328004 +0000 UTC m=+489.256909203" Jun 11 14:25:10.479974 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.479890 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4"] Jun 11 14:25:10.483506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.483487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.486192 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.486166 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:25:10.486362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.486166 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:25:10.486362 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.486274 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:25:10.493324 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.493294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4"] Jun 11 14:25:10.519674 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.519593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngdwm\" (UniqueName: \"kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.519674 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.519654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.519926 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.519762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.621187 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.621155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngdwm\" (UniqueName: \"kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.621187 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.621195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.621474 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.621273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.621645 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.621625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.621682 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.621651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.632725 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.632695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngdwm\" (UniqueName: \"kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.794333 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.794294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:10.927329 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:10.927302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4"] Jun 11 14:25:10.929262 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:25:10.929227 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397294af_9d7c_482a_aa55_853a313f2610.slice/crio-38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d WatchSource:0}: Error finding container 38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d: Status 404 returned error can't find the container with id 38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d Jun 11 14:25:11.121509 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:11.121416 2574 generic.go:356] "Generic (PLEG): container finished" podID="397294af-9d7c-482a-aa55-853a313f2610" containerID="a1c159be1b059c6d7bcc4cbcd6171c7e9561eedad88fc4c1794b322c4e8d8d69" exitCode=0 Jun 11 14:25:11.121979 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:11.121510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" event={"ID":"397294af-9d7c-482a-aa55-853a313f2610","Type":"ContainerDied","Data":"a1c159be1b059c6d7bcc4cbcd6171c7e9561eedad88fc4c1794b322c4e8d8d69"} Jun 11 14:25:11.121979 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:11.121573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" event={"ID":"397294af-9d7c-482a-aa55-853a313f2610","Type":"ContainerStarted","Data":"38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d"} Jun 11 14:25:13.132861 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:13.132824 2574 generic.go:356] "Generic (PLEG): container finished" podID="397294af-9d7c-482a-aa55-853a313f2610" containerID="6d06af9031fa044317212f70b2c80abb2ab85a6cfaeffec1f70e5ef82e8ff36a" exitCode=0 Jun 11 14:25:13.133390 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:13.132919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" event={"ID":"397294af-9d7c-482a-aa55-853a313f2610","Type":"ContainerDied","Data":"6d06af9031fa044317212f70b2c80abb2ab85a6cfaeffec1f70e5ef82e8ff36a"} Jun 11 14:25:14.140598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:14.140559 2574 generic.go:356] "Generic (PLEG): container finished" podID="397294af-9d7c-482a-aa55-853a313f2610" containerID="d72f9a69a377665e9cc4793777c2141a5e0b164f012fcdcda83e2b8d5b4b3a9b" exitCode=0 Jun 11 14:25:14.140991 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:14.140637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" event={"ID":"397294af-9d7c-482a-aa55-853a313f2610","Type":"ContainerDied","Data":"d72f9a69a377665e9cc4793777c2141a5e0b164f012fcdcda83e2b8d5b4b3a9b"} Jun 11 14:25:15.277761 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.277737 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:15.366029 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.365988 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util\") pod \"397294af-9d7c-482a-aa55-853a313f2610\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " Jun 11 14:25:15.366200 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.366120 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngdwm\" (UniqueName: \"kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm\") pod \"397294af-9d7c-482a-aa55-853a313f2610\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " Jun 11 14:25:15.366200 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.366144 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle\") pod \"397294af-9d7c-482a-aa55-853a313f2610\" (UID: \"397294af-9d7c-482a-aa55-853a313f2610\") " Jun 11 14:25:15.367078 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.367049 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle" (OuterVolumeSpecName: "bundle") pod "397294af-9d7c-482a-aa55-853a313f2610" (UID: "397294af-9d7c-482a-aa55-853a313f2610"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:25:15.368334 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.368313 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm" (OuterVolumeSpecName: "kube-api-access-ngdwm") pod "397294af-9d7c-482a-aa55-853a313f2610" (UID: "397294af-9d7c-482a-aa55-853a313f2610"). InnerVolumeSpecName "kube-api-access-ngdwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:25:15.373971 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.373933 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util" (OuterVolumeSpecName: "util") pod "397294af-9d7c-482a-aa55-853a313f2610" (UID: "397294af-9d7c-482a-aa55-853a313f2610"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:25:15.467494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.467396 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngdwm\" (UniqueName: \"kubernetes.io/projected/397294af-9d7c-482a-aa55-853a313f2610-kube-api-access-ngdwm\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:15.467494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.467433 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:15.467494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:15.467446 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/397294af-9d7c-482a-aa55-853a313f2610-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:16.151082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:16.151051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" event={"ID":"397294af-9d7c-482a-aa55-853a313f2610","Type":"ContainerDied","Data":"38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d"} Jun 11 14:25:16.151275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:16.151091 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qlcz4" Jun 11 14:25:16.151275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:16.151096 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38d836eb75e581cb4f797999bd373b79a8fd1e43bafa4683ed6d825eb116ac5d" Jun 11 14:25:21.123605 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:21.123564 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b69d76555-4gm5b" Jun 11 14:25:24.862538 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862498 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv"] Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862815 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="extract" Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862826 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="extract" Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862839 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="pull" Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862845 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="pull" Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862856 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="util" Jun 11 14:25:24.862937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862864 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="util" Jun 11 14:25:24.863124 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.862950 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="397294af-9d7c-482a-aa55-853a313f2610" containerName="extract" Jun 11 14:25:24.903675 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.903640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:24.905139 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.905108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv"] Jun 11 14:25:24.907493 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.907468 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:25:24.907613 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.907591 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:25:24.908668 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.908645 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:25:24.951618 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.951581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:24.951809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.951629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:24.951809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:24.951752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbb6x\" (UniqueName: \"kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.053152 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.053113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.053388 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.053198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbb6x\" (UniqueName: \"kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.053388 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.053253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.053602 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.053581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.053674 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.053627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.070155 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.070127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbb6x\" (UniqueName: \"kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.215135 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.215050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:25.397358 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:25.397330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv"] Jun 11 14:25:25.398932 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:25:25.398912 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e0d661_18ee_40b0_bb4b_fc33e8427948.slice/crio-6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9 WatchSource:0}: Error finding container 6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9: Status 404 returned error can't find the container with id 6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9 Jun 11 14:25:26.214690 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:26.214650 2574 generic.go:356] "Generic (PLEG): container finished" podID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerID="f4e1ad8211c290850106b8ed30ae32273537563892e03e433eaff11ce4a8ff51" exitCode=0 Jun 11 14:25:26.215122 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:26.214740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" event={"ID":"b0e0d661-18ee-40b0-bb4b-fc33e8427948","Type":"ContainerDied","Data":"f4e1ad8211c290850106b8ed30ae32273537563892e03e433eaff11ce4a8ff51"} Jun 11 14:25:26.215122 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:26.214799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" event={"ID":"b0e0d661-18ee-40b0-bb4b-fc33e8427948","Type":"ContainerStarted","Data":"6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9"} Jun 11 14:25:27.221447 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:27.221411 2574 generic.go:356] "Generic (PLEG): container finished" podID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerID="1d565693c96277cc0a6143dfd1c6a75bfd524ba81ee13737d4d62ee95daf5d40" exitCode=0 Jun 11 14:25:27.221817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:27.221482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" event={"ID":"b0e0d661-18ee-40b0-bb4b-fc33e8427948","Type":"ContainerDied","Data":"1d565693c96277cc0a6143dfd1c6a75bfd524ba81ee13737d4d62ee95daf5d40"} Jun 11 14:25:28.228510 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:28.228475 2574 generic.go:356] "Generic (PLEG): container finished" podID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerID="5cbba5ce2f40aa60a67fae36442e43ff14583e5a5716383fa246ac1375fec10e" exitCode=0 Jun 11 14:25:28.228915 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:28.228569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" event={"ID":"b0e0d661-18ee-40b0-bb4b-fc33e8427948","Type":"ContainerDied","Data":"5cbba5ce2f40aa60a67fae36442e43ff14583e5a5716383fa246ac1375fec10e"} Jun 11 14:25:29.355823 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.355797 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:29.503956 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.503863 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util\") pod \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " Jun 11 14:25:29.503956 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.503930 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle\") pod \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " Jun 11 14:25:29.503956 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.503951 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbb6x\" (UniqueName: \"kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x\") pod \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\" (UID: \"b0e0d661-18ee-40b0-bb4b-fc33e8427948\") " Jun 11 14:25:29.504931 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.504902 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle" (OuterVolumeSpecName: "bundle") pod "b0e0d661-18ee-40b0-bb4b-fc33e8427948" (UID: "b0e0d661-18ee-40b0-bb4b-fc33e8427948"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:25:29.506181 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.506147 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x" (OuterVolumeSpecName: "kube-api-access-cbb6x") pod "b0e0d661-18ee-40b0-bb4b-fc33e8427948" (UID: "b0e0d661-18ee-40b0-bb4b-fc33e8427948"). InnerVolumeSpecName "kube-api-access-cbb6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:25:29.509501 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.509466 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util" (OuterVolumeSpecName: "util") pod "b0e0d661-18ee-40b0-bb4b-fc33e8427948" (UID: "b0e0d661-18ee-40b0-bb4b-fc33e8427948"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:25:29.604961 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.604919 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:29.604961 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.604955 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0e0d661-18ee-40b0-bb4b-fc33e8427948-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:29.604961 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:29.604966 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbb6x\" (UniqueName: \"kubernetes.io/projected/b0e0d661-18ee-40b0-bb4b-fc33e8427948-kube-api-access-cbb6x\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:25:30.242092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:30.242058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" event={"ID":"b0e0d661-18ee-40b0-bb4b-fc33e8427948","Type":"ContainerDied","Data":"6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9"} Jun 11 14:25:30.242092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:30.242078 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ads4dv" Jun 11 14:25:30.242311 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:30.242112 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eef28f8118a78aa300b2f09aaf4f19997fb58aee2360468cb7e5158c16df0c9" Jun 11 14:25:40.906363 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906328 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-f6hd2"] Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906647 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="util" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906657 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="util" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906670 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="extract" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906675 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="extract" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906690 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="pull" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906695 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="pull" Jun 11 14:25:40.906825 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.906760 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e0d661-18ee-40b0-bb4b-fc33e8427948" containerName="extract" Jun 11 14:25:40.909299 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.909278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:40.911625 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.911600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jwzvc\"" Jun 11 14:25:40.911736 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.911624 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 14:25:40.919132 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:40.919105 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-f6hd2"] Jun 11 14:25:41.005638 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.005604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmgp\" (UniqueName: \"kubernetes.io/projected/04185f0e-a4d6-461b-aed7-89d9b1cae84f-kube-api-access-xsmgp\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.005638 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.005647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/04185f0e-a4d6-461b-aed7-89d9b1cae84f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.106253 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.106200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmgp\" (UniqueName: \"kubernetes.io/projected/04185f0e-a4d6-461b-aed7-89d9b1cae84f-kube-api-access-xsmgp\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.106253 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.106260 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/04185f0e-a4d6-461b-aed7-89d9b1cae84f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.106921 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.106903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/04185f0e-a4d6-461b-aed7-89d9b1cae84f-redirect-config\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.122316 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.122279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmgp\" (UniqueName: \"kubernetes.io/projected/04185f0e-a4d6-461b-aed7-89d9b1cae84f-kube-api-access-xsmgp\") pod \"dashboard-redirect-56997bdbdf-f6hd2\" (UID: \"04185f0e-a4d6-461b-aed7-89d9b1cae84f\") " pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.221712 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.221624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" Jun 11 14:25:41.360646 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:41.360617 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56997bdbdf-f6hd2"] Jun 11 14:25:41.363199 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:25:41.363161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04185f0e_a4d6_461b_aed7_89d9b1cae84f.slice/crio-badfff30c344a81fac7866fc126e59510707be3748c5426c6d4de4334d9746b6 WatchSource:0}: Error finding container badfff30c344a81fac7866fc126e59510707be3748c5426c6d4de4334d9746b6: Status 404 returned error can't find the container with id badfff30c344a81fac7866fc126e59510707be3748c5426c6d4de4334d9746b6 Jun 11 14:25:42.302159 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:42.302123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" event={"ID":"04185f0e-a4d6-461b-aed7-89d9b1cae84f","Type":"ContainerStarted","Data":"badfff30c344a81fac7866fc126e59510707be3748c5426c6d4de4334d9746b6"} Jun 11 14:25:48.574131 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.572947 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2"] Jun 11 14:25:48.580001 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.578864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.582817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.582179 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 14:25:48.583140 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.581968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2g955\"" Jun 11 14:25:48.592453 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.592072 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2"] Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.674947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b5cr\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-kube-api-access-2b5cr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.675428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.675323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.775883 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.775846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.775903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.775926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.775979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.776083 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b5cr\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-kube-api-access-2b5cr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.776967 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.777377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.777718 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.777619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.778332 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.778241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.779905 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.779736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.783115 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.781606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.786422 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.786336 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b5cr\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-kube-api-access-2b5cr\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.786658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.786500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e039e2-eaf3-48d4-bea0-1bc1942ab137-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qs6f2\" (UID: \"63e039e2-eaf3-48d4-bea0-1bc1942ab137\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:48.898832 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:48.898461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:49.072831 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:49.072739 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2"] Jun 11 14:25:49.085462 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:25:49.085425 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e039e2_eaf3_48d4_bea0_1bc1942ab137.slice/crio-679008dc5042e625c423eef1930df4f793647f71f075ace84690bb202f1636f5 WatchSource:0}: Error finding container 679008dc5042e625c423eef1930df4f793647f71f075ace84690bb202f1636f5: Status 404 returned error can't find the container with id 679008dc5042e625c423eef1930df4f793647f71f075ace84690bb202f1636f5 Jun 11 14:25:49.335642 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:49.335596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" event={"ID":"63e039e2-eaf3-48d4-bea0-1bc1942ab137","Type":"ContainerStarted","Data":"679008dc5042e625c423eef1930df4f793647f71f075ace84690bb202f1636f5"} Jun 11 14:25:53.997407 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:53.997362 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:25:53.997705 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:53.997459 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:25:53.997705 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:53.997501 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:25:54.371295 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:54.371252 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" event={"ID":"04185f0e-a4d6-461b-aed7-89d9b1cae84f","Type":"ContainerStarted","Data":"e08b3bbbddbb8943f50127e0d049937a25f9288c7671ce18877c36032a22f29c"} Jun 11 14:25:54.372877 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:54.372850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" event={"ID":"63e039e2-eaf3-48d4-bea0-1bc1942ab137","Type":"ContainerStarted","Data":"459a828004ce7d02a673698951fa7c6edb5038e434f53488ae28cb92bd38c672"} Jun 11 14:25:54.388424 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:54.388286 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56997bdbdf-f6hd2" podStartSLOduration=1.755745085 podStartE2EDuration="14.388266177s" totalImagesPullingTime="12.632521092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:54.387317023 +0000 UTC m=+533.488898153" watchObservedRunningTime="2026-06-11 14:25:54.388266177 +0000 UTC m=+533.489847308" Jun 11 14:25:54.411800 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:54.411736 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" podStartSLOduration=1.502827108 podStartE2EDuration="6.41171164s" totalImagesPullingTime="4.908884532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:25:54.409494662 +0000 UTC m=+533.511075795" watchObservedRunningTime="2026-06-11 14:25:54.41171164 +0000 UTC m=+533.513292771" Jun 11 14:25:54.898906 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:54.898867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:55.904071 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:55.904035 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:56.382437 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:56.382404 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:25:56.383464 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:25:56.383444 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qs6f2" Jun 11 14:26:10.628241 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.628190 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:10.633552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.633516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:10.636334 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.636309 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:26:10.636460 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.636309 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lwmd8\"" Jun 11 14:26:10.637195 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.637176 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:26:10.644141 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.644114 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:10.764483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.764437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w85k\" (UniqueName: \"kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k\") pod \"kuadrant-operator-catalog-l8ntr\" (UID: \"d4986563-5397-4f75-9d64-2758850e1be0\") " pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:10.865887 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.865841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w85k\" (UniqueName: \"kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k\") pod \"kuadrant-operator-catalog-l8ntr\" (UID: \"d4986563-5397-4f75-9d64-2758850e1be0\") " pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:10.875146 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.875115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w85k\" (UniqueName: \"kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k\") pod \"kuadrant-operator-catalog-l8ntr\" (UID: \"d4986563-5397-4f75-9d64-2758850e1be0\") " pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:10.945323 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.945229 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:10.995336 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:10.995303 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:11.083297 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.083265 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:11.085141 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:11.085116 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4986563_5397_4f75_9d64_2758850e1be0.slice/crio-de63e88abb0961fc495bd11f6850ffe1778d1491ffb6e717332b86a55bc720a5 WatchSource:0}: Error finding container de63e88abb0961fc495bd11f6850ffe1778d1491ffb6e717332b86a55bc720a5: Status 404 returned error can't find the container with id de63e88abb0961fc495bd11f6850ffe1778d1491ffb6e717332b86a55bc720a5 Jun 11 14:26:11.206506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.206424 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6cztn"] Jun 11 14:26:11.211130 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.211074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:11.224618 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.224590 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6cztn"] Jun 11 14:26:11.269609 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.269564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-928l7\" (UniqueName: \"kubernetes.io/projected/2b6e97c0-5518-414e-a385-95bf9e9e48ed-kube-api-access-928l7\") pod \"kuadrant-operator-catalog-6cztn\" (UID: \"2b6e97c0-5518-414e-a385-95bf9e9e48ed\") " pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:11.370801 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.370753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928l7\" (UniqueName: \"kubernetes.io/projected/2b6e97c0-5518-414e-a385-95bf9e9e48ed-kube-api-access-928l7\") pod \"kuadrant-operator-catalog-6cztn\" (UID: \"2b6e97c0-5518-414e-a385-95bf9e9e48ed\") " pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:11.379733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.379703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-928l7\" (UniqueName: \"kubernetes.io/projected/2b6e97c0-5518-414e-a385-95bf9e9e48ed-kube-api-access-928l7\") pod \"kuadrant-operator-catalog-6cztn\" (UID: \"2b6e97c0-5518-414e-a385-95bf9e9e48ed\") " pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:11.457693 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.457597 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" event={"ID":"d4986563-5397-4f75-9d64-2758850e1be0","Type":"ContainerStarted","Data":"de63e88abb0961fc495bd11f6850ffe1778d1491ffb6e717332b86a55bc720a5"} Jun 11 14:26:11.520993 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.520945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:11.668667 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:11.668635 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6cztn"] Jun 11 14:26:11.671385 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:11.671358 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6e97c0_5518_414e_a385_95bf9e9e48ed.slice/crio-259bdeabab2505e459656247f29d31b8454d868fd82358d64f9414ad72f871d0 WatchSource:0}: Error finding container 259bdeabab2505e459656247f29d31b8454d868fd82358d64f9414ad72f871d0: Status 404 returned error can't find the container with id 259bdeabab2505e459656247f29d31b8454d868fd82358d64f9414ad72f871d0 Jun 11 14:26:12.465127 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:12.465092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" event={"ID":"2b6e97c0-5518-414e-a385-95bf9e9e48ed","Type":"ContainerStarted","Data":"259bdeabab2505e459656247f29d31b8454d868fd82358d64f9414ad72f871d0"} Jun 11 14:26:14.477051 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.477007 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" event={"ID":"d4986563-5397-4f75-9d64-2758850e1be0","Type":"ContainerStarted","Data":"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63"} Jun 11 14:26:14.477051 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.477045 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" podUID="d4986563-5397-4f75-9d64-2758850e1be0" containerName="registry-server" containerID="cri-o://957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63" gracePeriod=2 Jun 11 14:26:14.478649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.478617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" event={"ID":"2b6e97c0-5518-414e-a385-95bf9e9e48ed","Type":"ContainerStarted","Data":"16be8b99c19bb3c61a5d63fbdda20184608125c7a1ee52871b5eea47fb146138"} Jun 11 14:26:14.495257 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.495187 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" podStartSLOduration=1.977623098 podStartE2EDuration="4.495170358s" totalImagesPullingTime="2.51754726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:14.493452311 +0000 UTC m=+553.595033442" watchObservedRunningTime="2026-06-11 14:26:14.495170358 +0000 UTC m=+553.596751490" Jun 11 14:26:14.509343 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.509294 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" podStartSLOduration=1.575149541 podStartE2EDuration="3.509278046s" totalImagesPullingTime="1.934128505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:14.507673674 +0000 UTC m=+553.609254805" watchObservedRunningTime="2026-06-11 14:26:14.509278046 +0000 UTC m=+553.610859175" Jun 11 14:26:14.725764 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.725736 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:14.805360 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.805330 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w85k\" (UniqueName: \"kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k\") pod \"d4986563-5397-4f75-9d64-2758850e1be0\" (UID: \"d4986563-5397-4f75-9d64-2758850e1be0\") " Jun 11 14:26:14.807453 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.807426 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k" (OuterVolumeSpecName: "kube-api-access-9w85k") pod "d4986563-5397-4f75-9d64-2758850e1be0" (UID: "d4986563-5397-4f75-9d64-2758850e1be0"). InnerVolumeSpecName "kube-api-access-9w85k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:26:14.906887 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:14.906849 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w85k\" (UniqueName: \"kubernetes.io/projected/d4986563-5397-4f75-9d64-2758850e1be0-kube-api-access-9w85k\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:15.484504 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.484467 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4986563-5397-4f75-9d64-2758850e1be0" containerID="957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63" exitCode=0 Jun 11 14:26:15.484986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.484514 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" Jun 11 14:26:15.484986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.484554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" event={"ID":"d4986563-5397-4f75-9d64-2758850e1be0","Type":"ContainerDied","Data":"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63"} Jun 11 14:26:15.484986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.484607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l8ntr" event={"ID":"d4986563-5397-4f75-9d64-2758850e1be0","Type":"ContainerDied","Data":"de63e88abb0961fc495bd11f6850ffe1778d1491ffb6e717332b86a55bc720a5"} Jun 11 14:26:15.484986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.484635 2574 scope.go:117] "RemoveContainer" containerID="957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63" Jun 11 14:26:15.494080 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.494060 2574 scope.go:117] "RemoveContainer" containerID="957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63" Jun 11 14:26:15.494416 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:26:15.494394 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63\": container with ID starting with 957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63 not found: ID does not exist" containerID="957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63" Jun 11 14:26:15.494489 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.494429 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63"} err="failed to get container status \"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63\": rpc error: code = NotFound desc = could not find container \"957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63\": container with ID starting with 957277a352abb7cca7922e335fd22245a80127a3decb798c9de77c98665ffc63 not found: ID does not exist" Jun 11 14:26:15.501260 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.501232 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:15.505655 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:15.505624 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l8ntr"] Jun 11 14:26:17.300466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:17.300427 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4986563-5397-4f75-9d64-2758850e1be0" path="/var/lib/kubelet/pods/d4986563-5397-4f75-9d64-2758850e1be0/volumes" Jun 11 14:26:21.521547 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:21.521511 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:21.521971 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:21.521586 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:21.544403 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:21.544361 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:22.541780 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:22.541753 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6cztn" Jun 11 14:26:26.416285 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.416243 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs"] Jun 11 14:26:26.416742 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.416601 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4986563-5397-4f75-9d64-2758850e1be0" containerName="registry-server" Jun 11 14:26:26.416742 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.416614 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4986563-5397-4f75-9d64-2758850e1be0" containerName="registry-server" Jun 11 14:26:26.416742 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.416672 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4986563-5397-4f75-9d64-2758850e1be0" containerName="registry-server" Jun 11 14:26:26.434804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.434773 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs"] Jun 11 14:26:26.434975 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.434875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.437656 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.437632 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7wgp6\"" Jun 11 14:26:26.508556 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.508515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4x9n\" (UniqueName: \"kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.508732 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.508588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.508732 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.508611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.609388 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.609343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.609576 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.609460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4x9n\" (UniqueName: \"kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.609630 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.609616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.609838 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.609814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.609902 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.609887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.618932 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.618902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4x9n\" (UniqueName: \"kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.746768 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.746669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:26.884487 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:26.884460 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs"] Jun 11 14:26:26.886562 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:26.886529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3e2991_9569_4e2e_92b3_547a89cf3e9c.slice/crio-4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5 WatchSource:0}: Error finding container 4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5: Status 404 returned error can't find the container with id 4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5 Jun 11 14:26:27.044975 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.044940 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq"] Jun 11 14:26:27.047482 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.047464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.058979 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.058952 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq"] Jun 11 14:26:27.215444 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.215404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.215444 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.215445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.215662 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.215541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lsj9\" (UniqueName: \"kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.316563 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.316476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lsj9\" (UniqueName: \"kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.316563 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.316550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.316813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.316572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.316894 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.316876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.316988 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.316965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.325494 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.325468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lsj9\" (UniqueName: \"kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.357167 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.357130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:27.428456 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.428421 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2"] Jun 11 14:26:27.431621 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.431598 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.442584 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.442556 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2"] Jun 11 14:26:27.518372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.518334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.518579 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.518384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.518579 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.518509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfdp\" (UniqueName: \"kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.526263 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.526235 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq"] Jun 11 14:26:27.528298 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:27.528272 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0a578b_6014_4722_9bbf_696aba67dfc8.slice/crio-0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4 WatchSource:0}: Error finding container 0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4: Status 404 returned error can't find the container with id 0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4 Jun 11 14:26:27.543739 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.543702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" event={"ID":"1c0a578b-6014-4722-9bbf-696aba67dfc8","Type":"ContainerStarted","Data":"0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4"} Jun 11 14:26:27.545490 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.545461 2574 generic.go:356] "Generic (PLEG): container finished" podID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerID="61368e5a5bc573e919a0bef60994fa6562c39d9de595caf42b4ebd074f4d25e5" exitCode=0 Jun 11 14:26:27.545611 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.545553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" event={"ID":"2d3e2991-9569-4e2e-92b3-547a89cf3e9c","Type":"ContainerDied","Data":"61368e5a5bc573e919a0bef60994fa6562c39d9de595caf42b4ebd074f4d25e5"} Jun 11 14:26:27.545689 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.545631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" event={"ID":"2d3e2991-9569-4e2e-92b3-547a89cf3e9c","Type":"ContainerStarted","Data":"4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5"} Jun 11 14:26:27.619772 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.619734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.619991 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.619794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.619991 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.619870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfdp\" (UniqueName: \"kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.620229 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.620192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.620289 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.620251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.629983 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.629945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfdp\" (UniqueName: \"kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.742391 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.742350 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:27.836605 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.836512 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6"] Jun 11 14:26:27.839435 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.839411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:27.850010 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.849984 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6"] Jun 11 14:26:27.880552 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.880525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2"] Jun 11 14:26:27.882167 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:27.882133 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe05a2c0_d50c_44f0_b6f9_29c701a4bd6a.slice/crio-cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f WatchSource:0}: Error finding container cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f: Status 404 returned error can't find the container with id cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f Jun 11 14:26:27.922483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.922451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:27.922611 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.922575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:27.922651 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:27.922626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqm4\" (UniqueName: \"kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.023893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.023860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.024078 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.023923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.024078 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.023942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqm4\" (UniqueName: \"kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.024375 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.024353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.024466 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.024382 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.037053 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.037020 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqm4\" (UniqueName: \"kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.152982 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.152907 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:28.333618 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.333595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6"] Jun 11 14:26:28.374124 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:28.374091 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908d837d_5435_4ba7_b50b_b72f124e7394.slice/crio-fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc WatchSource:0}: Error finding container fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc: Status 404 returned error can't find the container with id fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc Jun 11 14:26:28.551741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.551710 2574 generic.go:356] "Generic (PLEG): container finished" podID="908d837d-5435-4ba7-b50b-b72f124e7394" containerID="728c32ad6dfb2e27c881596e207565a27c18c2ccddc58f6cddfa373d2541715b" exitCode=0 Jun 11 14:26:28.552147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.551797 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" event={"ID":"908d837d-5435-4ba7-b50b-b72f124e7394","Type":"ContainerDied","Data":"728c32ad6dfb2e27c881596e207565a27c18c2ccddc58f6cddfa373d2541715b"} Jun 11 14:26:28.552147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.551856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" event={"ID":"908d837d-5435-4ba7-b50b-b72f124e7394","Type":"ContainerStarted","Data":"fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc"} Jun 11 14:26:28.553784 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.553763 2574 generic.go:356] "Generic (PLEG): container finished" podID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerID="2e21108c268a5e036154874dc25561ad28cb41561a9b7a5cffdeb4d6bee5617f" exitCode=0 Jun 11 14:26:28.553952 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.553850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" event={"ID":"2d3e2991-9569-4e2e-92b3-547a89cf3e9c","Type":"ContainerDied","Data":"2e21108c268a5e036154874dc25561ad28cb41561a9b7a5cffdeb4d6bee5617f"} Jun 11 14:26:28.555546 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.555524 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerID="705797a84dfe2b7faf66705a147c4e864ef7904d6d46b18755e680af2d223f96" exitCode=0 Jun 11 14:26:28.555649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.555623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" event={"ID":"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a","Type":"ContainerDied","Data":"705797a84dfe2b7faf66705a147c4e864ef7904d6d46b18755e680af2d223f96"} Jun 11 14:26:28.555708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.555667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" event={"ID":"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a","Type":"ContainerStarted","Data":"cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f"} Jun 11 14:26:28.557302 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.557279 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerID="7ffefa8d0e2839be07700f53c3159d9d0d878bbc5b7892e3f27e2a9344b0c33d" exitCode=0 Jun 11 14:26:28.557470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:28.557325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" event={"ID":"1c0a578b-6014-4722-9bbf-696aba67dfc8","Type":"ContainerDied","Data":"7ffefa8d0e2839be07700f53c3159d9d0d878bbc5b7892e3f27e2a9344b0c33d"} Jun 11 14:26:29.565338 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.565305 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerID="e8401f85ab94350348eacf254dc30ea68054efc0ece7fe319b8191c6770e47c8" exitCode=0 Jun 11 14:26:29.565755 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.565394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" event={"ID":"1c0a578b-6014-4722-9bbf-696aba67dfc8","Type":"ContainerDied","Data":"e8401f85ab94350348eacf254dc30ea68054efc0ece7fe319b8191c6770e47c8"} Jun 11 14:26:29.567496 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.567472 2574 generic.go:356] "Generic (PLEG): container finished" podID="908d837d-5435-4ba7-b50b-b72f124e7394" containerID="ca59a1afdb389b521431fb71d3edd4bec851ab2732591fc6dcb1e9b52700a4b7" exitCode=0 Jun 11 14:26:29.567598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.567577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" event={"ID":"908d837d-5435-4ba7-b50b-b72f124e7394","Type":"ContainerDied","Data":"ca59a1afdb389b521431fb71d3edd4bec851ab2732591fc6dcb1e9b52700a4b7"} Jun 11 14:26:29.570180 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.570154 2574 generic.go:356] "Generic (PLEG): container finished" podID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerID="a849322eb753eaa933951d3edce2538ec5f99aeaa333ef058a80313a5d6691ed" exitCode=0 Jun 11 14:26:29.570275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.570246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" event={"ID":"2d3e2991-9569-4e2e-92b3-547a89cf3e9c","Type":"ContainerDied","Data":"a849322eb753eaa933951d3edce2538ec5f99aeaa333ef058a80313a5d6691ed"} Jun 11 14:26:29.572277 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.572254 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerID="d675f2f409c267ae24d384baea231099d0c02e7e78ff509576c15982c20eb95e" exitCode=0 Jun 11 14:26:29.572370 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:29.572304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" event={"ID":"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a","Type":"ContainerDied","Data":"d675f2f409c267ae24d384baea231099d0c02e7e78ff509576c15982c20eb95e"} Jun 11 14:26:30.580082 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.580048 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerID="f53d40cf3543a1a3267c81002ce25a094ba3c993ef7850e44245581f82562699" exitCode=0 Jun 11 14:26:30.580545 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.580137 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" event={"ID":"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a","Type":"ContainerDied","Data":"f53d40cf3543a1a3267c81002ce25a094ba3c993ef7850e44245581f82562699"} Jun 11 14:26:30.582429 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.582410 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerID="8dbbc721a6cf20236dc946414c414e8e6285af5ceb42ed7712dfb65b910cbf58" exitCode=0 Jun 11 14:26:30.582509 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.582485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" event={"ID":"1c0a578b-6014-4722-9bbf-696aba67dfc8","Type":"ContainerDied","Data":"8dbbc721a6cf20236dc946414c414e8e6285af5ceb42ed7712dfb65b910cbf58"} Jun 11 14:26:30.584614 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.584590 2574 generic.go:356] "Generic (PLEG): container finished" podID="908d837d-5435-4ba7-b50b-b72f124e7394" containerID="cecb284b6d3095ce6e056645aac506134d58b50d2286a3e104fe296030dacba0" exitCode=0 Jun 11 14:26:30.584711 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.584652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" event={"ID":"908d837d-5435-4ba7-b50b-b72f124e7394","Type":"ContainerDied","Data":"cecb284b6d3095ce6e056645aac506134d58b50d2286a3e104fe296030dacba0"} Jun 11 14:26:30.742078 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.742053 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:30.853071 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.852981 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4x9n\" (UniqueName: \"kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n\") pod \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " Jun 11 14:26:30.853071 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.853055 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util\") pod \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " Jun 11 14:26:30.853346 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.853117 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle\") pod \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\" (UID: \"2d3e2991-9569-4e2e-92b3-547a89cf3e9c\") " Jun 11 14:26:30.853672 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.853642 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle" (OuterVolumeSpecName: "bundle") pod "2d3e2991-9569-4e2e-92b3-547a89cf3e9c" (UID: "2d3e2991-9569-4e2e-92b3-547a89cf3e9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:30.855175 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.855147 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n" (OuterVolumeSpecName: "kube-api-access-l4x9n") pod "2d3e2991-9569-4e2e-92b3-547a89cf3e9c" (UID: "2d3e2991-9569-4e2e-92b3-547a89cf3e9c"). InnerVolumeSpecName "kube-api-access-l4x9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:26:30.857924 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.857901 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util" (OuterVolumeSpecName: "util") pod "2d3e2991-9569-4e2e-92b3-547a89cf3e9c" (UID: "2d3e2991-9569-4e2e-92b3-547a89cf3e9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:30.953925 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.953886 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4x9n\" (UniqueName: \"kubernetes.io/projected/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-kube-api-access-l4x9n\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:30.953925 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.953915 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:30.953925 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:30.953927 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3e2991-9569-4e2e-92b3-547a89cf3e9c-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:31.211430 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211339 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87d664694-49ksd"] Jun 11 14:26:31.211737 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211722 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="pull" Jun 11 14:26:31.211798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211737 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="pull" Jun 11 14:26:31.211798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211761 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="extract" Jun 11 14:26:31.211798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211766 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="extract" Jun 11 14:26:31.211798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211776 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="util" Jun 11 14:26:31.211798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211782 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="util" Jun 11 14:26:31.212024 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.211836 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3e2991-9569-4e2e-92b3-547a89cf3e9c" containerName="extract" Jun 11 14:26:31.213822 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.213803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.235759 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.235724 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87d664694-49ksd"] Jun 11 14:26:31.357629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.357793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-oauth-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.357793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-service-ca\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.357793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-console-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.357793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68pb\" (UniqueName: \"kubernetes.io/projected/d295d050-6027-4981-8a5d-9f2091467a43-kube-api-access-p68pb\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.357793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-oauth-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.358142 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.357852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-trusted-ca-bundle\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.458782 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-oauth-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.458782 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-service-ca\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-console-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p68pb\" (UniqueName: \"kubernetes.io/projected/d295d050-6027-4981-8a5d-9f2091467a43-kube-api-access-p68pb\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-oauth-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.458959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-trusted-ca-bundle\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459241 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.459045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459692 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.459619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-oauth-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459820 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.459691 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-console-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.459820 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.459726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-service-ca\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.460074 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.460051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d295d050-6027-4981-8a5d-9f2091467a43-trusted-ca-bundle\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.461773 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.461708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-oauth-config\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.461773 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.461708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d295d050-6027-4981-8a5d-9f2091467a43-console-serving-cert\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.472805 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.472771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68pb\" (UniqueName: \"kubernetes.io/projected/d295d050-6027-4981-8a5d-9f2091467a43-kube-api-access-p68pb\") pod \"console-87d664694-49ksd\" (UID: \"d295d050-6027-4981-8a5d-9f2091467a43\") " pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.523262 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.523229 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:31.593798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.593769 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" Jun 11 14:26:31.593798 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.593773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs" event={"ID":"2d3e2991-9569-4e2e-92b3-547a89cf3e9c","Type":"ContainerDied","Data":"4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5"} Jun 11 14:26:31.594260 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.593834 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5cf0b7ecc1ecf9c9c27b8e31f94e7d6444f6a9af6d4eba143b414ccf810bc5" Jun 11 14:26:31.691468 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.689914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87d664694-49ksd"] Jun 11 14:26:31.693574 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:31.693537 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd295d050_6027_4981_8a5d_9f2091467a43.slice/crio-e93555829b38235ad8b87d41cd392f32442a390be04173d75c07005746c15e52 WatchSource:0}: Error finding container e93555829b38235ad8b87d41cd392f32442a390be04173d75c07005746c15e52: Status 404 returned error can't find the container with id e93555829b38235ad8b87d41cd392f32442a390be04173d75c07005746c15e52 Jun 11 14:26:31.792046 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.792016 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:31.796197 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.796174 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:31.799952 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.799930 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:31.965151 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpqm4\" (UniqueName: \"kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4\") pod \"908d837d-5435-4ba7-b50b-b72f124e7394\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " Jun 11 14:26:31.965151 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965094 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util\") pod \"908d837d-5435-4ba7-b50b-b72f124e7394\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " Jun 11 14:26:31.965151 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965121 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle\") pod \"908d837d-5435-4ba7-b50b-b72f124e7394\" (UID: \"908d837d-5435-4ba7-b50b-b72f124e7394\") " Jun 11 14:26:31.965151 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965151 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle\") pod \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " Jun 11 14:26:31.965513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965181 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util\") pod \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " Jun 11 14:26:31.965513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965253 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lsj9\" (UniqueName: \"kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9\") pod \"1c0a578b-6014-4722-9bbf-696aba67dfc8\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " Jun 11 14:26:31.965513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965287 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle\") pod \"1c0a578b-6014-4722-9bbf-696aba67dfc8\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " Jun 11 14:26:31.965513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965310 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkfdp\" (UniqueName: \"kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp\") pod \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\" (UID: \"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a\") " Jun 11 14:26:31.965513 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.965357 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util\") pod \"1c0a578b-6014-4722-9bbf-696aba67dfc8\" (UID: \"1c0a578b-6014-4722-9bbf-696aba67dfc8\") " Jun 11 14:26:31.966196 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.966117 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle" (OuterVolumeSpecName: "bundle") pod "908d837d-5435-4ba7-b50b-b72f124e7394" (UID: "908d837d-5435-4ba7-b50b-b72f124e7394"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:31.966196 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.966127 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle" (OuterVolumeSpecName: "bundle") pod "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" (UID: "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:31.966402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.966304 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle" (OuterVolumeSpecName: "bundle") pod "1c0a578b-6014-4722-9bbf-696aba67dfc8" (UID: "1c0a578b-6014-4722-9bbf-696aba67dfc8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:31.968289 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.968028 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9" (OuterVolumeSpecName: "kube-api-access-9lsj9") pod "1c0a578b-6014-4722-9bbf-696aba67dfc8" (UID: "1c0a578b-6014-4722-9bbf-696aba67dfc8"). InnerVolumeSpecName "kube-api-access-9lsj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:26:31.968404 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.968335 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4" (OuterVolumeSpecName: "kube-api-access-vpqm4") pod "908d837d-5435-4ba7-b50b-b72f124e7394" (UID: "908d837d-5435-4ba7-b50b-b72f124e7394"). InnerVolumeSpecName "kube-api-access-vpqm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:26:31.968462 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.968397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp" (OuterVolumeSpecName: "kube-api-access-zkfdp") pod "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" (UID: "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a"). InnerVolumeSpecName "kube-api-access-zkfdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:26:31.972373 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.972349 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util" (OuterVolumeSpecName: "util") pod "908d837d-5435-4ba7-b50b-b72f124e7394" (UID: "908d837d-5435-4ba7-b50b-b72f124e7394"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:31.972490 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.972466 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util" (OuterVolumeSpecName: "util") pod "1c0a578b-6014-4722-9bbf-696aba67dfc8" (UID: "1c0a578b-6014-4722-9bbf-696aba67dfc8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:31.972550 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:31.972533 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util" (OuterVolumeSpecName: "util") pod "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" (UID: "fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:26:32.066813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066761 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lsj9\" (UniqueName: \"kubernetes.io/projected/1c0a578b-6014-4722-9bbf-696aba67dfc8-kube-api-access-9lsj9\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.066813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066810 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.066813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066820 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkfdp\" (UniqueName: \"kubernetes.io/projected/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-kube-api-access-zkfdp\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.066813 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066830 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c0a578b-6014-4722-9bbf-696aba67dfc8-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.067092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066839 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpqm4\" (UniqueName: \"kubernetes.io/projected/908d837d-5435-4ba7-b50b-b72f124e7394-kube-api-access-vpqm4\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.067092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066848 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.067092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066855 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908d837d-5435-4ba7-b50b-b72f124e7394-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.067092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066863 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.067092 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.066870 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:26:32.600706 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.600670 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" Jun 11 14:26:32.600706 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.600676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2" event={"ID":"fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a","Type":"ContainerDied","Data":"cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f"} Jun 11 14:26:32.601158 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.600734 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc9879dbb20a4a6e9cb0e2a9d2e5c75d74a0abc41cbceb926eb5f51091849d3f" Jun 11 14:26:32.610859 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.610814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" event={"ID":"1c0a578b-6014-4722-9bbf-696aba67dfc8","Type":"ContainerDied","Data":"0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4"} Jun 11 14:26:32.611021 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.610868 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq" Jun 11 14:26:32.611021 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.610898 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a77728a6f635fe76f0276e838220669db97503cb6b9d30ab69a00e10f1fa1b4" Jun 11 14:26:32.612805 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.612779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d664694-49ksd" event={"ID":"d295d050-6027-4981-8a5d-9f2091467a43","Type":"ContainerStarted","Data":"c6660543536a9d24a0c2f78264016e9e9b8d008270f92dbb830bccb91e4989ea"} Jun 11 14:26:32.612963 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.612822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d664694-49ksd" event={"ID":"d295d050-6027-4981-8a5d-9f2091467a43","Type":"ContainerStarted","Data":"e93555829b38235ad8b87d41cd392f32442a390be04173d75c07005746c15e52"} Jun 11 14:26:32.615095 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.615073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" event={"ID":"908d837d-5435-4ba7-b50b-b72f124e7394","Type":"ContainerDied","Data":"fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc"} Jun 11 14:26:32.615272 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.615103 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbd5a9865d94e1389c79b615d069387718839b15499d3405b78fb4fd37c5bedc" Jun 11 14:26:32.615272 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.615106 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6" Jun 11 14:26:32.848217 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:32.848165 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87d664694-49ksd" podStartSLOduration=1.8481459249999999 podStartE2EDuration="1.848145925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:32.63881084 +0000 UTC m=+571.740391971" watchObservedRunningTime="2026-06-11 14:26:32.848145925 +0000 UTC m=+571.949727055" Jun 11 14:26:37.258320 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258287 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-thnwh"] Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258627 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="pull" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258638 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="pull" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258652 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="util" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258659 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="util" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258668 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="util" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258675 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="util" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258683 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="pull" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258688 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="pull" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258693 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="extract" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258698 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="extract" Jun 11 14:26:37.258700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258705 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258710 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258722 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="util" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258727 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="util" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258732 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="pull" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258736 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="pull" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258742 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258746 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258816 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="908d837d-5435-4ba7-b50b-b72f124e7394" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258826 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a" containerName="extract" Jun 11 14:26:37.259015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.258832 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0a578b-6014-4722-9bbf-696aba67dfc8" containerName="extract" Jun 11 14:26:37.261408 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.261389 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:37.264631 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.264609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6f6hg\"" Jun 11 14:26:37.275700 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.275671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-thnwh"] Jun 11 14:26:37.314856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.314819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srf2z\" (UniqueName: \"kubernetes.io/projected/cdb37ab8-b7a0-49d8-a80e-553d60c3aff0-kube-api-access-srf2z\") pod \"authorino-operator-75cc8d5cb7-thnwh\" (UID: \"cdb37ab8-b7a0-49d8-a80e-553d60c3aff0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:37.416157 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.416065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srf2z\" (UniqueName: \"kubernetes.io/projected/cdb37ab8-b7a0-49d8-a80e-553d60c3aff0-kube-api-access-srf2z\") pod \"authorino-operator-75cc8d5cb7-thnwh\" (UID: \"cdb37ab8-b7a0-49d8-a80e-553d60c3aff0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:37.431770 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.431739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srf2z\" (UniqueName: \"kubernetes.io/projected/cdb37ab8-b7a0-49d8-a80e-553d60c3aff0-kube-api-access-srf2z\") pod \"authorino-operator-75cc8d5cb7-thnwh\" (UID: \"cdb37ab8-b7a0-49d8-a80e-553d60c3aff0\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:37.572036 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.571997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:37.713859 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:37.713821 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-thnwh"] Jun 11 14:26:37.715446 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:37.715421 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb37ab8_b7a0_49d8_a80e_553d60c3aff0.slice/crio-605c0ce90ab67436b0b3b6cb1a03d6c64309c6b1b2f3b3d59504eea87b54267f WatchSource:0}: Error finding container 605c0ce90ab67436b0b3b6cb1a03d6c64309c6b1b2f3b3d59504eea87b54267f: Status 404 returned error can't find the container with id 605c0ce90ab67436b0b3b6cb1a03d6c64309c6b1b2f3b3d59504eea87b54267f Jun 11 14:26:38.652939 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:38.652853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" event={"ID":"cdb37ab8-b7a0-49d8-a80e-553d60c3aff0","Type":"ContainerStarted","Data":"605c0ce90ab67436b0b3b6cb1a03d6c64309c6b1b2f3b3d59504eea87b54267f"} Jun 11 14:26:40.667804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:40.667772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" event={"ID":"cdb37ab8-b7a0-49d8-a80e-553d60c3aff0","Type":"ContainerStarted","Data":"0754802bec75a8db7df3c9586dc36ef84abd413e5baa11fc2492d461399cdb06"} Jun 11 14:26:40.668229 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:40.667877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:40.711544 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:40.711480 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" podStartSLOduration=1.233026523 podStartE2EDuration="3.711463s" totalImagesPullingTime="2.478436477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:40.710283998 +0000 UTC m=+579.811865130" watchObservedRunningTime="2026-06-11 14:26:40.711463 +0000 UTC m=+579.813044129" Jun 11 14:26:41.523638 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:41.523611 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:41.523849 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:41.523824 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:41.528744 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:41.528717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:41.677075 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:41.677046 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-87d664694-49ksd" Jun 11 14:26:41.729927 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:41.729896 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:26:43.611725 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.611686 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg"] Jun 11 14:26:43.614284 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.614265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:43.616752 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.616731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r7zqd\"" Jun 11 14:26:43.627223 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.627175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg"] Jun 11 14:26:43.678604 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.678566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6pv\" (UniqueName: \"kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv\") pod \"limitador-operator-controller-manager-859d7b78bd-hzftg\" (UID: \"8981cabe-c288-4ce4-8421-96ce947c94db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:43.780147 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.780110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6pv\" (UniqueName: \"kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv\") pod \"limitador-operator-controller-manager-859d7b78bd-hzftg\" (UID: \"8981cabe-c288-4ce4-8421-96ce947c94db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:43.788864 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.788829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6pv\" (UniqueName: \"kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv\") pod \"limitador-operator-controller-manager-859d7b78bd-hzftg\" (UID: \"8981cabe-c288-4ce4-8421-96ce947c94db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:43.924142 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:43.924043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:44.064962 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:44.064938 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg"] Jun 11 14:26:44.066908 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:44.066882 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8981cabe_c288_4ce4_8421_96ce947c94db.slice/crio-cea277da9460e241664408a497dbbd8c2e678313d5c019d4e560836ef4ab1147 WatchSource:0}: Error finding container cea277da9460e241664408a497dbbd8c2e678313d5c019d4e560836ef4ab1147: Status 404 returned error can't find the container with id cea277da9460e241664408a497dbbd8c2e678313d5c019d4e560836ef4ab1147 Jun 11 14:26:44.691881 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:44.691843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" event={"ID":"8981cabe-c288-4ce4-8421-96ce947c94db","Type":"ContainerStarted","Data":"cea277da9460e241664408a497dbbd8c2e678313d5c019d4e560836ef4ab1147"} Jun 11 14:26:46.706649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:46.706610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" event={"ID":"8981cabe-c288-4ce4-8421-96ce947c94db","Type":"ContainerStarted","Data":"921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1"} Jun 11 14:26:46.707025 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:46.706693 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:26:46.730772 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:46.730712 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" podStartSLOduration=1.795559893 podStartE2EDuration="3.730696849s" totalImagesPullingTime="1.935136956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:26:46.728076388 +0000 UTC m=+585.829657519" watchObservedRunningTime="2026-06-11 14:26:46.730696849 +0000 UTC m=+585.832277979" Jun 11 14:26:51.675282 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:51.675246 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-thnwh" Jun 11 14:26:52.683055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.683018 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf"] Jun 11 14:26:52.692085 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.692054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.695991 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.695956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 14:26:52.696149 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.696061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 14:26:52.696275 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.696257 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7wgp6\"" Jun 11 14:26:52.696836 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.696812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf"] Jun 11 14:26:52.768319 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.768281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.768534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.768434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58735ce9-4628-4bbc-92c9-78834e360966-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.768534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.768499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpcx\" (UniqueName: \"kubernetes.io/projected/58735ce9-4628-4bbc-92c9-78834e360966-kube-api-access-4hpcx\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.869729 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.869686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58735ce9-4628-4bbc-92c9-78834e360966-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.869933 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.869771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpcx\" (UniqueName: \"kubernetes.io/projected/58735ce9-4628-4bbc-92c9-78834e360966-kube-api-access-4hpcx\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.869933 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.869818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.869933 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:26:52.869930 2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 14:26:52.870115 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:26:52.870016 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert podName:58735ce9-4628-4bbc-92c9-78834e360966 nodeName:}" failed. No retries permitted until 2026-06-11 14:26:53.370000256 +0000 UTC m=+592.471581365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-h4crf" (UID: "58735ce9-4628-4bbc-92c9-78834e360966") : secret "plugin-serving-cert" not found Jun 11 14:26:52.870414 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.870392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58735ce9-4628-4bbc-92c9-78834e360966-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:52.883804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:52.883776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpcx\" (UniqueName: \"kubernetes.io/projected/58735ce9-4628-4bbc-92c9-78834e360966-kube-api-access-4hpcx\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:53.374341 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:53.374306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:53.376861 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:53.376824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58735ce9-4628-4bbc-92c9-78834e360966-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h4crf\" (UID: \"58735ce9-4628-4bbc-92c9-78834e360966\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:53.602651 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:53.602614 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" Jun 11 14:26:53.739691 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:53.739664 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf"] Jun 11 14:26:53.740947 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:26:53.740920 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58735ce9_4628_4bbc_92c9_78834e360966.slice/crio-eb83ba89baa2c869970d984932633bf46f39660031b5a5e5c650118be8d23362 WatchSource:0}: Error finding container eb83ba89baa2c869970d984932633bf46f39660031b5a5e5c650118be8d23362: Status 404 returned error can't find the container with id eb83ba89baa2c869970d984932633bf46f39660031b5a5e5c650118be8d23362 Jun 11 14:26:53.750570 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:53.750536 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" event={"ID":"58735ce9-4628-4bbc-92c9-78834e360966","Type":"ContainerStarted","Data":"eb83ba89baa2c869970d984932633bf46f39660031b5a5e5c650118be8d23362"} Jun 11 14:26:57.714110 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:26:57.714077 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:01.301163 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:01.301132 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:27:01.302077 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:01.302058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:27:03.355893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.355856 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg"] Jun 11 14:27:03.358395 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.356097 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" containerName="manager" containerID="cri-o://921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1" gracePeriod=2 Jun 11 14:27:03.370833 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.370801 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg"] Jun 11 14:27:03.405176 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.405141 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2"] Jun 11 14:27:03.405639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.405617 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" containerName="manager" Jun 11 14:27:03.405697 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.405644 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" containerName="manager" Jun 11 14:27:03.405741 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.405705 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" containerName="manager" Jun 11 14:27:03.409118 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.409094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:03.427883 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.427840 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2"] Jun 11 14:27:03.447731 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:03.447679 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hzftg\" is forbidden: User \"system:node:ip-10-0-129-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-86.ec2.internal' and this object" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.571984 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.571950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdp5\" (UniqueName: \"kubernetes.io/projected/768b6423-0be8-4997-8f14-63d12266166f-kube-api-access-4kdp5\") pod \"limitador-operator-controller-manager-859d7b78bd-84jr2\" (UID: \"768b6423-0be8-4997-8f14-63d12266166f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:03.607881 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.607801 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.610468 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:03.610421 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hzftg\" is forbidden: User \"system:node:ip-10-0-129-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-86.ec2.internal' and this object" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.672763 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.672720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdp5\" (UniqueName: \"kubernetes.io/projected/768b6423-0be8-4997-8f14-63d12266166f-kube-api-access-4kdp5\") pod \"limitador-operator-controller-manager-859d7b78bd-84jr2\" (UID: \"768b6423-0be8-4997-8f14-63d12266166f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:03.684946 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.684909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdp5\" (UniqueName: \"kubernetes.io/projected/768b6423-0be8-4997-8f14-63d12266166f-kube-api-access-4kdp5\") pod \"limitador-operator-controller-manager-859d7b78bd-84jr2\" (UID: \"768b6423-0be8-4997-8f14-63d12266166f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:03.741723 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.741686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:03.773487 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.773458 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm6pv\" (UniqueName: \"kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv\") pod \"8981cabe-c288-4ce4-8421-96ce947c94db\" (UID: \"8981cabe-c288-4ce4-8421-96ce947c94db\") " Jun 11 14:27:03.775499 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.775467 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv" (OuterVolumeSpecName: "kube-api-access-sm6pv") pod "8981cabe-c288-4ce4-8421-96ce947c94db" (UID: "8981cabe-c288-4ce4-8421-96ce947c94db"). InnerVolumeSpecName "kube-api-access-sm6pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:27:03.817814 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.817778 2574 generic.go:356] "Generic (PLEG): container finished" podID="8981cabe-c288-4ce4-8421-96ce947c94db" containerID="921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1" exitCode=0 Jun 11 14:27:03.817972 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.817828 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.817972 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.817895 2574 scope.go:117] "RemoveContainer" containerID="921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1" Jun 11 14:27:03.820780 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:03.820747 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hzftg\" is forbidden: User \"system:node:ip-10-0-129-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-86.ec2.internal' and this object" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.828102 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.828081 2574 scope.go:117] "RemoveContainer" containerID="921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1" Jun 11 14:27:03.828441 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:03.828413 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1\": container with ID starting with 921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1 not found: ID does not exist" containerID="921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1" Jun 11 14:27:03.828534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.828450 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1"} err="failed to get container status \"921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1\": rpc error: code = NotFound desc = could not find container \"921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1\": container with ID starting with 921a0aaf8d5966976f3a8aa80ddc3e97ae722c65240a0e48874306c19f06c3f1 not found: ID does not exist" Jun 11 14:27:03.829966 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:03.829910 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hzftg\" is forbidden: User \"system:node:ip-10-0-129-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-86.ec2.internal' and this object" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:03.875049 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.874975 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm6pv\" (UniqueName: \"kubernetes.io/projected/8981cabe-c288-4ce4-8421-96ce947c94db-kube-api-access-sm6pv\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:03.885491 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:03.885463 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2"] Jun 11 14:27:03.887457 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:27:03.887429 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768b6423_0be8_4997_8f14_63d12266166f.slice/crio-c5e0a6827f3bbbe84ba0a6fd1075446460919bc02e7ab71ea32ba80a2f07d9b9 WatchSource:0}: Error finding container c5e0a6827f3bbbe84ba0a6fd1075446460919bc02e7ab71ea32ba80a2f07d9b9: Status 404 returned error can't find the container with id c5e0a6827f3bbbe84ba0a6fd1075446460919bc02e7ab71ea32ba80a2f07d9b9 Jun 11 14:27:04.826119 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:04.826086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" event={"ID":"768b6423-0be8-4997-8f14-63d12266166f","Type":"ContainerStarted","Data":"cb582934e5553985284476870845904afbf14d0e25d22f7a40abc8f4aed559bf"} Jun 11 14:27:04.826532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:04.826139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" event={"ID":"768b6423-0be8-4997-8f14-63d12266166f","Type":"ContainerStarted","Data":"c5e0a6827f3bbbe84ba0a6fd1075446460919bc02e7ab71ea32ba80a2f07d9b9"} Jun 11 14:27:04.826532 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:04.826178 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:04.828569 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:04.828542 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hzftg\" is forbidden: User \"system:node:ip-10-0-129-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-86.ec2.internal' and this object" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzftg" Jun 11 14:27:04.848123 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:04.848067 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" podStartSLOduration=1.848050879 podStartE2EDuration="1.848050879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:04.845811194 +0000 UTC m=+603.947392325" watchObservedRunningTime="2026-06-11 14:27:04.848050879 +0000 UTC m=+603.949632008" Jun 11 14:27:05.301333 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:05.301300 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8981cabe-c288-4ce4-8421-96ce947c94db" path="/var/lib/kubelet/pods/8981cabe-c288-4ce4-8421-96ce947c94db/volumes" Jun 11 14:27:06.754605 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:06.754557 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6654688866-62qx5" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerName="console" containerID="cri-o://8aed11e29fbc8f287b41922b810c0832523f379c6c3a2766f0250ca955bfe3e5" gracePeriod=15 Jun 11 14:27:15.835923 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:15.835887 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-84jr2" Jun 11 14:27:16.456937 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:16.456887 2574 patch_prober.go:28] interesting pod/console-6654688866-62qx5 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 11 14:27:16.457149 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:16.456970 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6654688866-62qx5" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 11 14:27:19.933537 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:19.933498 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerID="8aed11e29fbc8f287b41922b810c0832523f379c6c3a2766f0250ca955bfe3e5" exitCode=0 Jun 11 14:27:19.933965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:19.933570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6654688866-62qx5" event={"ID":"4f32747d-644b-4c82-898f-a4b92ba9066a","Type":"ContainerDied","Data":"8aed11e29fbc8f287b41922b810c0832523f379c6c3a2766f0250ca955bfe3e5"} Jun 11 14:27:20.029908 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.029887 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:27:20.135497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135399 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135450 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135497 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135476 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135505 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135583 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135656 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135683 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt9pp\" (UniqueName: \"kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp\") pod \"4f32747d-644b-4c82-898f-a4b92ba9066a\" (UID: \"4f32747d-644b-4c82-898f-a4b92ba9066a\") " Jun 11 14:27:20.135988 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135837 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:27:20.135988 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135889 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:27:20.136084 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.135978 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:27:20.136084 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.136021 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config" (OuterVolumeSpecName: "console-config") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:27:20.136084 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.136032 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-service-ca\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.137731 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.137700 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp" (OuterVolumeSpecName: "kube-api-access-nt9pp") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "kube-api-access-nt9pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:27:20.137832 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.137726 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:27:20.137832 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.137760 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f32747d-644b-4c82-898f-a4b92ba9066a" (UID: "4f32747d-644b-4c82-898f-a4b92ba9066a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:27:20.237301 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237259 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.237301 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237302 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-trusted-ca-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.237506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237316 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-oauth-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.237506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237332 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f32747d-644b-4c82-898f-a4b92ba9066a-console-oauth-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.237506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237346 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f32747d-644b-4c82-898f-a4b92ba9066a-console-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.237506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.237356 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt9pp\" (UniqueName: \"kubernetes.io/projected/4f32747d-644b-4c82-898f-a4b92ba9066a-kube-api-access-nt9pp\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:20.940504 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.940476 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6654688866-62qx5" Jun 11 14:27:20.940934 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.940512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6654688866-62qx5" event={"ID":"4f32747d-644b-4c82-898f-a4b92ba9066a","Type":"ContainerDied","Data":"c94db2d4cb01e757fc1d187b3721f2b020405b1cb61f3e5547296117385b5447"} Jun 11 14:27:20.940934 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.940576 2574 scope.go:117] "RemoveContainer" containerID="8aed11e29fbc8f287b41922b810c0832523f379c6c3a2766f0250ca955bfe3e5" Jun 11 14:27:20.942105 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.942083 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" event={"ID":"58735ce9-4628-4bbc-92c9-78834e360966","Type":"ContainerStarted","Data":"842ccfbef23ad448b270ce68d077d18f5aae7fb3180c3f8a5a969fb71b01b276"} Jun 11 14:27:20.964030 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.963978 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h4crf" podStartSLOduration=2.76948641 podStartE2EDuration="28.963962414s" totalImagesPullingTime="26.194476004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:20.962279167 +0000 UTC m=+620.063860299" watchObservedRunningTime="2026-06-11 14:27:20.963962414 +0000 UTC m=+620.065543543" Jun 11 14:27:20.985658 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.985364 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:27:20.988283 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:20.988254 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6654688866-62qx5"] Jun 11 14:27:21.300893 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:21.300847 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" path="/var/lib/kubelet/pods/4f32747d-644b-4c82-898f-a4b92ba9066a/volumes" Jun 11 14:27:31.799218 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.799180 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j"] Jun 11 14:27:31.799801 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.799753 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerName="console" Jun 11 14:27:31.799801 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.799775 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerName="console" Jun 11 14:27:31.799923 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.799881 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f32747d-644b-4c82-898f-a4b92ba9066a" containerName="console" Jun 11 14:27:31.802298 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.802274 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.804964 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.804944 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-98kb7\"" Jun 11 14:27:31.815265 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.815201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j"] Jun 11 14:27:31.840480 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840480 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7kh\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-kube-api-access-fs7kh\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383c1887-0d07-4ec6-b437-9e3146b49645-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.840733 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383c1887-0d07-4ec6-b437-9e3146b49645-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.841043 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.840754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942130 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942130 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7kh\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-kube-api-access-fs7kh\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383c1887-0d07-4ec6-b437-9e3146b49645-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383c1887-0d07-4ec6-b437-9e3146b49645-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942470 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.942817 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.942782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.943149 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.943130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/383c1887-0d07-4ec6-b437-9e3146b49645-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.944643 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.944620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/383c1887-0d07-4ec6-b437-9e3146b49645-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.944781 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.944761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/383c1887-0d07-4ec6-b437-9e3146b49645-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.950266 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.950242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:31.950579 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:31.950558 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7kh\" (UniqueName: \"kubernetes.io/projected/383c1887-0d07-4ec6-b437-9e3146b49645-kube-api-access-fs7kh\") pod \"maas-default-gateway-openshift-default-687ff6996-86t5j\" (UID: \"383c1887-0d07-4ec6-b437-9e3146b49645\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:32.115249 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:32.115135 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:32.257179 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:32.257152 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j"] Jun 11 14:27:32.258781 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:27:32.258746 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383c1887_0d07_4ec6_b437_9e3146b49645.slice/crio-151d5177f85c301fd09e111b426dafc12696922e14e87fd3414b50a807257b08 WatchSource:0}: Error finding container 151d5177f85c301fd09e111b426dafc12696922e14e87fd3414b50a807257b08: Status 404 returned error can't find the container with id 151d5177f85c301fd09e111b426dafc12696922e14e87fd3414b50a807257b08 Jun 11 14:27:32.260961 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:32.260925 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:27:32.261069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:32.261006 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:27:32.261069 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:32.261051 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:27:33.015706 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:33.015669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" event={"ID":"383c1887-0d07-4ec6-b437-9e3146b49645","Type":"ContainerStarted","Data":"dddd417c151415cb4c74afeb39f0ac6d4d02e2b208fcc0c5c8d60c3eedeeeec7"} Jun 11 14:27:33.016168 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:33.015749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" event={"ID":"383c1887-0d07-4ec6-b437-9e3146b49645","Type":"ContainerStarted","Data":"151d5177f85c301fd09e111b426dafc12696922e14e87fd3414b50a807257b08"} Jun 11 14:27:33.041073 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:33.041020 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" podStartSLOduration=2.041002075 podStartE2EDuration="2.041002075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:33.03797185 +0000 UTC m=+632.139553006" watchObservedRunningTime="2026-06-11 14:27:33.041002075 +0000 UTC m=+632.142583204" Jun 11 14:27:33.116232 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:33.116171 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:33.121039 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:33.121011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:34.021354 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.021322 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:34.022640 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.022615 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:27:34.795338 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.795307 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:34.812919 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.812889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:34.816679 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.816653 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7c5n\"" Jun 11 14:27:34.823659 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.823634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:34.872620 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.872584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjnv\" (UniqueName: \"kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv\") pod \"authorino-58cd955675-nqgzf\" (UID: \"00b3daa5-36ac-4770-b632-f3af3adb8519\") " pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:34.973965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.973907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjnv\" (UniqueName: \"kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv\") pod \"authorino-58cd955675-nqgzf\" (UID: \"00b3daa5-36ac-4770-b632-f3af3adb8519\") " pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:34.982604 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:34.982575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjnv\" (UniqueName: \"kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv\") pod \"authorino-58cd955675-nqgzf\" (UID: \"00b3daa5-36ac-4770-b632-f3af3adb8519\") " pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:35.124032 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:35.123939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:35.258066 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:35.258041 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:35.260093 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:27:35.260063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00b3daa5_36ac_4770_b632_f3af3adb8519.slice/crio-687e413438c044388adb07082a9b0e81e00288931333f342a95a80bce0e9b301 WatchSource:0}: Error finding container 687e413438c044388adb07082a9b0e81e00288931333f342a95a80bce0e9b301: Status 404 returned error can't find the container with id 687e413438c044388adb07082a9b0e81e00288931333f342a95a80bce0e9b301 Jun 11 14:27:36.034176 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:36.034136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nqgzf" event={"ID":"00b3daa5-36ac-4770-b632-f3af3adb8519","Type":"ContainerStarted","Data":"687e413438c044388adb07082a9b0e81e00288931333f342a95a80bce0e9b301"} Jun 11 14:27:39.053969 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:39.053924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nqgzf" event={"ID":"00b3daa5-36ac-4770-b632-f3af3adb8519","Type":"ContainerStarted","Data":"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684"} Jun 11 14:27:39.071144 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:39.071063 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-nqgzf" podStartSLOduration=1.392597415 podStartE2EDuration="5.071043018s" totalImagesPullingTime="3.678445603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:39.070674474 +0000 UTC m=+638.172255598" watchObservedRunningTime="2026-06-11 14:27:39.071043018 +0000 UTC m=+638.172624153" Jun 11 14:27:39.646591 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:39.646556 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:41.064298 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:41.064256 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-nqgzf" podUID="00b3daa5-36ac-4770-b632-f3af3adb8519" containerName="authorino" containerID="cri-o://45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684" gracePeriod=30 Jun 11 14:27:41.361837 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:41.361799 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:41.437804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:41.437774 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpjnv\" (UniqueName: \"kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv\") pod \"00b3daa5-36ac-4770-b632-f3af3adb8519\" (UID: \"00b3daa5-36ac-4770-b632-f3af3adb8519\") " Jun 11 14:27:41.440156 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:41.440127 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv" (OuterVolumeSpecName: "kube-api-access-kpjnv") pod "00b3daa5-36ac-4770-b632-f3af3adb8519" (UID: "00b3daa5-36ac-4770-b632-f3af3adb8519"). InnerVolumeSpecName "kube-api-access-kpjnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:27:41.538645 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:41.538611 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpjnv\" (UniqueName: \"kubernetes.io/projected/00b3daa5-36ac-4770-b632-f3af3adb8519-kube-api-access-kpjnv\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:27:42.071295 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.071262 2574 generic.go:356] "Generic (PLEG): container finished" podID="00b3daa5-36ac-4770-b632-f3af3adb8519" containerID="45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684" exitCode=0 Jun 11 14:27:42.071715 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.071303 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nqgzf" Jun 11 14:27:42.071715 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.071347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nqgzf" event={"ID":"00b3daa5-36ac-4770-b632-f3af3adb8519","Type":"ContainerDied","Data":"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684"} Jun 11 14:27:42.071715 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.071392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nqgzf" event={"ID":"00b3daa5-36ac-4770-b632-f3af3adb8519","Type":"ContainerDied","Data":"687e413438c044388adb07082a9b0e81e00288931333f342a95a80bce0e9b301"} Jun 11 14:27:42.071715 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.071415 2574 scope.go:117] "RemoveContainer" containerID="45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684" Jun 11 14:27:42.081389 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.081365 2574 scope.go:117] "RemoveContainer" containerID="45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684" Jun 11 14:27:42.081664 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:27:42.081646 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684\": container with ID starting with 45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684 not found: ID does not exist" containerID="45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684" Jun 11 14:27:42.081723 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.081671 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684"} err="failed to get container status \"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684\": rpc error: code = NotFound desc = could not find container \"45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684\": container with ID starting with 45b05eae527329bdc9f1a8cafbc7a2080d11377f9aa83df3a7754964fc2d0684 not found: ID does not exist" Jun 11 14:27:42.093262 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.093230 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:42.099510 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:42.099485 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-nqgzf"] Jun 11 14:27:43.300782 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:27:43.300748 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b3daa5-36ac-4770-b632-f3af3adb8519" path="/var/lib/kubelet/pods/00b3daa5-36ac-4770-b632-f3af3adb8519/volumes" Jun 11 14:28:07.170683 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.170648 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh"] Jun 11 14:28:07.171138 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.171031 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b3daa5-36ac-4770-b632-f3af3adb8519" containerName="authorino" Jun 11 14:28:07.171138 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.171043 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b3daa5-36ac-4770-b632-f3af3adb8519" containerName="authorino" Jun 11 14:28:07.171138 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.171104 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b3daa5-36ac-4770-b632-f3af3adb8519" containerName="authorino" Jun 11 14:28:07.174177 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.174159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.178288 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.178264 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:28:07.178452 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.178432 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-667lk\"" Jun 11 14:28:07.179421 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.179401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:28:07.186823 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.186794 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh"] Jun 11 14:28:07.283854 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.283807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.284031 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.283889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p2sm\" (UniqueName: \"kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.284031 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.283940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.384505 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.384467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.384505 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.384509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p2sm\" (UniqueName: \"kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.384723 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.384549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.384965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.384945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.385003 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.384943 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.397485 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.397453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p2sm\" (UniqueName: \"kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.483487 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.483386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:07.634500 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:07.634465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh"] Jun 11 14:28:07.634642 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:28:07.634515 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e774226_9111_4e10_a18a_a0fc1e0c70e7.slice/crio-0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2 WatchSource:0}: Error finding container 0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2: Status 404 returned error can't find the container with id 0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2 Jun 11 14:28:08.218222 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:08.218170 2574 generic.go:356] "Generic (PLEG): container finished" podID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerID="7364a051a393955bec74217115dc76adf225460b5af285f3357f9718c47fd709" exitCode=0 Jun 11 14:28:08.218652 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:08.218256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" event={"ID":"0e774226-9111-4e10-a18a-a0fc1e0c70e7","Type":"ContainerDied","Data":"7364a051a393955bec74217115dc76adf225460b5af285f3357f9718c47fd709"} Jun 11 14:28:08.218652 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:08.218310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" event={"ID":"0e774226-9111-4e10-a18a-a0fc1e0c70e7","Type":"ContainerStarted","Data":"0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2"} Jun 11 14:28:08.219282 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:08.219267 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:28:09.225566 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:09.225476 2574 generic.go:356] "Generic (PLEG): container finished" podID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerID="1a91e3b5e42d838ea6a3fa8a132283240ad32ad8a4ff6bf52cc10c8c816feafb" exitCode=0 Jun 11 14:28:09.225566 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:09.225528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" event={"ID":"0e774226-9111-4e10-a18a-a0fc1e0c70e7","Type":"ContainerDied","Data":"1a91e3b5e42d838ea6a3fa8a132283240ad32ad8a4ff6bf52cc10c8c816feafb"} Jun 11 14:28:10.233216 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:10.233169 2574 generic.go:356] "Generic (PLEG): container finished" podID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerID="aefcd92db3afff512e26b10e70a28e631bed3988af1e61f0113304cc1c0f493b" exitCode=0 Jun 11 14:28:10.233610 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:10.233239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" event={"ID":"0e774226-9111-4e10-a18a-a0fc1e0c70e7","Type":"ContainerDied","Data":"aefcd92db3afff512e26b10e70a28e631bed3988af1e61f0113304cc1c0f493b"} Jun 11 14:28:11.422332 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.422296 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:11.523884 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.523794 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util\") pod \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " Jun 11 14:28:11.524113 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.523916 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle\") pod \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " Jun 11 14:28:11.524113 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.523978 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p2sm\" (UniqueName: \"kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm\") pod \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\" (UID: \"0e774226-9111-4e10-a18a-a0fc1e0c70e7\") " Jun 11 14:28:11.524606 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.524526 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle" (OuterVolumeSpecName: "bundle") pod "0e774226-9111-4e10-a18a-a0fc1e0c70e7" (UID: "0e774226-9111-4e10-a18a-a0fc1e0c70e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:28:11.526474 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.526443 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm" (OuterVolumeSpecName: "kube-api-access-2p2sm") pod "0e774226-9111-4e10-a18a-a0fc1e0c70e7" (UID: "0e774226-9111-4e10-a18a-a0fc1e0c70e7"). InnerVolumeSpecName "kube-api-access-2p2sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:28:11.531454 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.531421 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util" (OuterVolumeSpecName: "util") pod "0e774226-9111-4e10-a18a-a0fc1e0c70e7" (UID: "0e774226-9111-4e10-a18a-a0fc1e0c70e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:28:11.625230 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.625175 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-bundle\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:28:11.625403 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.625241 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p2sm\" (UniqueName: \"kubernetes.io/projected/0e774226-9111-4e10-a18a-a0fc1e0c70e7-kube-api-access-2p2sm\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:28:11.625403 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:11.625257 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e774226-9111-4e10-a18a-a0fc1e0c70e7-util\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:28:12.246698 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:12.246672 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" Jun 11 14:28:12.246901 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:12.246667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748m2nhh" event={"ID":"0e774226-9111-4e10-a18a-a0fc1e0c70e7","Type":"ContainerDied","Data":"0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2"} Jun 11 14:28:12.246901 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:12.246829 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b92b6ede9c2988a0efe513bf8891b32a95748432befce39ea9ce08a1afb3ff2" Jun 11 14:28:33.966115 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966078 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966494 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="util" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966506 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="util" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966529 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="extract" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966537 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="extract" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966550 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="pull" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966556 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="pull" Jun 11 14:28:33.966629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.966628 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e774226-9111-4e10-a18a-a0fc1e0c70e7" containerName="extract" Jun 11 14:28:33.968786 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.968769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:33.971489 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.971466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:28:33.972730 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.972703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:28:33.972853 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.972754 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gxnq6\"" Jun 11 14:28:33.972853 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.972754 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 14:28:33.982708 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:33.982682 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:28:34.142430 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:34.142391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pq9\" (UniqueName: \"kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9\") pod \"maas-keycloak-0\" (UID: \"c5940661-1d5c-421a-bcdb-567e6047031d\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:34.243196 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:34.243100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pq9\" (UniqueName: \"kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9\") pod \"maas-keycloak-0\" (UID: \"c5940661-1d5c-421a-bcdb-567e6047031d\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:34.252335 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:34.252298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pq9\" (UniqueName: \"kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9\") pod \"maas-keycloak-0\" (UID: \"c5940661-1d5c-421a-bcdb-567e6047031d\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:34.278196 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:34.278162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:34.419756 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:34.419720 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:28:34.421246 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:28:34.421200 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5940661_1d5c_421a_bcdb_567e6047031d.slice/crio-5ff8eecc7d402b1d20ea37bf656b45bd781c794e744292cb7a2d44f14b52ea57 WatchSource:0}: Error finding container 5ff8eecc7d402b1d20ea37bf656b45bd781c794e744292cb7a2d44f14b52ea57: Status 404 returned error can't find the container with id 5ff8eecc7d402b1d20ea37bf656b45bd781c794e744292cb7a2d44f14b52ea57 Jun 11 14:28:35.379272 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:35.379234 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c5940661-1d5c-421a-bcdb-567e6047031d","Type":"ContainerStarted","Data":"5ff8eecc7d402b1d20ea37bf656b45bd781c794e744292cb7a2d44f14b52ea57"} Jun 11 14:28:40.410415 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:40.410374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c5940661-1d5c-421a-bcdb-567e6047031d","Type":"ContainerStarted","Data":"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986"} Jun 11 14:28:40.432786 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:40.432715 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.44544183 podStartE2EDuration="7.432695482s" totalImagesPullingTime="4.987253652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:40.429504239 +0000 UTC m=+699.531085370" watchObservedRunningTime="2026-06-11 14:28:40.432695482 +0000 UTC m=+699.534276614" Jun 11 14:28:41.278742 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:41.278696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:41.280875 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:41.280819 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:42.278768 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:42.278724 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:43.279111 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:43.279052 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:44.278861 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:44.278812 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:44.279236 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:44.279170 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:45.278856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:45.278807 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:46.279027 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:46.278968 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:47.279663 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:47.279600 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:48.279548 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:48.279493 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:49.278912 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:49.278862 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:50.278940 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:50.278883 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:51.279709 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:51.279605 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:52.278572 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:52.278531 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 11 14:28:53.389157 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:53.389108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 14:28:53.406759 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:28:53.406705 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:29:03.395366 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:03.395329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:29:04.931839 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:04.931802 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:29:04.940035 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:04.940006 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:29:04.942604 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:04.942580 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7c5n\"" Jun 11 14:29:04.943305 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:04.943282 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:29:05.058719 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.058678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c7qr\" (UniqueName: \"kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr\") pod \"authorino-65cb976fc5-59dw4\" (UID: \"ffa1440e-b597-471f-9fb4-3686d7824d7b\") " pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:29:05.160270 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.160202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c7qr\" (UniqueName: \"kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr\") pod \"authorino-65cb976fc5-59dw4\" (UID: \"ffa1440e-b597-471f-9fb4-3686d7824d7b\") " pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:29:05.169615 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.169580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c7qr\" (UniqueName: \"kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr\") pod \"authorino-65cb976fc5-59dw4\" (UID: \"ffa1440e-b597-471f-9fb4-3686d7824d7b\") " pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:29:05.250428 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.250342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:29:05.391750 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.391717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:29:05.393009 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:29:05.392984 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa1440e_b597_471f_9fb4_3686d7824d7b.slice/crio-dfef3fd4d5f6f2c0272b52d7f688b33aefd9dc308c5eccc2284cf0d8f3d9df65 WatchSource:0}: Error finding container dfef3fd4d5f6f2c0272b52d7f688b33aefd9dc308c5eccc2284cf0d8f3d9df65: Status 404 returned error can't find the container with id dfef3fd4d5f6f2c0272b52d7f688b33aefd9dc308c5eccc2284cf0d8f3d9df65 Jun 11 14:29:05.599774 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:05.599736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb976fc5-59dw4" event={"ID":"ffa1440e-b597-471f-9fb4-3686d7824d7b","Type":"ContainerStarted","Data":"dfef3fd4d5f6f2c0272b52d7f688b33aefd9dc308c5eccc2284cf0d8f3d9df65"} Jun 11 14:29:06.606988 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:06.606948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb976fc5-59dw4" event={"ID":"ffa1440e-b597-471f-9fb4-3686d7824d7b","Type":"ContainerStarted","Data":"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7"} Jun 11 14:29:06.623107 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:06.623028 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65cb976fc5-59dw4" podStartSLOduration=2.318347275 podStartE2EDuration="2.623014362s" totalImagesPullingTime="304.667087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:06.62278264 +0000 UTC m=+725.724363771" watchObservedRunningTime="2026-06-11 14:29:06.623014362 +0000 UTC m=+725.724595492" Jun 11 14:29:10.541483 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.541444 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9b94fc9cf-m9n9k"] Jun 11 14:29:10.543913 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.543891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.546862 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.546840 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 14:29:10.547007 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.546860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 14:29:10.547007 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.546927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bxmwr\"" Jun 11 14:29:10.553556 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.553530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b94fc9cf-m9n9k"] Jun 11 14:29:10.617743 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.617704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttktw\" (UniqueName: \"kubernetes.io/projected/ad8cedaa-d879-493e-93fc-d21def42f09d-kube-api-access-ttktw\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.617743 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.617749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8cedaa-d879-493e-93fc-d21def42f09d-webhook-cert\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.718976 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.718941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttktw\" (UniqueName: \"kubernetes.io/projected/ad8cedaa-d879-493e-93fc-d21def42f09d-kube-api-access-ttktw\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.719143 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.718982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8cedaa-d879-493e-93fc-d21def42f09d-webhook-cert\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.721534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.721501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8cedaa-d879-493e-93fc-d21def42f09d-webhook-cert\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.728994 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.728955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttktw\" (UniqueName: \"kubernetes.io/projected/ad8cedaa-d879-493e-93fc-d21def42f09d-kube-api-access-ttktw\") pod \"maas-controller-9b94fc9cf-m9n9k\" (UID: \"ad8cedaa-d879-493e-93fc-d21def42f09d\") " pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.857010 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.856898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:10.993420 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:10.993392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9b94fc9cf-m9n9k"] Jun 11 14:29:10.995255 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:29:10.995226 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8cedaa_d879_493e_93fc_d21def42f09d.slice/crio-ae8b7e09517f26a02375b59649d6166d3b95210cb08782c44e5c72d7f93fa8fc WatchSource:0}: Error finding container ae8b7e09517f26a02375b59649d6166d3b95210cb08782c44e5c72d7f93fa8fc: Status 404 returned error can't find the container with id ae8b7e09517f26a02375b59649d6166d3b95210cb08782c44e5c72d7f93fa8fc Jun 11 14:29:11.645559 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:11.645513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" event={"ID":"ad8cedaa-d879-493e-93fc-d21def42f09d","Type":"ContainerStarted","Data":"ae8b7e09517f26a02375b59649d6166d3b95210cb08782c44e5c72d7f93fa8fc"} Jun 11 14:29:13.660411 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:13.660374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" event={"ID":"ad8cedaa-d879-493e-93fc-d21def42f09d","Type":"ContainerStarted","Data":"9cbfd4e5d13f32431334805a9209f39bc56cbfba0016852445c9432716cfbf33"} Jun 11 14:29:13.660806 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:13.660437 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:13.683138 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:13.683065 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" podStartSLOduration=1.12735747 podStartE2EDuration="3.683041486s" totalImagesPullingTime="2.555684016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:13.680131922 +0000 UTC m=+732.781713049" watchObservedRunningTime="2026-06-11 14:29:13.683041486 +0000 UTC m=+732.784622616" Jun 11 14:29:24.670933 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:24.670901 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9b94fc9cf-m9n9k" Jun 11 14:29:53.904430 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.904397 2574 generic.go:356] "Generic (PLEG): container finished" podID="383c1887-0d07-4ec6-b437-9e3146b49645" containerID="dddd417c151415cb4c74afeb39f0ac6d4d02e2b208fcc0c5c8d60c3eedeeeec7" exitCode=0 Jun 11 14:29:53.904875 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.904469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" event={"ID":"383c1887-0d07-4ec6-b437-9e3146b49645","Type":"ContainerDied","Data":"dddd417c151415cb4c74afeb39f0ac6d4d02e2b208fcc0c5c8d60c3eedeeeec7"} Jun 11 14:29:53.904875 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.904852 2574 scope.go:117] "RemoveContainer" containerID="dddd417c151415cb4c74afeb39f0ac6d4d02e2b208fcc0c5c8d60c3eedeeeec7" Jun 11 14:29:53.905826 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.905796 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:29:53.905923 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.905865 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:29:53.905923 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:53.905900 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 14:29:54.912410 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:54.912367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" event={"ID":"383c1887-0d07-4ec6-b437-9e3146b49645","Type":"ContainerStarted","Data":"a80993553d3d7792e8909d79918be81469a5a5123171deb78dbf20d0ef3b7114"} Jun 11 14:29:55.115567 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:55.115505 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:29:55.115747 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:55.115723 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-86t5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jun 11 14:29:55.115793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:55.115772 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" podUID="383c1887-0d07-4ec6-b437-9e3146b49645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jun 11 14:29:56.116422 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:56.116384 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-86t5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jun 11 14:29:56.116824 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:56.116457 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" podUID="383c1887-0d07-4ec6-b437-9e3146b49645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jun 11 14:29:57.116537 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:57.116490 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-86t5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jun 11 14:29:57.117023 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:57.116557 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" podUID="383c1887-0d07-4ec6-b437-9e3146b49645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jun 11 14:29:58.115558 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:58.115517 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-86t5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jun 11 14:29:58.115737 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:58.115572 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" podUID="383c1887-0d07-4ec6-b437-9e3146b49645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jun 11 14:29:59.119531 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:59.119502 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:29:59.119911 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:59.119783 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:29:59.120472 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:29:59.120452 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-86t5j" Jun 11 14:31:59.467644 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:31:59.467553 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:31:59.468165 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:31:59.467750 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" containerID="cri-o://03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986" gracePeriod=30 Jun 11 14:32:01.130528 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.130461 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.216751 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.216719 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9pq9\" (UniqueName: \"kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9\") pod \"c5940661-1d5c-421a-bcdb-567e6047031d\" (UID: \"c5940661-1d5c-421a-bcdb-567e6047031d\") " Jun 11 14:32:01.218876 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.218850 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9" (OuterVolumeSpecName: "kube-api-access-h9pq9") pod "c5940661-1d5c-421a-bcdb-567e6047031d" (UID: "c5940661-1d5c-421a-bcdb-567e6047031d"). InnerVolumeSpecName "kube-api-access-h9pq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:32:01.319033 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.318993 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9pq9\" (UniqueName: \"kubernetes.io/projected/c5940661-1d5c-421a-bcdb-567e6047031d-kube-api-access-h9pq9\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:32:01.345809 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.345779 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:32:01.350224 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.350187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6b2c6_b024e4d2-3c81-4ba3-986c-cbfe81bf883e/ovn-acl-logging/0.log" Jun 11 14:32:01.656130 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.656088 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5940661-1d5c-421a-bcdb-567e6047031d" containerID="03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986" exitCode=143 Jun 11 14:32:01.656337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.656145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c5940661-1d5c-421a-bcdb-567e6047031d","Type":"ContainerDied","Data":"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986"} Jun 11 14:32:01.656337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.656158 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.656337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.656250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c5940661-1d5c-421a-bcdb-567e6047031d","Type":"ContainerDied","Data":"5ff8eecc7d402b1d20ea37bf656b45bd781c794e744292cb7a2d44f14b52ea57"} Jun 11 14:32:01.656337 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.656281 2574 scope.go:117] "RemoveContainer" containerID="03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986" Jun 11 14:32:01.666804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.666778 2574 scope.go:117] "RemoveContainer" containerID="03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986" Jun 11 14:32:01.667151 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:32:01.667129 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986\": container with ID starting with 03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986 not found: ID does not exist" containerID="03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986" Jun 11 14:32:01.667200 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.667160 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986"} err="failed to get container status \"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986\": rpc error: code = NotFound desc = could not find container \"03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986\": container with ID starting with 03162912e0b8135b922fa5ba57f334d9e36d8a534a09aaeeb25e687d48af4986 not found: ID does not exist" Jun 11 14:32:01.682924 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.682892 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:32:01.690283 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.690255 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:32:01.742413 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.742372 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:32:01.742756 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.742743 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" Jun 11 14:32:01.742806 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.742758 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" Jun 11 14:32:01.742846 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.742834 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" containerName="keycloak" Jun 11 14:32:01.747250 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.747200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.750096 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.750001 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 14:32:01.750323 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.750267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:32:01.750506 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.750486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-gxnq6\"" Jun 11 14:32:01.750657 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.750575 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:32:01.750744 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.750699 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 14:32:01.752478 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.752457 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:32:01.823867 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.823825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bl8\" (UniqueName: \"kubernetes.io/projected/2c861dfd-97b9-49b0-af65-e4b39beddb04-kube-api-access-74bl8\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.824059 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.823939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2c861dfd-97b9-49b0-af65-e4b39beddb04-test-realms\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.925029 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.924924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bl8\" (UniqueName: \"kubernetes.io/projected/2c861dfd-97b9-49b0-af65-e4b39beddb04-kube-api-access-74bl8\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.925029 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.925008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2c861dfd-97b9-49b0-af65-e4b39beddb04-test-realms\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.925740 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.925719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2c861dfd-97b9-49b0-af65-e4b39beddb04-test-realms\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:01.934649 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:01.934622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bl8\" (UniqueName: \"kubernetes.io/projected/2c861dfd-97b9-49b0-af65-e4b39beddb04-kube-api-access-74bl8\") pod \"maas-keycloak-0\" (UID: \"2c861dfd-97b9-49b0-af65-e4b39beddb04\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:02.059844 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:02.059801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:02.209133 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:02.209105 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:32:02.209499 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:32:02.209428 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c861dfd_97b9_49b0_af65_e4b39beddb04.slice/crio-6e0d59f0107576847530e6960deb24d771e435881bd4b8f2eb0d92b8bd1cb027 WatchSource:0}: Error finding container 6e0d59f0107576847530e6960deb24d771e435881bd4b8f2eb0d92b8bd1cb027: Status 404 returned error can't find the container with id 6e0d59f0107576847530e6960deb24d771e435881bd4b8f2eb0d92b8bd1cb027 Jun 11 14:32:02.664474 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:02.664445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2c861dfd-97b9-49b0-af65-e4b39beddb04","Type":"ContainerStarted","Data":"6e0d59f0107576847530e6960deb24d771e435881bd4b8f2eb0d92b8bd1cb027"} Jun 11 14:32:03.303169 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:03.303127 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5940661-1d5c-421a-bcdb-567e6047031d" path="/var/lib/kubelet/pods/c5940661-1d5c-421a-bcdb-567e6047031d/volumes" Jun 11 14:32:03.674409 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:03.674312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2c861dfd-97b9-49b0-af65-e4b39beddb04","Type":"ContainerStarted","Data":"ab8efc1af0f6c64257e0fc293860aa94642a275131255a2fd911901eef9731de"} Jun 11 14:32:03.696956 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:03.696886 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.258552923 podStartE2EDuration="2.696862285s" totalImagesPullingTime="438.309362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:03.695950007 +0000 UTC m=+902.797531138" watchObservedRunningTime="2026-06-11 14:32:03.696862285 +0000 UTC m=+902.798443416" Jun 11 14:32:04.060449 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:04.060399 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:04.062434 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:04.062389 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:05.061041 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:05.060990 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:06.060630 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:06.060569 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:07.060328 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:07.060272 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:08.060639 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:08.060587 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:09.060758 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:09.060708 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:10.060536 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:10.060472 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:11.060453 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:11.060400 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:12.060909 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:12.060871 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:12.061474 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:12.061293 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:13.060578 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:13.060526 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:14.061116 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:14.061065 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:15.061328 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:15.061272 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:16.060293 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:16.060248 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.50:9000/health/started\": dial tcp 10.133.0.50:9000: connect: connection refused" Jun 11 14:32:17.186427 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:17.186371 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 14:32:17.203281 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:17.203225 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:32:27.191495 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:27.191437 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2c861dfd-97b9-49b0-af65-e4b39beddb04" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:32:37.192630 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:32:37.192585 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:33:13.748598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.748549 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc"] Jun 11 14:33:13.753541 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.753513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.756498 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.756469 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 14:33:13.757660 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.757624 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 14:33:13.757775 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.757658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zl5mj\"" Jun 11 14:33:13.757775 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.757626 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 14:33:13.763636 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.763610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc"] Jun 11 14:33:13.840602 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.840776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47370a7-9241-4736-aff0-30e003979ad5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.840776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.840776 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.840931 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98ks\" (UniqueName: \"kubernetes.io/projected/d47370a7-9241-4736-aff0-30e003979ad5-kube-api-access-q98ks\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.840931 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.840822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.941685 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.941868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q98ks\" (UniqueName: \"kubernetes.io/projected/d47370a7-9241-4736-aff0-30e003979ad5-kube-api-access-q98ks\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.941868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.941868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.941868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47370a7-9241-4736-aff0-30e003979ad5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.942067 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.941905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.942181 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.942158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.942285 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.942184 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.942285 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.942251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.944255 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.944221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d47370a7-9241-4736-aff0-30e003979ad5-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.944458 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.944441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d47370a7-9241-4736-aff0-30e003979ad5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:13.950760 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:13.950729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98ks\" (UniqueName: \"kubernetes.io/projected/d47370a7-9241-4736-aff0-30e003979ad5-kube-api-access-q98ks\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc\" (UID: \"d47370a7-9241-4736-aff0-30e003979ad5\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:14.065947 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:14.065902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:14.215933 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:14.215897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc"] Jun 11 14:33:14.217506 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:33:14.217479 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47370a7_9241_4736_aff0_30e003979ad5.slice/crio-f4e768e948325f53962a8c87462634b0e59da4f0ecbe698dfa184c81b510bc7c WatchSource:0}: Error finding container f4e768e948325f53962a8c87462634b0e59da4f0ecbe698dfa184c81b510bc7c: Status 404 returned error can't find the container with id f4e768e948325f53962a8c87462634b0e59da4f0ecbe698dfa184c81b510bc7c Jun 11 14:33:14.219417 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:14.219397 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:33:15.146711 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:15.146677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" event={"ID":"d47370a7-9241-4736-aff0-30e003979ad5","Type":"ContainerStarted","Data":"f4e768e948325f53962a8c87462634b0e59da4f0ecbe698dfa184c81b510bc7c"} Jun 11 14:33:18.169883 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:18.169846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" event={"ID":"d47370a7-9241-4736-aff0-30e003979ad5","Type":"ContainerStarted","Data":"8ce11075833e8ad6d7fb28bfb1e6f79243b240fca2de4fd89a0c783d39b90120"} Jun 11 14:33:20.189225 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:20.189168 2574 generic.go:356] "Generic (PLEG): container finished" podID="d47370a7-9241-4736-aff0-30e003979ad5" containerID="8ce11075833e8ad6d7fb28bfb1e6f79243b240fca2de4fd89a0c783d39b90120" exitCode=0 Jun 11 14:33:20.189614 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:20.189249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" event={"ID":"d47370a7-9241-4736-aff0-30e003979ad5","Type":"ContainerDied","Data":"8ce11075833e8ad6d7fb28bfb1e6f79243b240fca2de4fd89a0c783d39b90120"} Jun 11 14:33:22.204936 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:22.204900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" event={"ID":"d47370a7-9241-4736-aff0-30e003979ad5","Type":"ContainerStarted","Data":"4a55f5c8c6e45477061832d01e74604a832a9c83ff8bddbbdccc5aae1cc3e633"} Jun 11 14:33:22.226191 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:22.226138 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" podStartSLOduration=3.100076227 podStartE2EDuration="9.226121143s" totalImagesPullingTime="4.698692309s" totalInitContainerRuntime="1.427352607s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:33:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:33:22.224984206 +0000 UTC m=+981.326565334" watchObservedRunningTime="2026-06-11 14:33:22.226121143 +0000 UTC m=+981.327702274" Jun 11 14:33:24.066950 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:24.066912 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:24.067387 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:24.066980 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:24.079966 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:24.079934 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:33:24.227167 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:33:24.227142 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc" Jun 11 14:34:49.698396 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:49.698361 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:34:49.698951 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:49.698528 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65cb976fc5-59dw4" podUID="ffa1440e-b597-471f-9fb4-3686d7824d7b" containerName="authorino" containerID="cri-o://4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7" gracePeriod=30 Jun 11 14:34:49.978772 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:49.978746 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:34:50.068367 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.068330 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c7qr\" (UniqueName: \"kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr\") pod \"ffa1440e-b597-471f-9fb4-3686d7824d7b\" (UID: \"ffa1440e-b597-471f-9fb4-3686d7824d7b\") " Jun 11 14:34:50.070407 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.070378 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr" (OuterVolumeSpecName: "kube-api-access-6c7qr") pod "ffa1440e-b597-471f-9fb4-3686d7824d7b" (UID: "ffa1440e-b597-471f-9fb4-3686d7824d7b"). InnerVolumeSpecName "kube-api-access-6c7qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:34:50.169975 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.169937 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c7qr\" (UniqueName: \"kubernetes.io/projected/ffa1440e-b597-471f-9fb4-3686d7824d7b-kube-api-access-6c7qr\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 11 14:34:50.710019 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.709985 2574 generic.go:356] "Generic (PLEG): container finished" podID="ffa1440e-b597-471f-9fb4-3686d7824d7b" containerID="4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7" exitCode=0 Jun 11 14:34:50.710543 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.710029 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65cb976fc5-59dw4" Jun 11 14:34:50.710543 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.710074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb976fc5-59dw4" event={"ID":"ffa1440e-b597-471f-9fb4-3686d7824d7b","Type":"ContainerDied","Data":"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7"} Jun 11 14:34:50.710543 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.710110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65cb976fc5-59dw4" event={"ID":"ffa1440e-b597-471f-9fb4-3686d7824d7b","Type":"ContainerDied","Data":"dfef3fd4d5f6f2c0272b52d7f688b33aefd9dc308c5eccc2284cf0d8f3d9df65"} Jun 11 14:34:50.710543 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.710127 2574 scope.go:117] "RemoveContainer" containerID="4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7" Jun 11 14:34:50.719965 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.719941 2574 scope.go:117] "RemoveContainer" containerID="4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7" Jun 11 14:34:50.720253 ip-10-0-129-86 kubenswrapper[2574]: E0611 14:34:50.720231 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7\": container with ID starting with 4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7 not found: ID does not exist" containerID="4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7" Jun 11 14:34:50.720344 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.720261 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7"} err="failed to get container status \"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7\": rpc error: code = NotFound desc = could not find container \"4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7\": container with ID starting with 4d32bfcfe54e74f2d94a82af46fd8ddf145f12762cfc0ceaba59e04b13af16c7 not found: ID does not exist" Jun 11 14:34:50.732012 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.731974 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:34:50.736238 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:50.736194 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65cb976fc5-59dw4"] Jun 11 14:34:51.305872 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:34:51.305835 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa1440e-b597-471f-9fb4-3686d7824d7b" path="/var/lib/kubelet/pods/ffa1440e-b597-471f-9fb4-3686d7824d7b/volumes" Jun 11 14:35:32.469447 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:32.469414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56997bdbdf-f6hd2_04185f0e-a4d6-461b-aed7-89d9b1cae84f/nginx/0.log" Jun 11 14:35:32.984491 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:32.984453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b94fc9cf-m9n9k_ad8cedaa-d879-493e-93fc-d21def42f09d/manager/0.log" Jun 11 14:35:33.508200 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:33.508170 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-c59c5_982da782-3935-4635-95ad-9460aa159630/copy-manifests/0.log" Jun 11 14:35:33.515921 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:33.515899 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-c59c5_982da782-3935-4635-95ad-9460aa159630/manager/0.log" Jun 11 14:35:34.558826 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.558796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/util/0.log" Jun 11 14:35:34.566528 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.566503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/pull/0.log" Jun 11 14:35:34.573378 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.573342 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/extract/0.log" Jun 11 14:35:34.690126 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.690095 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/util/0.log" Jun 11 14:35:34.697005 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.696978 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/pull/0.log" Jun 11 14:35:34.704015 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.703984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/extract/0.log" Jun 11 14:35:34.836571 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.836482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/util/0.log" Jun 11 14:35:34.846914 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.846890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/pull/0.log" Jun 11 14:35:34.874304 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.874276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/extract/0.log" Jun 11 14:35:34.999604 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:34.999575 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/util/0.log" Jun 11 14:35:35.011302 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:35.011264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/pull/0.log" Jun 11 14:35:35.022356 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:35.022332 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/extract/0.log" Jun 11 14:35:35.289174 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:35.289141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-thnwh_cdb37ab8-b7a0-49d8-a80e-553d60c3aff0/manager/0.log" Jun 11 14:35:35.552793 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:35.552715 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h4crf_58735ce9-4628-4bbc-92c9-78834e360966/kuadrant-console-plugin/0.log" Jun 11 14:35:35.690873 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:35.690838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6cztn_2b6e97c0-5518-414e-a385-95bf9e9e48ed/registry-server/0.log" Jun 11 14:35:36.102586 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:36.102558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-84jr2_768b6423-0be8-4997-8f14-63d12266166f/manager/0.log" Jun 11 14:35:36.550271 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:36.550238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qs6f2_63e039e2-eaf3-48d4-bea0-1bc1942ab137/istio-proxy/0.log" Jun 11 14:35:37.078507 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:37.078478 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/1.log" Jun 11 14:35:37.449959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:37.449838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b6cc4cf9-8cxgp_0425a27f-ec46-410e-8ca7-64c890d286d6/router/0.log" Jun 11 14:35:38.134399 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:38.134366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc_d47370a7-9241-4736-aff0-30e003979ad5/storage-initializer/0.log" Jun 11 14:35:38.144804 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:38.144771 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4p2jc_d47370a7-9241-4736-aff0-30e003979ad5/main/0.log" Jun 11 14:35:46.255374 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:46.255336 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-krlhg_b199705d-1cf4-4ed5-9e52-e1172189a769/global-pull-secret-syncer/0.log" Jun 11 14:35:46.460013 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:46.459986 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nckc7_4b59ab54-4cec-421d-b88f-299e804b4b0c/konnectivity-agent/0.log" Jun 11 14:35:46.480778 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:46.480753 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-86.ec2.internal_b1fb63bb1df8db54b165336d4644dafb/haproxy/0.log" Jun 11 14:35:50.968737 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:50.968704 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/extract/0.log" Jun 11 14:35:50.996543 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:50.996512 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/util/0.log" Jun 11 14:35:51.021182 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.021152 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dsfhq_1c0a578b-6014-4722-9bbf-696aba67dfc8/pull/0.log" Jun 11 14:35:51.052251 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.052218 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/extract/0.log" Jun 11 14:35:51.076437 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.076398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/util/0.log" Jun 11 14:35:51.097839 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.097810 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b72v6_908d837d-5435-4ba7-b50b-b72f124e7394/pull/0.log" Jun 11 14:35:51.134055 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.134030 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/extract/0.log" Jun 11 14:35:51.186173 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.186122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/util/0.log" Jun 11 14:35:51.211856 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.211827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb5k2_fe05a2c0-d50c-44f0-b6f9-29c701a4bd6a/pull/0.log" Jun 11 14:35:51.243242 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.243145 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/extract/0.log" Jun 11 14:35:51.268634 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.268598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/util/0.log" Jun 11 14:35:51.335914 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.335885 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k2gcs_2d3e2991-9569-4e2e-92b3-547a89cf3e9c/pull/0.log" Jun 11 14:35:51.420072 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.420040 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-thnwh_cdb37ab8-b7a0-49d8-a80e-553d60c3aff0/manager/0.log" Jun 11 14:35:51.481025 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.480996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h4crf_58735ce9-4628-4bbc-92c9-78834e360966/kuadrant-console-plugin/0.log" Jun 11 14:35:51.514754 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.514674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6cztn_2b6e97c0-5518-414e-a385-95bf9e9e48ed/registry-server/0.log" Jun 11 14:35:51.627439 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:51.627409 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-84jr2_768b6423-0be8-4997-8f14-63d12266166f/manager/0.log" Jun 11 14:35:53.315913 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.315880 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/alertmanager/0.log" Jun 11 14:35:53.344225 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.344174 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/config-reloader/0.log" Jun 11 14:35:53.380562 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.380539 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/kube-rbac-proxy-web/0.log" Jun 11 14:35:53.421631 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.421597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/kube-rbac-proxy/0.log" Jun 11 14:35:53.447986 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.447957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/kube-rbac-proxy-metric/0.log" Jun 11 14:35:53.483500 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.483464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/prom-label-proxy/0.log" Jun 11 14:35:53.515193 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.515164 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38df735e-ae9f-4330-aeb9-22ed5439802a/init-config-reloader/0.log" Jun 11 14:35:53.587957 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.587873 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-state-metrics/0.log" Jun 11 14:35:53.611868 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.611843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-rbac-proxy-main/0.log" Jun 11 14:35:53.640256 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.640203 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mkhzn_97414da9-76ba-4e47-b236-a8834023405d/kube-rbac-proxy-self/0.log" Jun 11 14:35:53.680895 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.680868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-ffb48fbf4-dqjmb_ddcae661-1229-499d-bfaf-e229fe256b01/metrics-server/0.log" Jun 11 14:35:53.852381 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.852301 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/node-exporter/0.log" Jun 11 14:35:53.902933 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.902904 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/kube-rbac-proxy/0.log" Jun 11 14:35:53.935704 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:53.935681 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfv4d_ec198a6f-6cc2-4168-9522-c9a97a52a9c2/init-textfile/0.log" Jun 11 14:35:54.564787 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:54.564759 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/telemeter-client/0.log" Jun 11 14:35:54.588710 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:54.588683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/reload/0.log" Jun 11 14:35:54.634598 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:54.634567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-854596449b-tcn9k_09fb3e58-5663-491f-a98a-dd02ebbd66e2/kube-rbac-proxy/0.log" Jun 11 14:35:56.926973 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.926937 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw"] Jun 11 14:35:56.927402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.927337 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa1440e-b597-471f-9fb4-3686d7824d7b" containerName="authorino" Jun 11 14:35:56.927402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.927349 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa1440e-b597-471f-9fb4-3686d7824d7b" containerName="authorino" Jun 11 14:35:56.927485 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.927409 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa1440e-b597-471f-9fb4-3686d7824d7b" containerName="authorino" Jun 11 14:35:56.930356 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.930337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:56.932919 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.932895 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5jsz\"/\"default-dockercfg-bvk9d\"" Jun 11 14:35:56.933244 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.933217 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jsz\"/\"openshift-service-ca.crt\"" Jun 11 14:35:56.933954 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.933933 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jsz\"/\"kube-root-ca.crt\"" Jun 11 14:35:56.941139 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.941114 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw"] Jun 11 14:35:56.999988 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:56.999949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-podres\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.000169 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.000010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472tc\" (UniqueName: \"kubernetes.io/projected/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-kube-api-access-472tc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.000169 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.000093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-sys\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.000276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.000176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-proc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.000276 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.000196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-lib-modules\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100727 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-proc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100727 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-lib-modules\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-podres\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472tc\" (UniqueName: \"kubernetes.io/projected/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-kube-api-access-472tc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-sys\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100828 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-proc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-lib-modules\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100907 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-sys\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.100959 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.100929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-podres\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.110369 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.110334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-472tc\" (UniqueName: \"kubernetes.io/projected/04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a-kube-api-access-472tc\") pod \"perf-node-gather-daemonset-mbmgw\" (UID: \"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a\") " pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.241534 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.241439 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:57.384382 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.383068 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw"] Jun 11 14:35:57.386163 ip-10-0-129-86 kubenswrapper[2574]: W0611 14:35:57.386129 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04ea9a29_4bb1_4ff5_bde8_a7eb4f126e1a.slice/crio-8366508625d7321907beb4d2de4a8142d9e77bd663788c7a722745d1e112edeb WatchSource:0}: Error finding container 8366508625d7321907beb4d2de4a8142d9e77bd663788c7a722745d1e112edeb: Status 404 returned error can't find the container with id 8366508625d7321907beb4d2de4a8142d9e77bd663788c7a722745d1e112edeb Jun 11 14:35:57.585855 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:57.585826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-87d664694-49ksd_d295d050-6027-4981-8a5d-9f2091467a43/console/0.log" Jun 11 14:35:58.098385 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:58.098346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" event={"ID":"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a","Type":"ContainerStarted","Data":"9ed8cac931be5399572ec8abd98eab0d162a3a917013479d85ddf659d304ed8d"} Jun 11 14:35:58.098782 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:58.098411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" event={"ID":"04ea9a29-4bb1-4ff5-bde8-a7eb4f126e1a","Type":"ContainerStarted","Data":"8366508625d7321907beb4d2de4a8142d9e77bd663788c7a722745d1e112edeb"} Jun 11 14:35:58.098782 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:58.098564 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:35:58.119020 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:58.118966 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" podStartSLOduration=2.118948451 podStartE2EDuration="2.118948451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:35:58.11672699 +0000 UTC m=+1137.218308134" watchObservedRunningTime="2026-06-11 14:35:58.118948451 +0000 UTC m=+1137.220529581" Jun 11 14:35:58.330550 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:58.330478 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-rsh5n_64c7fc19-3b5e-4369-8473-814dffbe2128/volume-data-source-validator/0.log" Jun 11 14:35:59.548969 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:59.548929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmznc_734fc394-a2e7-4254-8826-39aaa2b4e153/dns/0.log" Jun 11 14:35:59.572053 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:59.572026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmznc_734fc394-a2e7-4254-8826-39aaa2b4e153/kube-rbac-proxy/0.log" Jun 11 14:35:59.738885 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:35:59.738856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2kk4_609124a0-2b86-49a9-8fd6-2013db290ef1/dns-node-resolver/0.log" Jun 11 14:36:00.300384 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:00.300354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5fc7fc85-gd74h_da635b33-2f18-4f58-9b22-43927c928499/registry/0.log" Jun 11 14:36:00.306349 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:00.306328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f5fc7fc85-gd74h_da635b33-2f18-4f58-9b22-43927c928499/registry/1.log" Jun 11 14:36:00.325815 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:00.325791 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2hw4r_dc8c7c54-ce79-4beb-8cb3-3bc19e194f77/node-ca/0.log" Jun 11 14:36:01.366402 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:01.366370 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qs6f2_63e039e2-eaf3-48d4-bea0-1bc1942ab137/istio-proxy/0.log" Jun 11 14:36:01.492044 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:01.492007 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/1.log" Jun 11 14:36:01.492629 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:01.492592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/0.log" Jun 11 14:36:01.563090 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:01.563047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b6cc4cf9-8cxgp_0425a27f-ec46-410e-8ca7-64c890d286d6/router/0.log" Jun 11 14:36:02.187499 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:02.187470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dr9d_11327480-d2b8-4673-b2d2-85e6dea0157c/serve-healthcheck-canary/0.log" Jun 11 14:36:02.921123 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:02.921095 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xj2l9_09143d69-38ea-4350-b8a4-5636cd5081a4/kube-rbac-proxy/0.log" Jun 11 14:36:02.943941 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:02.943911 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xj2l9_09143d69-38ea-4350-b8a4-5636cd5081a4/exporter/0.log" Jun 11 14:36:02.968394 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:02.968362 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xj2l9_09143d69-38ea-4350-b8a4-5636cd5081a4/extractor/0.log" Jun 11 14:36:04.115145 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:04.115120 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5jsz/perf-node-gather-daemonset-mbmgw" Jun 11 14:36:05.401650 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:05.401619 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56997bdbdf-f6hd2_04185f0e-a4d6-461b-aed7-89d9b1cae84f/nginx/0.log" Jun 11 14:36:05.525366 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:05.525333 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9b94fc9cf-m9n9k_ad8cedaa-d879-493e-93fc-d21def42f09d/manager/0.log" Jun 11 14:36:05.731461 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:05.731374 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-c59c5_982da782-3935-4635-95ad-9460aa159630/manager/0.log" Jun 11 14:36:05.753731 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:05.753702 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85855677f7-c59c5_982da782-3935-4635-95ad-9460aa159630/copy-manifests/0.log" Jun 11 14:36:07.583148 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:07.583120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b69d76555-4gm5b_f0747584-32b0-42a9-9c7b-f07c69c6673b/manager/0.log" Jun 11 14:36:12.041909 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:12.041854 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qs6f2_63e039e2-eaf3-48d4-bea0-1bc1942ab137/istio-proxy/0.log" Jun 11 14:36:12.129770 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:12.129725 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/1.log" Jun 11 14:36:12.130354 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:12.130331 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/0.log" Jun 11 14:36:12.183595 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:12.183556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b6cc4cf9-8cxgp_0425a27f-ec46-410e-8ca7-64c890d286d6/router/0.log" Jun 11 14:36:13.323328 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:13.323292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qs6f2_63e039e2-eaf3-48d4-bea0-1bc1942ab137/istio-proxy/0.log" Jun 11 14:36:13.410372 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:13.410341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/1.log" Jun 11 14:36:13.411035 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:13.411016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-86t5j_383c1887-0d07-4ec6-b437-9e3146b49645/istio-proxy/0.log" Jun 11 14:36:13.455663 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:13.455610 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b6cc4cf9-8cxgp_0425a27f-ec46-410e-8ca7-64c890d286d6/router/0.log" Jun 11 14:36:14.753039 ip-10-0-129-86 kubenswrapper[2574]: I0611 14:36:14.753007 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-75zn5_6e774368-db1d-433d-8481-3fb7305b949e/kube-multus/0.log"