Jun 10 11:34:35.455189 ip-10-0-132-117 systemd[1]: Starting Kubernetes Kubelet... Jun 10 11:34:35.858640 ip-10-0-132-117 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:34:35.858640 ip-10-0-132-117 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 11:34:35.858640 ip-10-0-132-117 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:34:35.858640 ip-10-0-132-117 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 11:34:35.858640 ip-10-0-132-117 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 11:34:35.859379 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.858703 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 11:34:35.866179 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866152 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.866179 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866174 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.866179 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866179 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.866179 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866189 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866194 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866199 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866203 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866207 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866211 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866214 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866218 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866222 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866226 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866230 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866235 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866238 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866242 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866246 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866250 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866254 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866258 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866262 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.866439 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866267 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866271 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866275 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866279 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866283 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866287 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866292 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866296 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866304 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866312 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866316 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866320 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866327 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866333 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866339 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866346 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866352 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866358 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.867292 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866363 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866368 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866372 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866377 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866381 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866386 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866391 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866396 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866400 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866404 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866409 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866413 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866419 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866424 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866429 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866433 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866437 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866442 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866447 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866451 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.868083 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866456 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866460 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866466 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866470 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866475 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866479 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866484 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866488 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866493 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866498 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866502 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866507 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866511 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866516 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866520 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866524 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866529 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866534 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866540 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.869008 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866545 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866550 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866554 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866565 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866570 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866574 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866579 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866582 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866587 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866591 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866596 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866600 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866605 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866610 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866615 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866619 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866623 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866628 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.866632 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867847 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.869819 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867859 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867864 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867888 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867893 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867898 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867902 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867907 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867911 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867916 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867921 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867925 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867930 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867934 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867939 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867943 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867947 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867958 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867963 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867967 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867972 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.870691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867976 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867980 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867985 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867989 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867994 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.867999 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868004 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868012 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868018 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868024 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868028 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868034 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868038 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868044 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868050 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868055 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868060 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868068 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868074 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.871464 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868078 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868082 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868086 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868090 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868094 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868098 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868102 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868111 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868115 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868121 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868126 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868131 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868135 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868140 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868144 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868149 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868153 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868158 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868162 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.871976 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868167 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868171 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868176 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868180 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868185 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868190 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868195 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868200 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868204 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868208 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868217 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868224 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868229 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868234 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868238 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868242 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868246 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868251 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868256 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868260 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.872544 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868265 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868269 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868273 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868278 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868283 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868287 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868291 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868295 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868301 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868305 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868310 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868315 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868319 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868324 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868328 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868333 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868338 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868342 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868347 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868984 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.873316 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.868994 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869001 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869007 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869012 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869016 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869021 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869027 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869033 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869038 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869043 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869048 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869053 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869057 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869062 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869067 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869073 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869077 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869082 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869086 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869091 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.873833 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869095 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869103 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869109 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869114 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869119 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869124 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869128 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869133 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869137 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869142 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869147 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869151 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869156 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869160 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869165 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869169 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869175 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869179 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869184 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.874444 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869188 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869193 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869198 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869202 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869206 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869211 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869215 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869219 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869223 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869234 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869239 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869243 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869247 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869255 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869260 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869264 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869269 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869274 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869281 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869286 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.874939 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869290 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869294 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869298 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869303 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869307 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869313 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869318 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869322 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869327 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869331 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869335 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869339 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869344 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869349 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869353 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869358 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869362 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869366 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869370 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869374 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.875465 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869378 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869382 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869388 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869393 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869398 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869403 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869408 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869413 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869417 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869421 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869428 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869433 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869437 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869441 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869446 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869450 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869454 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869458 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.869463 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869565 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 11:34:35.875975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869577 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869616 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869628 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869636 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869641 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869649 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869657 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869662 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869667 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869673 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869679 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869684 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869689 2563 flags.go:64] FLAG: --cgroup-root="" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869694 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869699 2563 flags.go:64] FLAG: --client-ca-file="" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869705 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869710 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869721 2563 flags.go:64] FLAG: --cluster-domain="" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869726 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869732 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869737 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869743 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869752 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 11:34:35.876453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869757 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869762 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869768 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869773 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869778 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869783 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869788 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869793 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869800 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869806 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869811 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869815 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869821 2563 flags.go:64] FLAG: --enable-server="true" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869827 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869833 2563 flags.go:64] FLAG: --event-burst="100" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869838 2563 flags.go:64] FLAG: --event-qps="50" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869843 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869848 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869853 2563 flags.go:64] FLAG: --eviction-hard="" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869860 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869865 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869888 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869893 2563 flags.go:64] FLAG: --eviction-soft="" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869898 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869903 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 11:34:35.877125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869910 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869916 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869921 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869926 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869931 2563 flags.go:64] FLAG: --feature-gates="" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869938 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869943 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869949 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869954 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869959 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869964 2563 flags.go:64] FLAG: --help="false" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869970 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-132-117.ec2.internal" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869975 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869980 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869985 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869991 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.869997 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870002 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870007 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870012 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870017 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870022 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870027 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870032 2563 flags.go:64] FLAG: --kube-reserved="" Jun 10 11:34:35.877808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870037 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870042 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870048 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870052 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870057 2563 flags.go:64] FLAG: --lock-file="" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870062 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870067 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870072 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870081 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870088 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870095 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870100 2563 flags.go:64] FLAG: --logging-format="text" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870105 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870111 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870116 2563 flags.go:64] FLAG: --manifest-url="" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870121 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870129 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870135 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870142 2563 flags.go:64] FLAG: --max-pods="110" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870147 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870152 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870157 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870162 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870168 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870173 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 11:34:35.878447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870178 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870199 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870204 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870209 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870214 2563 flags.go:64] FLAG: --pod-cidr="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870219 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870229 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870233 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870239 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870243 2563 flags.go:64] FLAG: --port="10250" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870249 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870254 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05f84649da4997d73" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870260 2563 flags.go:64] FLAG: --qos-reserved="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870265 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870270 2563 flags.go:64] FLAG: --register-node="true" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870275 2563 flags.go:64] FLAG: --register-with-taints="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870288 2563 flags.go:64] FLAG: --registry-burst="10" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870294 2563 flags.go:64] FLAG: --registry-qps="5" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870299 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870304 2563 flags.go:64] FLAG: --reserved-memory="" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870311 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870316 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870322 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870327 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870332 2563 flags.go:64] FLAG: --runonce="false" Jun 10 11:34:35.879102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870337 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870342 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870347 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870352 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870357 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870362 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870368 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870373 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870378 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870383 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870388 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870393 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870398 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870403 2563 flags.go:64] FLAG: --system-cgroups="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870408 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870418 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870423 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870428 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870436 2563 flags.go:64] FLAG: --tls-min-version="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870440 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870446 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870450 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870457 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870462 2563 flags.go:64] FLAG: --v="2" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870469 2563 flags.go:64] FLAG: --version="false" Jun 10 11:34:35.879751 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870494 2563 flags.go:64] FLAG: --vmodule="" Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870503 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.870509 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870717 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870726 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870732 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870737 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870758 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870763 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870768 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870774 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870780 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870784 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870789 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870796 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870801 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870806 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870811 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870815 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870821 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.880384 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870825 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870830 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870836 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870841 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870845 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870850 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870854 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870858 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870863 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870886 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870891 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870896 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870900 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870910 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870915 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870919 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870925 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870930 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870935 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.881021 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870940 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870944 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870949 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870953 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870957 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870961 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870966 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870971 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870975 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870979 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870984 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870988 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870992 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.870996 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871001 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871007 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871011 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871016 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871021 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871025 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.881491 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871032 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871037 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871043 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871048 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871053 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871057 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871061 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871067 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871071 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871078 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871082 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871087 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871091 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871096 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871100 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871104 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871109 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871113 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871118 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.882022 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871123 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871127 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871131 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871135 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871140 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871144 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871149 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871153 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871159 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871164 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871168 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871173 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871177 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871183 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871189 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871194 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871198 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871207 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871212 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.882492 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871216 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871221 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871228 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.871232 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.871992 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.878941 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.878959 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.879776 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.879783 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879847 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879853 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879857 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879861 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879864 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879880 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.882998 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879883 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879889 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879892 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879895 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879898 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879900 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879903 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879906 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879909 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879911 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879914 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879917 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879920 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879922 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879925 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879927 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879930 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879932 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879935 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.883373 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879938 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879940 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879943 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879948 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879951 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879954 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879956 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879959 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879962 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879964 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879967 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879970 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879972 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879975 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879978 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879980 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879983 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879987 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879991 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.883882 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879994 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.879997 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880000 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880003 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880005 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880008 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880011 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880014 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880016 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880020 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880023 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880026 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880030 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880032 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880035 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880038 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880041 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880044 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880047 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.884352 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880050 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880052 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880055 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880059 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880062 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880065 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880068 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880071 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880074 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880076 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880079 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880081 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880084 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880086 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880089 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880092 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880094 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880097 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880099 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880102 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.884841 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880104 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880107 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880109 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880112 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880114 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880117 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880120 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880122 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880125 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880128 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880130 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880133 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880136 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880139 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880142 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.885346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.880146 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880301 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880306 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880309 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880313 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880316 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880319 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880322 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880324 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880327 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880330 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880332 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880335 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880338 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880340 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880343 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880346 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880348 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880350 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880353 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 11:34:35.885720 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880356 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880358 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880361 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880364 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880367 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880369 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880372 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880375 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880377 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880386 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880389 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880392 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880396 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880399 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880401 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880404 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880407 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880409 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880412 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 11:34:35.886322 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880414 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880417 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880420 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880422 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880425 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880427 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880431 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880434 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880437 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880440 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880443 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880445 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880448 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880450 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880453 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880457 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880460 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880463 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880466 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 11:34:35.886818 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880469 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880473 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880475 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880478 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880486 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880489 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880491 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880493 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880496 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880499 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880502 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880504 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880507 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880509 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880512 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880514 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880517 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880519 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880522 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880524 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 11:34:35.887293 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880527 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880530 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880532 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880534 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880538 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880540 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880543 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880545 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880548 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880550 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880553 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880555 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880558 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880560 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880563 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880565 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880568 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880576 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880579 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880581 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 11:34:35.887777 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880584 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:35.880586 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.880591 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.880714 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.882751 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.884313 2563 server.go:1019] "Starting client certificate rotation" Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.884419 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.884451 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 11:34:35.888275 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.887085 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:34:35.891741 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.891627 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 11:34:35.903485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.903466 2563 log.go:25] "Validated CRI v1 runtime API" Jun 10 11:34:35.905920 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.905904 2563 log.go:25] "Validated CRI v1 image API" Jun 10 11:34:35.906772 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.906759 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 11:34:35.912759 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.912731 2563 fs.go:135] Filesystem UUIDs: map[2235bd3a-9dc7-4ab2-acee-fa052cf4b828:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7e56a0fd-e256-4c9e-89c1-67ea62d2ffaa:/dev/nvme0n1p4] Jun 10 11:34:35.912838 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.912757 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 11:34:35.913059 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.913042 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:34:35.917999 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.917882 2563 manager.go:216] Machine: {Timestamp:2026-06-10 11:34:35.916494479 +0000 UTC m=+0.344673701 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104211 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2138b75fab16d85a4b04a3987b0a3e SystemUUID:ec2138b7-5fab-16d8-5a4b-04a3987b0a3e BootID:0ccdb0d8-68cc-4770-91b6-6b5744e6f0f4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:fd:5c:cf:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:fd:5c:cf:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:9a:b3:0d:ea:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 11:34:35.917999 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.917988 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 11:34:35.918140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.918093 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 11:34:35.921304 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.921275 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 11:34:35.921474 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.921308 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 11:34:35.922039 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.922027 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 11:34:35.922103 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.922045 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 11:34:35.922103 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.922056 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:34:35.922805 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.922793 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 11:34:35.923665 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.923653 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 11:34:35.926925 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.926911 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:34:35.927061 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927050 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 11:34:35.927118 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927090 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 10 11:34:35.927118 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927110 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 11:34:35.927207 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927131 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 11:34:35.927207 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927148 2563 kubelet.go:398] "Adding apiserver pod source" Jun 10 11:34:35.927207 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927161 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 11:34:35.927591 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927577 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:34:35.927659 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.927600 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 11:34:35.936694 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.936678 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9gkf" Jun 10 11:34:35.937377 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.937361 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 11:34:35.938760 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.938746 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 11:34:35.938805 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.938777 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 11:34:35.939410 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939396 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 11:34:35.939450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939416 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 11:34:35.939450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939423 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 11:34:35.939450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939428 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 11:34:35.939450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939445 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 11:34:35.939450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939450 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939474 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939480 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939486 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939492 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939499 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939507 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939528 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 11:34:35.939608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.939533 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 11:34:35.943203 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.943183 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 11:34:35.943273 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.943212 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 11:34:35.943273 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.943244 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 11:34:35.943739 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.943726 2563 server.go:1268] "Started kubelet" Jun 10 11:34:35.943843 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.943816 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 11:34:35.943966 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.943910 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 11:34:35.944029 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.943996 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 11:34:35.944696 ip-10-0-132-117 systemd[1]: Started Kubernetes Kubelet. Jun 10 11:34:35.945505 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.945344 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9gkf" Jun 10 11:34:35.945777 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.945756 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 11:34:35.945939 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.945927 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 10 11:34:35.951010 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.950993 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 11:34:35.951090 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951029 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 11:34:35.951153 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.951101 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:35.951265 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.950073 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-117.ec2.internal.18b7b5142f2bb1bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-117.ec2.internal,UID:ip-10-0-132-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-117.ec2.internal,},FirstTimestamp:2026-06-10 11:34:35.943686587 +0000 UTC m=+0.371865811,LastTimestamp:2026-06-10 11:34:35.943686587 +0000 UTC m=+0.371865811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-117.ec2.internal,}" Jun 10 11:34:35.951467 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.951446 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 11:34:35.951551 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951527 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 11:34:35.951610 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951554 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 11:34:35.951610 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951532 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 11:34:35.951722 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951705 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 10 11:34:35.951722 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951718 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 10 11:34:35.951983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951946 2563 factory.go:55] Registering systemd factory Jun 10 11:34:35.951983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.951986 2563 factory.go:223] Registration of the systemd container factory successfully Jun 10 11:34:35.952181 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952168 2563 factory.go:153] Registering CRI-O factory Jun 10 11:34:35.952238 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952185 2563 factory.go:223] Registration of the crio container factory successfully Jun 10 11:34:35.952238 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952230 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 11:34:35.952332 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952254 2563 factory.go:103] Registering Raw factory Jun 10 11:34:35.952332 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952268 2563 manager.go:1196] Started watching for new ooms in manager Jun 10 11:34:35.952860 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.952838 2563 manager.go:349] Starting recovery of all containers Jun 10 11:34:35.962016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.961806 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:35.965011 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:35.964987 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" Jun 10 11:34:35.966202 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.966180 2563 manager.go:354] Recovery completed Jun 10 11:34:35.970529 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.970516 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:35.973067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.973050 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:35.973138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.973078 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:35.973138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.973089 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:35.974785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.974768 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 11:34:35.974785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.974783 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 11:34:35.974977 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.974794 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:35.974977 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.974811 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 10 11:34:35.975682 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.975663 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:35.975767 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.975695 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:35.975767 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.975714 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:35.976225 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.976210 2563 policy_none.go:49] "None policy: Start" Jun 10 11:34:35.976225 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.976227 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 11:34:35.976349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.976238 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 11:34:35.977444 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:35.977429 2563 policy_none.go:47] "Start" Jun 10 11:34:36.014470 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.014453 2563 manager.go:337] "Starting Device Plugin manager" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.014493 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.014507 2563 server.go:87] "Starting device plugin registration server" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.014932 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.014946 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.015034 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.015129 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.015139 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.016061 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.016099 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.024764 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.025930 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.025960 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.025988 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.026016 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 11:34:36.031427 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.028355 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:36.115514 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.115456 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:36.116432 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.116416 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:36.116493 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.116447 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:36.116493 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.116457 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:36.116493 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.116488 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.124638 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.124624 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.124686 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.124646 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-117.ec2.internal\": node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.126718 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.126688 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal"] Jun 10 11:34:36.126772 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.126763 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:36.128058 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.128042 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:36.128120 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.128073 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:36.128120 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.128089 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:36.129494 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.129482 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:36.129591 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.129577 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.129636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.129605 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:36.130155 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130138 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:36.130246 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130170 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:36.130246 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130180 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:36.130246 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130138 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:36.130339 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130256 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:36.130339 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.130270 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:36.131271 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.131259 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.131311 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.131291 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 11:34:36.131959 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.131944 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" Jun 10 11:34:36.132050 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.131967 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 11:34:36.132050 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.131976 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" Jun 10 11:34:36.141940 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.141923 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.153185 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.153165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.153248 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.153189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.153248 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.153204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.155419 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.155403 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.159996 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.159982 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.242758 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.242723 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.254048 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.254126 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.254126 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.254195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.254195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747a1ff862514f63c638769a18b3468e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"747a1ff862514f63c638769a18b3468e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.254195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.254143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c31271bbde5f4411a9e783b19068f04-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"9c31271bbde5f4411a9e783b19068f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.343531 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.343496 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.444261 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.444232 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.460677 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.460658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.463700 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.463685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:36.544659 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.544628 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.645162 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.645112 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.745662 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.745590 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.846058 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.846001 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.883502 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.883475 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 11:34:36.884150 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.883678 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:34:36.884150 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.883722 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 11:34:36.946138 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:36.946112 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:36.948800 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.948768 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:29:35 +0000 UTC" deadline="2028-03-24 01:02:59.560788222 +0000 UTC" Jun 10 11:34:36.948800 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.948796 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15661h28m22.611996182s" Jun 10 11:34:36.964106 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:36.964076 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747a1ff862514f63c638769a18b3468e.slice/crio-e989112d7cec4823608588e1ad9d10b583b674df809fb55c96f45b4cb19cd368 WatchSource:0}: Error finding container e989112d7cec4823608588e1ad9d10b583b674df809fb55c96f45b4cb19cd368: Status 404 returned error can't find the container with id e989112d7cec4823608588e1ad9d10b583b674df809fb55c96f45b4cb19cd368 Jun 10 11:34:36.964479 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:36.964460 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c31271bbde5f4411a9e783b19068f04.slice/crio-71d9ee5be0afcfd504c60b931d260c602e36dc6b326582c2d63722fb07ce075e WatchSource:0}: Error finding container 71d9ee5be0afcfd504c60b931d260c602e36dc6b326582c2d63722fb07ce075e: Status 404 returned error can't find the container with id 71d9ee5be0afcfd504c60b931d260c602e36dc6b326582c2d63722fb07ce075e Jun 10 11:34:36.970368 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:36.970349 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:34:37.029340 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.029242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerStarted","Data":"e989112d7cec4823608588e1ad9d10b583b674df809fb55c96f45b4cb19cd368"} Jun 10 11:34:37.030463 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.030427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"9c31271bbde5f4411a9e783b19068f04","Type":"ContainerStarted","Data":"71d9ee5be0afcfd504c60b931d260c602e36dc6b326582c2d63722fb07ce075e"} Jun 10 11:34:37.046577 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.046558 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:37.147082 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.147045 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:37.233425 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.233397 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:37.247613 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.247588 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:37.348216 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.348120 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:37.448964 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.448899 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" Jun 10 11:34:37.502238 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.502089 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:37.551645 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.551455 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" Jun 10 11:34:37.562798 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.562769 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:34:37.564089 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.564067 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" Jun 10 11:34:37.574089 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.574068 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 11:34:37.928542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.928511 2563 apiserver.go:52] "Watching apiserver" Jun 10 11:34:37.936685 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.936658 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 11:34:37.938140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.938110 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-2fc8l","kube-system/global-pull-secret-syncer-8nzpr","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv","openshift-dns/node-resolver-jsrxk","openshift-multus/network-metrics-daemon-gpx7m","openshift-network-operator/iptables-alerter-zh7kx","openshift-ovn-kubernetes/ovnkube-node-tx78s","kube-system/konnectivity-agent-9k5pg","openshift-cluster-node-tuning-operator/tuned-99dxf","openshift-image-registry/node-ca-cxs9t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-z4n76","openshift-multus/multus-xmlfc"] Jun 10 11:34:37.940893 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.940861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:37.943113 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.943083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.943603 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.943584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.943603 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.943586 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 11:34:37.943750 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.943631 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.944019 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.943999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8svfx\"" Jun 10 11:34:37.945178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945043 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.945178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945081 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 11:34:37.945346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.945567 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 11:34:37.945682 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.945747 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945683 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rgsx7\"" Jun 10 11:34:37.945806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.945755 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 11:34:37.947168 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.947130 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lx9cg\"" Jun 10 11:34:37.947433 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.947416 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 11:34:37.947529 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.947423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.949449 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.949418 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 11:34:37.949533 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.949482 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.949881 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.949796 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.949975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.949896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:37.950143 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.950127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2fj97\"" Jun 10 11:34:37.951904 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.951862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.951904 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.951865 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 11:34:37.952053 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.952038 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.952642 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.952209 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-86dvw\"" Jun 10 11:34:37.952642 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.952454 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:37.952642 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.952534 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:37.954967 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.954947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:37.957540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.957221 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 11:34:37.957540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.957367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 11:34:37.957540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.957379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9vndn\"" Jun 10 11:34:37.957832 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.957610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:37.957832 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.957670 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:37.961731 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.960497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:37.961731 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:37.960573 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:37.962435 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-conf-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962532 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-etc-kubernetes\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962532 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cnibin\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.962532 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962498 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962532 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cnibin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962723 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-hosts-file\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:37.962723 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-tmp-dir\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:37.962723 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962612 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:37.962723 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-system-cni-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cni-binary-copy\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcv9\" (UniqueName: \"kubernetes.io/projected/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-kube-api-access-5pcv9\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-netns\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-kubelet\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.962936 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqpr\" (UniqueName: \"kubernetes.io/projected/4aca6b8c-909f-4c8f-a86b-02f0368859f2-kube-api-access-2bqpr\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.962947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ph9\" (UniqueName: \"kubernetes.io/projected/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-kube-api-access-c7ph9\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-daemon-config\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k775k\" (UniqueName: \"kubernetes.io/projected/9f54c5cc-705f-4c0c-8955-2451863a6f6e-kube-api-access-k775k\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-socket-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963151 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-system-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-os-release\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-bin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aca6b8c-909f-4c8f-a86b-02f0368859f2-iptables-alerter-script\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-multus\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-hostroot\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-multus-certs\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-registration-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4vfz\" (UniqueName: \"kubernetes.io/projected/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kube-api-access-j4vfz\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aca6b8c-909f-4c8f-a86b-02f0368859f2-host-slash\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-os-release\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-sys-fs\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-socket-dir-parent\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-device-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:37.963710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.963683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27k4f\" (UniqueName: \"kubernetes.io/projected/3606f559-9ccd-442d-b721-3360bf17f37a-kube-api-access-27k4f\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:37.964810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.964789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zlnlz\"" Jun 10 11:34:37.964900 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.964809 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.964960 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.964944 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.965064 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.965046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:37.967102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.967072 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.967189 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.967165 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.967299 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.967278 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5d4dx\"" Jun 10 11:34:37.967299 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.967292 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 11:34:37.967460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.967370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:37.969262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.969240 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6mm9n\"" Jun 10 11:34:37.969894 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.969862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 11:34:37.969985 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.969882 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 11:34:37.970316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.970170 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 11:34:37.970316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.970190 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 11:34:37.970316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.970210 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 11:34:37.970316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.970212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 11:34:37.984558 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.984541 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzxw" Jun 10 11:34:37.995763 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:37.995408 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzxw" Jun 10 11:34:38.053367 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.053343 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 11:34:38.064304 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-bin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-tmp\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-kubelet\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-bin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-node-log\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.064455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-multus-certs\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-registration-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4vfz\" (UniqueName: \"kubernetes.io/projected/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kube-api-access-j4vfz\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-registration-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-modprobe-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-multus-certs\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-tuned\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.064745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-config\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovn-node-metrics-cert\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-socket-dir-parent\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27k4f\" (UniqueName: \"kubernetes.io/projected/3606f559-9ccd-442d-b721-3360bf17f37a-kube-api-access-27k4f\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-socket-dir-parent\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.064963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-host\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc2b91ec-a050-43ce-94e3-19dc93a050ee-serviceca\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-netns\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-var-lib-kubelet\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-etc-kubernetes\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cnibin\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cnibin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cnibin\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-etc-kubernetes\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-hosts-file\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.065289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cnibin\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-systemd\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-hosts-file\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-systemd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99146453-42b7-446d-ba6a-6a6c22e8e86f-konnectivity-ca\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-system-cni-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-system-cni-dir\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cni-binary-copy\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcv9\" (UniqueName: \"kubernetes.io/projected/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-kube-api-access-5pcv9\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpzn\" (UniqueName: \"kubernetes.io/projected/bc2b91ec-a050-43ce-94e3-19dc93a050ee-kube-api-access-ljpzn\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqpr\" (UniqueName: \"kubernetes.io/projected/4aca6b8c-909f-4c8f-a86b-02f0368859f2-kube-api-access-2bqpr\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-var-lib-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-etc-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-ovn\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-log-socket\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-daemon-config\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-socket-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.065972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-cni-binary-copy\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc2b91ec-a050-43ce-94e3-19dc93a050ee-host\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-slash\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-socket-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-system-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-os-release\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aca6b8c-909f-4c8f-a86b-02f0368859f2-iptables-alerter-script\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-system-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.066839 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-daemon-config\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwpm\" (UniqueName: \"kubernetes.io/projected/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-kube-api-access-fwwpm\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066606 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-os-release\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-multus\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-hostroot\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aca6b8c-909f-4c8f-a86b-02f0368859f2-host-slash\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-lib-modules\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-bin\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-cni-multus\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99146453-42b7-446d-ba6a-6a6c22e8e86f-agent-certs\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aca6b8c-909f-4c8f-a86b-02f0368859f2-host-slash\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-hostroot\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.067542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.066970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-os-release\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-sys-fs\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-env-overrides\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-device-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4aca6b8c-909f-4c8f-a86b-02f0368859f2-iptables-alerter-script\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067926 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-sys-fs\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067925 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-os-release\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-kubelet-config\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.067992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2df819-73f3-42cd-b09c-bb6a59c8565a-device-dir\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.068091 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.068206 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.068171 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:34:38.568149358 +0000 UTC m=+2.996328591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-systemd-units\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-netd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-script-lib\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-run\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-sys\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-conf-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-tmp-dir\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.068781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-cni-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.069214 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-tmp-dir\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.070558 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.068579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-multus-conf-dir\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.070674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.070674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysconfig\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.070674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-kubernetes\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.070836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-netns\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.070836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-kubelet\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.070836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-conf\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.070836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-var-lib-kubelet\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.071034 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.070760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f54c5cc-705f-4c0c-8955-2451863a6f6e-host-run-netns\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.071264 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.071224 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26wc9\" (UniqueName: \"kubernetes.io/projected/bea62bbe-783b-4bba-b04c-8021d8836c0e-kube-api-access-26wc9\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.071334 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.071297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ph9\" (UniqueName: \"kubernetes.io/projected/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-kube-api-access-c7ph9\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.071392 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.071331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k775k\" (UniqueName: \"kubernetes.io/projected/9f54c5cc-705f-4c0c-8955-2451863a6f6e-kube-api-access-k775k\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.071392 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.071360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-dbus\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.071489 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.071447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.074544 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.074509 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 11:34:38.078382 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.078308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4vfz\" (UniqueName: \"kubernetes.io/projected/fa2df819-73f3-42cd-b09c-bb6a59c8565a-kube-api-access-j4vfz\") pod \"aws-ebs-csi-driver-node-nqhdv\" (UID: \"fa2df819-73f3-42cd-b09c-bb6a59c8565a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.078382 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.078308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqpr\" (UniqueName: \"kubernetes.io/projected/4aca6b8c-909f-4c8f-a86b-02f0368859f2-kube-api-access-2bqpr\") pod \"iptables-alerter-zh7kx\" (UID: \"4aca6b8c-909f-4c8f-a86b-02f0368859f2\") " pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.078382 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.078313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27k4f\" (UniqueName: \"kubernetes.io/projected/3606f559-9ccd-442d-b721-3360bf17f37a-kube-api-access-27k4f\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:38.079250 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.079208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcv9\" (UniqueName: \"kubernetes.io/projected/b3e746f5-1d3e-4e49-8f33-14ffaf17075b-kube-api-access-5pcv9\") pod \"node-resolver-jsrxk\" (UID: \"b3e746f5-1d3e-4e49-8f33-14ffaf17075b\") " pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.079473 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.079452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k775k\" (UniqueName: \"kubernetes.io/projected/9f54c5cc-705f-4c0c-8955-2451863a6f6e-kube-api-access-k775k\") pod \"multus-xmlfc\" (UID: \"9f54c5cc-705f-4c0c-8955-2451863a6f6e\") " pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.079563 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.079524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ph9\" (UniqueName: \"kubernetes.io/projected/6c3e423c-63a5-44b4-8c9f-bac6ff22400c-kube-api-access-c7ph9\") pod \"multus-additional-cni-plugins-z4n76\" (UID: \"6c3e423c-63a5-44b4-8c9f-bac6ff22400c\") " pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.116509 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.116486 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:38.172657 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc2b91ec-a050-43ce-94e3-19dc93a050ee-host\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.172657 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-slash\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwpm\" (UniqueName: \"kubernetes.io/projected/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-kube-api-access-fwwpm\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-lib-modules\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc2b91ec-a050-43ce-94e3-19dc93a050ee-host\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-bin\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-slash\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99146453-42b7-446d-ba6a-6a6c22e8e86f-agent-certs\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-env-overrides\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-bin\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.172919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-kubelet-config\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-lib-modules\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.172964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-kubelet-config\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.173035 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-systemd-units\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.173106 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:38.673085306 +0000 UTC m=+3.101264531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-netd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-systemd-units\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-cni-netd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173209 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-script-lib\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-run\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-sys\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysconfig\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-kubernetes\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.173455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-run\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-sys\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-conf\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-env-overrides\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26wc9\" (UniqueName: \"kubernetes.io/projected/bea62bbe-783b-4bba-b04c-8021d8836c0e-kube-api-access-26wc9\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-kubernetes\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysconfig\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-dbus\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-tmp\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-kubelet\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-node-log\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-sysctl-conf\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/842bdaf9-d1c6-4228-b276-a461c295e0e2-dbus\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-kubelet\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-modprobe-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.174260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-node-log\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-tuned\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-script-lib\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-config\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-modprobe-d\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovn-node-metrics-cert\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-host\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc2b91ec-a050-43ce-94e3-19dc93a050ee-serviceca\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-netns\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-var-lib-kubelet\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-systemd\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-systemd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.173967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-systemd\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-netns\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-var-lib-kubelet\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174127 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-systemd\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovnkube-config\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bea62bbe-783b-4bba-b04c-8021d8836c0e-host\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99146453-42b7-446d-ba6a-6a6c22e8e86f-konnectivity-ca\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpzn\" (UniqueName: \"kubernetes.io/projected/bc2b91ec-a050-43ce-94e3-19dc93a050ee-kube-api-access-ljpzn\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-var-lib-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-etc-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-ovn\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-log-socket\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-var-lib-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174592 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-etc-openvswitch\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-log-socket\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.174700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-run-ovn\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.175004 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc2b91ec-a050-43ce-94e3-19dc93a050ee-serviceca\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.175806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.175078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99146453-42b7-446d-ba6a-6a6c22e8e86f-konnectivity-ca\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.176428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.175823 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99146453-42b7-446d-ba6a-6a6c22e8e86f-agent-certs\") pod \"konnectivity-agent-9k5pg\" (UID: \"99146453-42b7-446d-ba6a-6a6c22e8e86f\") " pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.176646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.176629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-ovn-node-metrics-cert\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.176760 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.176741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-etc-tuned\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.176911 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.176893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea62bbe-783b-4bba-b04c-8021d8836c0e-tmp\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.179815 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.179759 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:38.179815 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.179789 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:38.179815 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.179804 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:38.180022 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.179865 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:38.679847777 +0000 UTC m=+3.108027006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:38.181392 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.181349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpzn\" (UniqueName: \"kubernetes.io/projected/bc2b91ec-a050-43ce-94e3-19dc93a050ee-kube-api-access-ljpzn\") pod \"node-ca-cxs9t\" (UID: \"bc2b91ec-a050-43ce-94e3-19dc93a050ee\") " pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.181714 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.181692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26wc9\" (UniqueName: \"kubernetes.io/projected/bea62bbe-783b-4bba-b04c-8021d8836c0e-kube-api-access-26wc9\") pod \"tuned-99dxf\" (UID: \"bea62bbe-783b-4bba-b04c-8021d8836c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.181992 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.181973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwpm\" (UniqueName: \"kubernetes.io/projected/8700e99d-c3f9-4c5f-aa17-100e7ae43dd7-kube-api-access-fwwpm\") pod \"ovnkube-node-tx78s\" (UID: \"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.253458 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.253419 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh7kx" Jun 10 11:34:38.262497 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.262468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4n76" Jun 10 11:34:38.272169 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.272150 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmlfc" Jun 10 11:34:38.276747 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.276712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" Jun 10 11:34:38.284495 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.284475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jsrxk" Jun 10 11:34:38.291183 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.291166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:34:38.298771 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.298752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99dxf" Jun 10 11:34:38.304283 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.304264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxs9t" Jun 10 11:34:38.308997 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.308979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:34:38.453397 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.453331 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 11:34:38.578087 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.578058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:38.578249 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.578197 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:38.578310 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.578265 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:34:39.578244971 +0000 UTC m=+4.006424188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:38.678884 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.678829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:38.679029 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.678988 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:38.679086 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.679052 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:39.679038309 +0000 UTC m=+4.107217519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:38.780226 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.780153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:38.780351 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.780289 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:38.780351 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.780303 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:38.780351 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.780312 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:38.780449 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:38.780358 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:39.780345804 +0000 UTC m=+4.208525015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:38.808326 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.808297 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2df819_73f3_42cd_b09c_bb6a59c8565a.slice/crio-aa970907ce3984b0c7688d1b9bc4f711f140846741f790c9b84659bb61d2b680 WatchSource:0}: Error finding container aa970907ce3984b0c7688d1b9bc4f711f140846741f790c9b84659bb61d2b680: Status 404 returned error can't find the container with id aa970907ce3984b0c7688d1b9bc4f711f140846741f790c9b84659bb61d2b680 Jun 10 11:34:38.809167 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.809146 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99146453_42b7_446d_ba6a_6a6c22e8e86f.slice/crio-beacf722927d98faf3bba2140a79b220bebd2d56ff089334647b276b416ef50f WatchSource:0}: Error finding container beacf722927d98faf3bba2140a79b220bebd2d56ff089334647b276b416ef50f: Status 404 returned error can't find the container with id beacf722927d98faf3bba2140a79b220bebd2d56ff089334647b276b416ef50f Jun 10 11:34:38.832535 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.832509 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3e423c_63a5_44b4_8c9f_bac6ff22400c.slice/crio-c582d02d71314a7225aca91820c928c9dec6837b9fa219a5dd5474825a8433b6 WatchSource:0}: Error finding container c582d02d71314a7225aca91820c928c9dec6837b9fa219a5dd5474825a8433b6: Status 404 returned error can't find the container with id c582d02d71314a7225aca91820c928c9dec6837b9fa219a5dd5474825a8433b6 Jun 10 11:34:38.834030 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.834009 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aca6b8c_909f_4c8f_a86b_02f0368859f2.slice/crio-43464b4debd7db00c68109d6679b31f9951280caf7954130a276677436071d17 WatchSource:0}: Error finding container 43464b4debd7db00c68109d6679b31f9951280caf7954130a276677436071d17: Status 404 returned error can't find the container with id 43464b4debd7db00c68109d6679b31f9951280caf7954130a276677436071d17 Jun 10 11:34:38.835115 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.835091 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8700e99d_c3f9_4c5f_aa17_100e7ae43dd7.slice/crio-6608cd45ed82dd3f167232dc2220474725be44c0a6f75bb50d46ec8be81223a8 WatchSource:0}: Error finding container 6608cd45ed82dd3f167232dc2220474725be44c0a6f75bb50d46ec8be81223a8: Status 404 returned error can't find the container with id 6608cd45ed82dd3f167232dc2220474725be44c0a6f75bb50d46ec8be81223a8 Jun 10 11:34:38.837795 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.837747 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e746f5_1d3e_4e49_8f33_14ffaf17075b.slice/crio-81610c0ba0b31c80a40429bb747b6a1a4ac1ca9e560d95cf6c9412f5a78bd908 WatchSource:0}: Error finding container 81610c0ba0b31c80a40429bb747b6a1a4ac1ca9e560d95cf6c9412f5a78bd908: Status 404 returned error can't find the container with id 81610c0ba0b31c80a40429bb747b6a1a4ac1ca9e560d95cf6c9412f5a78bd908 Jun 10 11:34:38.837949 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.837929 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f54c5cc_705f_4c0c_8955_2451863a6f6e.slice/crio-d114eef332c41502b6ed523f337ed7204861bd28bed1bc909ec2060d6345db1f WatchSource:0}: Error finding container d114eef332c41502b6ed523f337ed7204861bd28bed1bc909ec2060d6345db1f: Status 404 returned error can't find the container with id d114eef332c41502b6ed523f337ed7204861bd28bed1bc909ec2060d6345db1f Jun 10 11:34:38.840419 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.840297 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2b91ec_a050_43ce_94e3_19dc93a050ee.slice/crio-47e4b97a9f2ff791cc2b8c410ada7f92244776562971178618baec84cbdd9cc2 WatchSource:0}: Error finding container 47e4b97a9f2ff791cc2b8c410ada7f92244776562971178618baec84cbdd9cc2: Status 404 returned error can't find the container with id 47e4b97a9f2ff791cc2b8c410ada7f92244776562971178618baec84cbdd9cc2 Jun 10 11:34:38.841220 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:34:38.841068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea62bbe_783b_4bba_b04c_8021d8836c0e.slice/crio-4cd45d2dd1a0c1f557461eda8439221e95b848ef8c92bbd765bd45c80f795107 WatchSource:0}: Error finding container 4cd45d2dd1a0c1f557461eda8439221e95b848ef8c92bbd765bd45c80f795107: Status 404 returned error can't find the container with id 4cd45d2dd1a0c1f557461eda8439221e95b848ef8c92bbd765bd45c80f795107 Jun 10 11:34:38.999175 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.998939 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:29:37 +0000 UTC" deadline="2028-01-01 23:24:41.188153762 +0000 UTC" Jun 10 11:34:38.999175 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:38.999171 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13691h50m2.188987893s" Jun 10 11:34:39.040079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.039973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" event={"ID":"fa2df819-73f3-42cd-b09c-bb6a59c8565a","Type":"ContainerStarted","Data":"aa970907ce3984b0c7688d1b9bc4f711f140846741f790c9b84659bb61d2b680"} Jun 10 11:34:39.042514 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.042470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"9c31271bbde5f4411a9e783b19068f04","Type":"ContainerStarted","Data":"4eac5741afb389b617deb9689f1f822f827841071a14c4394e6768d005d6be26"} Jun 10 11:34:39.044609 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.044585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmlfc" event={"ID":"9f54c5cc-705f-4c0c-8955-2451863a6f6e","Type":"ContainerStarted","Data":"d114eef332c41502b6ed523f337ed7204861bd28bed1bc909ec2060d6345db1f"} Jun 10 11:34:39.045598 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.045578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerStarted","Data":"c582d02d71314a7225aca91820c928c9dec6837b9fa219a5dd5474825a8433b6"} Jun 10 11:34:39.047095 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.047065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k5pg" event={"ID":"99146453-42b7-446d-ba6a-6a6c22e8e86f","Type":"ContainerStarted","Data":"beacf722927d98faf3bba2140a79b220bebd2d56ff089334647b276b416ef50f"} Jun 10 11:34:39.048060 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.048039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99dxf" event={"ID":"bea62bbe-783b-4bba-b04c-8021d8836c0e","Type":"ContainerStarted","Data":"4cd45d2dd1a0c1f557461eda8439221e95b848ef8c92bbd765bd45c80f795107"} Jun 10 11:34:39.049099 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.049075 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxs9t" event={"ID":"bc2b91ec-a050-43ce-94e3-19dc93a050ee","Type":"ContainerStarted","Data":"47e4b97a9f2ff791cc2b8c410ada7f92244776562971178618baec84cbdd9cc2"} Jun 10 11:34:39.050046 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.050022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsrxk" event={"ID":"b3e746f5-1d3e-4e49-8f33-14ffaf17075b","Type":"ContainerStarted","Data":"81610c0ba0b31c80a40429bb747b6a1a4ac1ca9e560d95cf6c9412f5a78bd908"} Jun 10 11:34:39.051116 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.051097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"6608cd45ed82dd3f167232dc2220474725be44c0a6f75bb50d46ec8be81223a8"} Jun 10 11:34:39.052084 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.052067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh7kx" event={"ID":"4aca6b8c-909f-4c8f-a86b-02f0368859f2","Type":"ContainerStarted","Data":"43464b4debd7db00c68109d6679b31f9951280caf7954130a276677436071d17"} Jun 10 11:34:39.057460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.057422 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" podStartSLOduration=2.057410963 podStartE2EDuration="2.057410963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:39.057267488 +0000 UTC m=+3.485446733" watchObservedRunningTime="2026-06-10 11:34:39.057410963 +0000 UTC m=+3.485590195" Jun 10 11:34:39.587768 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.587164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:39.587768 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.587337 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:39.587768 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.587400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:34:41.587380665 +0000 UTC m=+6.015559878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:39.688499 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.687787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:39.688499 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.687960 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:39.688499 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.688024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:41.688006022 +0000 UTC m=+6.116185232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:39.789221 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:39.788538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:39.789221 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.788761 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:39.789221 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.788785 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:39.789221 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.788799 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:39.789221 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:39.788861 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:41.788841861 +0000 UTC m=+6.217021094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:40.000349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.000242 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:29:37 +0000 UTC" deadline="2028-01-22 23:47:23.440993202 +0000 UTC" Jun 10 11:34:40.000349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.000314 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14196h12m43.440683254s" Jun 10 11:34:40.026708 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.026676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:40.026708 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.026690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:40.026957 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:40.026786 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:40.026957 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:40.026847 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:40.026957 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.026948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:40.027102 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:40.027019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:40.069107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.069073 2563 generic.go:356] "Generic (PLEG): container finished" podID="747a1ff862514f63c638769a18b3468e" containerID="f93ca9eec7f1a85e0055800634eeccc03f9064c27bbdeb0b1aef9969fe2c711a" exitCode=0 Jun 10 11:34:40.070037 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:40.070009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerDied","Data":"f93ca9eec7f1a85e0055800634eeccc03f9064c27bbdeb0b1aef9969fe2c711a"} Jun 10 11:34:41.084442 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:41.084344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"747a1ff862514f63c638769a18b3468e","Type":"ContainerStarted","Data":"544d97bc3cf6c97c21223e21b3c45aea4fcae34f74f6f634eb091498b86b10b1"} Jun 10 11:34:41.101605 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:41.101546 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" podStartSLOduration=4.101524009 podStartE2EDuration="4.101524009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:41.101015833 +0000 UTC m=+5.529195077" watchObservedRunningTime="2026-06-10 11:34:41.101524009 +0000 UTC m=+5.529703243" Jun 10 11:34:41.606517 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:41.606478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:41.606714 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.606693 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:41.606779 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.606772 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:34:45.606748564 +0000 UTC m=+10.034927774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:41.707938 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:41.707900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:41.708121 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.708105 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:41.708195 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.708177 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:45.708157461 +0000 UTC m=+10.136336690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:41.808653 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:41.808614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:41.808848 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.808815 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:41.808848 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.808835 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:41.808848 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.808847 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:41.809082 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:41.808922 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:45.808902944 +0000 UTC m=+10.237082161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:42.026391 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:42.026354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:42.026561 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:42.026523 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:42.026967 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:42.026930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:42.026967 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:42.026950 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:42.027100 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:42.027064 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:42.027215 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:42.027145 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:44.026497 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:44.026459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:44.027019 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:44.026459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:44.027019 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:44.026616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:44.027019 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:44.026459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:44.027019 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:44.026716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:44.027019 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:44.026739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:45.642540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:45.642429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:45.643016 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.642552 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:45.643016 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.642622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:34:53.642602995 +0000 UTC m=+18.070782218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:45.744449 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:45.743883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:45.744449 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.744059 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:45.744449 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.744128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:53.744107841 +0000 UTC m=+18.172287066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:45.845213 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:45.845168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:45.845405 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.845388 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:45.845462 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.845411 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:45.845462 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.845424 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:45.845575 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:45.845493 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:34:53.845473746 +0000 UTC m=+18.273652974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:46.027721 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:46.027677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:46.028053 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:46.027787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:46.028053 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:46.027812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:46.028497 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:46.028363 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:46.028497 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:46.028455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:46.028655 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:46.028277 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:48.026578 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:48.026541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:48.027140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:48.026541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:48.027140 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:48.026689 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:48.027140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:48.026542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:48.027140 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:48.026787 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:48.027140 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:48.026861 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:50.026499 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:50.026465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:50.026499 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:50.026491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:50.026990 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:50.026467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:50.026990 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:50.026583 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:50.026990 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:50.026642 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:50.026990 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:50.026727 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:52.026734 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:52.026700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:52.026734 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:52.026719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:52.027222 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:52.026700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:52.027222 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:52.026850 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:52.027222 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:52.026939 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:52.027222 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:52.027001 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:53.705624 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:53.705584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:53.706072 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.705748 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:53.706072 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.705821 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:35:09.705802981 +0000 UTC m=+34.133982191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:34:53.806301 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:53.806263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:53.806492 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.806437 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:53.806556 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.806526 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:35:09.806501676 +0000 UTC m=+34.234680905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:34:53.907669 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:53.907629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:53.907834 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.907801 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:34:53.907834 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.907823 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:34:53.907834 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.907835 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:53.907974 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:53.907913 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:35:09.907894754 +0000 UTC m=+34.336073964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:34:54.026533 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:54.026446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:54.026672 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:54.026451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:54.026672 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:54.026582 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:54.026672 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:54.026455 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:54.026817 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:54.026667 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:54.026817 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:54.026784 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:56.027833 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:56.027802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:56.028334 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:56.027916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:56.028334 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:56.027926 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:56.028334 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:56.028041 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:56.028334 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:56.028091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:56.028334 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:56.028163 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:58.027153 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.026964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:34:58.027890 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.026964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:34:58.027890 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:58.027257 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:34:58.027890 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.026965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:34:58.027890 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:58.027318 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:34:58.027890 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:34:58.027374 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:34:58.123219 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.123195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k5pg" event={"ID":"99146453-42b7-446d-ba6a-6a6c22e8e86f","Type":"ContainerStarted","Data":"8c7e750619b6b8b475248df067e9a6e17967bfe8d305ca0a9d041f27c39c653f"} Jun 10 11:34:58.124774 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.124749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99dxf" event={"ID":"bea62bbe-783b-4bba-b04c-8021d8836c0e","Type":"ContainerStarted","Data":"87ed9cb14abf6e6efd32ec36826d06a952fba62c56abf62af30c70e62c308f88"} Jun 10 11:34:58.126375 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.126322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxs9t" event={"ID":"bc2b91ec-a050-43ce-94e3-19dc93a050ee","Type":"ContainerStarted","Data":"5f94695c8258e3e48d28c8c1c84244236b2e16e814b83b86602cb089ad3668c8"} Jun 10 11:34:58.127748 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.127723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jsrxk" event={"ID":"b3e746f5-1d3e-4e49-8f33-14ffaf17075b","Type":"ContainerStarted","Data":"7ae6ebda9ab47f701ae9a17e94ea36f33a8c9a266700cc7efb1c157cb9ee2891"} Jun 10 11:34:58.130126 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.130105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:34:58.130482 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.130462 2563 generic.go:356] "Generic (PLEG): container finished" podID="8700e99d-c3f9-4c5f-aa17-100e7ae43dd7" containerID="3504c334b81207a7425caf24a8fbf58ead33ff82b3d214703c84a5addec44467" exitCode=1 Jun 10 11:34:58.130574 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.130531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"55868b0e1cb04dcf043da05552b164c4313f715e1863359990ddf3db13c45062"} Jun 10 11:34:58.130630 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.130601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerDied","Data":"3504c334b81207a7425caf24a8fbf58ead33ff82b3d214703c84a5addec44467"} Jun 10 11:34:58.130682 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.130652 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"a470ce155453e7de65310a426cbc80baf7d9afc5a806823a0695a9d248a220e7"} Jun 10 11:34:58.132117 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.132094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" event={"ID":"fa2df819-73f3-42cd-b09c-bb6a59c8565a","Type":"ContainerStarted","Data":"a2c872abfbcc5eb3e634778667badd1943c072c1bf8ac9856fbd9554e04250f6"} Jun 10 11:34:58.133679 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.133626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmlfc" event={"ID":"9f54c5cc-705f-4c0c-8955-2451863a6f6e","Type":"ContainerStarted","Data":"66de94bcfaefc6444e3f0bfa233a3fadf44bfb93a17c2a7c9ac5a590962cd56b"} Jun 10 11:34:58.135212 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.135188 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="c17c4b9ef9ece08cef548a61a27a1c4e988c061ee661f8717c630560132f0f4c" exitCode=0 Jun 10 11:34:58.135314 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.135218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"c17c4b9ef9ece08cef548a61a27a1c4e988c061ee661f8717c630560132f0f4c"} Jun 10 11:34:58.139308 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.139262 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9k5pg" podStartSLOduration=3.388830278 podStartE2EDuration="22.139246404s" totalImagesPullingTime="18.750416126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:58.138739118 +0000 UTC m=+22.566918352" watchObservedRunningTime="2026-06-10 11:34:58.139246404 +0000 UTC m=+22.567425638" Jun 10 11:34:58.173548 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.173332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cxs9t" podStartSLOduration=3.465092587 podStartE2EDuration="22.173310504s" totalImagesPullingTime="18.708217917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:58.173294366 +0000 UTC m=+22.601473599" watchObservedRunningTime="2026-06-10 11:34:58.173310504 +0000 UTC m=+22.601489738" Jun 10 11:34:58.192535 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.192495 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xmlfc" podStartSLOduration=3.410199647 podStartE2EDuration="22.192479726s" totalImagesPullingTime="18.782280079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:58.19197829 +0000 UTC m=+22.620157525" watchObservedRunningTime="2026-06-10 11:34:58.192479726 +0000 UTC m=+22.620658958" Jun 10 11:34:58.205965 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.205925 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jsrxk" podStartSLOduration=3.422164597 podStartE2EDuration="22.205911284s" totalImagesPullingTime="18.783746687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:58.205686694 +0000 UTC m=+22.633865928" watchObservedRunningTime="2026-06-10 11:34:58.205911284 +0000 UTC m=+22.634090516" Jun 10 11:34:58.222140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.222102 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-99dxf" podStartSLOduration=3.463926363 podStartE2EDuration="22.222088489s" totalImagesPullingTime="18.758162126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:58.221895051 +0000 UTC m=+22.650074282" watchObservedRunningTime="2026-06-10 11:34:58.222088489 +0000 UTC m=+22.650267745" Jun 10 11:34:58.342861 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.342817 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:58.423246 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:58.423212 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:59.090451 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.090411 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 11:34:59.141290 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.141262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:34:59.141803 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.141775 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"cfa7f7ec41c2ad0256e3360c3b27fd15bd39f3264f73bde131949a86b6a564b6"} Jun 10 11:34:59.141919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.141901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"97e5c9459c37cde2c6b96f8aa9370e7de48c3859fd9c4e181402f0870ed6dc61"} Jun 10 11:34:59.141983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.141953 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"85e282bae24442855de11a0fe7a5b6a0f7e044f10c99b6ff4a0c18ead869d69d"} Jun 10 11:34:59.143596 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.143570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh7kx" event={"ID":"4aca6b8c-909f-4c8f-a86b-02f0368859f2","Type":"ContainerStarted","Data":"0776be16d1ecd7703c2f078cb565149efaf5a8b9765330681b455efb5edf2a0b"} Jun 10 11:34:59.145906 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.145863 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" event={"ID":"fa2df819-73f3-42cd-b09c-bb6a59c8565a","Type":"ContainerStarted","Data":"392d222c34c20b33de5b5414eeeb0670dbf4f6faf6cffc59d5c527afb68a7166"} Jun 10 11:34:59.158983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.158941 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zh7kx" podStartSLOduration=4.375877751 podStartE2EDuration="23.158926662s" totalImagesPullingTime="18.783048911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:34:59.158350948 +0000 UTC m=+23.586530200" watchObservedRunningTime="2026-06-10 11:34:59.158926662 +0000 UTC m=+23.587105895" Jun 10 11:34:59.278363 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.278262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" limit=1024 Jun 10 11:34:59.338036 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:34:59.337999 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:00.027341 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.027305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:00.027521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.027305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:00.027521 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:00.027437 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:00.027521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.027306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:00.027521 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:00.027488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:00.027722 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:00.027611 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:00.027777 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.027693 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T11:34:59.090430529Z","UUID":"c62d9c80-aa8f-4b47-9cf6-6a7b034ac2cb","Handler":null,"Name":"","Endpoint":""} Jun 10 11:35:00.029396 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.029375 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 11:35:00.029519 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:00.029414 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 11:35:01.152649 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:01.152603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" event={"ID":"fa2df819-73f3-42cd-b09c-bb6a59c8565a","Type":"ContainerStarted","Data":"0d23889eeac50309b55fc80303b57621d91a99fb2176b206b72c7fc81a27911f"} Jun 10 11:35:01.171236 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:01.171187 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqhdv" podStartSLOduration=4.370548008 podStartE2EDuration="25.171173766s" totalImagesPullingTime="20.800625758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:01.169951037 +0000 UTC m=+25.598130269" watchObservedRunningTime="2026-06-10 11:35:01.171173766 +0000 UTC m=+25.599352994" Jun 10 11:35:02.027273 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.027133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:02.027407 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.027133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:02.027407 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:02.027389 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:02.027506 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.027250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:02.027506 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:02.027462 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:02.027581 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:02.027561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:02.158111 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.158085 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:35:02.158568 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.158470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"dd2ef4f29d55322b0a43fdf9c6e0455b5ff8812d4a80f1f748b5ecb3889b89dc"} Jun 10 11:35:02.160277 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.160253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerStarted","Data":"284fef53f03c1411cc648cb0be6d70eb07b3eb694bb396066f9dbbd2f720b942"} Jun 10 11:35:02.662804 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.662769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:35:02.663313 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:02.663291 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:35:03.164470 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:03.164429 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="284fef53f03c1411cc648cb0be6d70eb07b3eb694bb396066f9dbbd2f720b942" exitCode=0 Jun 10 11:35:03.165014 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:03.164517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"284fef53f03c1411cc648cb0be6d70eb07b3eb694bb396066f9dbbd2f720b942"} Jun 10 11:35:03.165014 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:03.164834 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:35:03.165617 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:03.165312 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9k5pg" Jun 10 11:35:03.249065 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:03.249008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" limit=1024 Jun 10 11:35:04.026524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.026497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:04.026524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.026510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:04.026731 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:04.026604 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:04.026731 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:04.026655 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:04.026731 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.026711 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:04.026844 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:04.026800 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:04.171971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.171220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:35:04.171971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.171746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"36e3ef8e79533258815ee1921f38c503a7c7ddaf10eb1ec6d359f24f8f39c36a"} Jun 10 11:35:04.173548 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.172176 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:04.173548 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.172249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:04.173548 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.172289 2563 scope.go:117] "RemoveContainer" containerID="3504c334b81207a7425caf24a8fbf58ead33ff82b3d214703c84a5addec44467" Jun 10 11:35:04.175533 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.174516 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="0fe9b46d4381c852f6902cbe6129a370088a2d1620578e4fce407f2e8223f855" exitCode=0 Jun 10 11:35:04.175533 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.174567 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"0fe9b46d4381c852f6902cbe6129a370088a2d1620578e4fce407f2e8223f855"} Jun 10 11:35:04.190676 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:04.190314 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:05.181294 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.181264 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="8382d954ff3a3df01b448faf44d5608822b976e7d71f90e80c546d9b4f805a12" exitCode=0 Jun 10 11:35:05.181757 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.181346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"8382d954ff3a3df01b448faf44d5608822b976e7d71f90e80c546d9b4f805a12"} Jun 10 11:35:05.185273 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.185256 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:35:05.185629 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.185589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" event={"ID":"8700e99d-c3f9-4c5f-aa17-100e7ae43dd7","Type":"ContainerStarted","Data":"b95a6320b5fb51f62f25d382f5e6a8c8ca6c4cbba6a551bc91571fbac8293c98"} Jun 10 11:35:05.185889 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.185839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:05.200756 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.200733 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:05.233370 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:05.233320 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" podStartSLOduration=10.400542314 podStartE2EDuration="29.233306117s" totalImagesPullingTime="18.832763803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:05.232166563 +0000 UTC m=+29.660345818" watchObservedRunningTime="2026-06-10 11:35:05.233306117 +0000 UTC m=+29.661485348" Jun 10 11:35:06.027644 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.027613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:06.027822 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.027713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:06.027822 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.027730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:06.027822 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.027752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:06.028012 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.027843 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:06.028012 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.027952 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:06.066579 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.066547 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nzpr"] Jun 10 11:35:06.070438 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.070281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2fc8l"] Jun 10 11:35:06.071960 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.071276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gpx7m"] Jun 10 11:35:06.188468 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.188444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:06.188900 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.188444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:06.188900 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:06.188444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:06.188900 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.188599 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:06.188900 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.188651 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:06.189127 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:06.189050 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:08.026766 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:08.026727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:08.027195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:08.026727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:08.027195 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:08.026862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzpr" podUID="842bdaf9-d1c6-4228-b276-a461c295e0e2" Jun 10 11:35:08.027195 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:08.027000 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:35:08.027195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:08.026727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:08.027195 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:08.027136 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2fc8l" podUID="85949759-f0f7-4479-9fe5-def17f7eb285" Jun 10 11:35:09.389338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.389315 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeReady" Jun 10 11:35:09.389765 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.389478 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 11:35:09.436318 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.436286 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wfb4d"] Jun 10 11:35:09.449946 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.449853 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bvbcb"] Jun 10 11:35:09.450151 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.450132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.453010 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.452986 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-98p9t\"" Jun 10 11:35:09.453124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.453026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 11:35:09.453124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.452986 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 11:35:09.461902 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.461863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfb4d"] Jun 10 11:35:09.462002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.461926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvbcb"] Jun 10 11:35:09.462002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.461958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.464256 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.464214 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 11:35:09.464391 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.464368 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cxtmj\"" Jun 10 11:35:09.464510 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.464491 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 11:35:09.464856 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.464841 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 11:35:09.635005 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.634966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38187b12-9c42-4730-819c-c849ad36e361-cert\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.635182 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.635022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-tmp-dir\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.635182 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.635056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-config-volume\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.635182 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.635077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7gsw\" (UniqueName: \"kubernetes.io/projected/38187b12-9c42-4730-819c-c849ad36e361-kube-api-access-d7gsw\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.635182 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.635113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.635182 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.635127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5tmc\" (UniqueName: \"kubernetes.io/projected/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-kube-api-access-w5tmc\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.736380 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-config-volume\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.736380 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7gsw\" (UniqueName: \"kubernetes.io/projected/38187b12-9c42-4730-819c-c849ad36e361-kube-api-access-d7gsw\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.736380 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:09.736615 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.736467 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:35:09.736615 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.736544 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:35:41.7365228 +0000 UTC m=+66.164702034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 11:35:09.736615 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.736615 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5tmc\" (UniqueName: \"kubernetes.io/projected/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-kube-api-access-w5tmc\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.736823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38187b12-9c42-4730-819c-c849ad36e361-cert\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.736823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-tmp-dir\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.736823 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.736687 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:09.736823 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.736752 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:10.236736541 +0000 UTC m=+34.664915754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:09.737054 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.736937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-config-volume\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.737054 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.737010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-tmp-dir\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.740836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.740814 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38187b12-9c42-4730-819c-c849ad36e361-cert\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.744562 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.744539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5tmc\" (UniqueName: \"kubernetes.io/projected/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-kube-api-access-w5tmc\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:09.745008 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.744990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7gsw\" (UniqueName: \"kubernetes.io/projected/38187b12-9c42-4730-819c-c849ad36e361-kube-api-access-d7gsw\") pod \"ingress-canary-bvbcb\" (UID: \"38187b12-9c42-4730-819c-c849ad36e361\") " pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.770058 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.770027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bvbcb" Jun 10 11:35:09.837850 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.837820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:09.838043 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.837999 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 11:35:09.838108 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.838090 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret podName:842bdaf9-d1c6-4228-b276-a461c295e0e2 nodeName:}" failed. No retries permitted until 2026-06-10 11:35:41.838068338 +0000 UTC m=+66.266247572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret") pod "global-pull-secret-syncer-8nzpr" (UID: "842bdaf9-d1c6-4228-b276-a461c295e0e2") : object "kube-system"/"original-pull-secret" not registered Jun 10 11:35:09.938629 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.938463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:09.938629 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.938626 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 11:35:09.938829 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.938646 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 11:35:09.938829 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.938656 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w7jwn for pod openshift-network-diagnostics/network-check-target-2fc8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:35:09.938829 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:09.938707 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn podName:85949759-f0f7-4479-9fe5-def17f7eb285 nodeName:}" failed. No retries permitted until 2026-06-10 11:35:41.938692961 +0000 UTC m=+66.366872171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7jwn" (UniqueName: "kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn") pod "network-check-target-2fc8l" (UID: "85949759-f0f7-4479-9fe5-def17f7eb285") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 11:35:09.940256 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:09.940223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bvbcb"] Jun 10 11:35:09.945461 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:35:09.945436 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38187b12_9c42_4730_819c_c849ad36e361.slice/crio-3b83acf06ab50afe7fbf02290ab4b1009c5343f581ec10f1125f54e116d3974d WatchSource:0}: Error finding container 3b83acf06ab50afe7fbf02290ab4b1009c5343f581ec10f1125f54e116d3974d: Status 404 returned error can't find the container with id 3b83acf06ab50afe7fbf02290ab4b1009c5343f581ec10f1125f54e116d3974d Jun 10 11:35:10.027277 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.027190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:10.027436 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.027190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:10.027436 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.027382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:10.029903 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.029884 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:35:10.030704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.030636 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:35:10.030704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.030652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:35:10.030704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.030664 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d86hz\"" Jun 10 11:35:10.030911 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.030654 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nt55\"" Jun 10 11:35:10.030911 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.030744 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:35:10.200746 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.200705 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="989a6d6d192ccbdc340e290abe7691f4ca80277ba81bdaf0036446d11e1bcd0d" exitCode=0 Jun 10 11:35:10.200959 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.200787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"989a6d6d192ccbdc340e290abe7691f4ca80277ba81bdaf0036446d11e1bcd0d"} Jun 10 11:35:10.202058 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.202038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvbcb" event={"ID":"38187b12-9c42-4730-819c-c849ad36e361","Type":"ContainerStarted","Data":"3b83acf06ab50afe7fbf02290ab4b1009c5343f581ec10f1125f54e116d3974d"} Jun 10 11:35:10.240434 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:10.240412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:10.240569 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:10.240549 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:10.240638 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:10.240628 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:11.240593116 +0000 UTC m=+35.668772332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:11.208433 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:11.208399 2563 generic.go:356] "Generic (PLEG): container finished" podID="6c3e423c-63a5-44b4-8c9f-bac6ff22400c" containerID="ac48dadbc57c57378fa029aabcbc0d70b2310f90be667d12f3806d1f0b59897d" exitCode=0 Jun 10 11:35:11.209339 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:11.208486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerDied","Data":"ac48dadbc57c57378fa029aabcbc0d70b2310f90be667d12f3806d1f0b59897d"} Jun 10 11:35:11.247160 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:11.247136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:11.247289 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:11.247271 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:11.247351 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:11.247335 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:13.247319127 +0000 UTC m=+37.675498337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:12.214360 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:12.214325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4n76" event={"ID":"6c3e423c-63a5-44b4-8c9f-bac6ff22400c","Type":"ContainerStarted","Data":"a60614cde6e3490c68465cc7fe578298c8ed16ab37a10ea5aaff3c6ecf6aab65"} Jun 10 11:35:12.241212 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:12.241163 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4n76" podStartSLOduration=8.05798886 podStartE2EDuration="36.241146786s" totalImagesPullingTime="28.183157926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:12.23968992 +0000 UTC m=+36.667869152" watchObservedRunningTime="2026-06-10 11:35:12.241146786 +0000 UTC m=+36.669326021" Jun 10 11:35:13.218549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:13.218510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bvbcb" event={"ID":"38187b12-9c42-4730-819c-c849ad36e361","Type":"ContainerStarted","Data":"6636568359d9c3f6b86c3e0a60c65d6212a37305cd236ae1710efd00085027c5"} Jun 10 11:35:13.248826 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:13.248772 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bvbcb" podStartSLOduration=1.936300924 podStartE2EDuration="4.248749739s" totalImagesPullingTime="2.312448815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:13.248106997 +0000 UTC m=+37.676286242" watchObservedRunningTime="2026-06-10 11:35:13.248749739 +0000 UTC m=+37.676928967" Jun 10 11:35:13.261609 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:13.261577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:13.261744 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:13.261682 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:13.261791 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:13.261757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:17.26173942 +0000 UTC m=+41.689918636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:17.290456 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:17.290258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:17.291049 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:17.290408 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:17.291049 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:17.290595 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:25.290573346 +0000 UTC m=+49.718752573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:25.344185 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:25.344141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:25.344590 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:25.344303 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:25.344590 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:25.344379 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:35:41.344357937 +0000 UTC m=+65.772537165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:37.202107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:37.202082 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tx78s" Jun 10 11:35:41.354516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.354472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:35:41.354974 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:41.354623 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:35:41.354974 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:41.354690 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:36:13.35467372 +0000 UTC m=+97.782852929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:35:41.378555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.378529 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk"] Jun 10 11:35:41.422865 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.422829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk"] Jun 10 11:35:41.423056 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.422965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.426453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.426413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4jbzp\"" Jun 10 11:35:41.426453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.426421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 11:35:41.426453 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.426419 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 11:35:41.426705 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.426541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 11:35:41.426705 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.426545 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 11:35:41.455701 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.455674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a70249ba-9c52-4087-997b-cfa3cea57a0a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.455791 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.455736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwkfp\" (UniqueName: \"kubernetes.io/projected/a70249ba-9c52-4087-997b-cfa3cea57a0a-kube-api-access-xwkfp\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.556329 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.556303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwkfp\" (UniqueName: \"kubernetes.io/projected/a70249ba-9c52-4087-997b-cfa3cea57a0a-kube-api-access-xwkfp\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.556447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.556358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a70249ba-9c52-4087-997b-cfa3cea57a0a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.560386 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.560364 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a70249ba-9c52-4087-997b-cfa3cea57a0a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.564798 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.564776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwkfp\" (UniqueName: \"kubernetes.io/projected/a70249ba-9c52-4087-997b-cfa3cea57a0a-kube-api-access-xwkfp\") pod \"managed-serviceaccount-addon-agent-6984558d98-5cbgk\" (UID: \"a70249ba-9c52-4087-997b-cfa3cea57a0a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.746627 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.746598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" Jun 10 11:35:41.757841 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.757819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:35:41.760239 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.760220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 11:35:41.768014 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:41.767994 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 11:35:41.768065 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:35:41.768055 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:36:45.768039081 +0000 UTC m=+130.196218290 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : secret "metrics-daemon-secret" not found Jun 10 11:35:41.858539 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.858512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:41.860775 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.860755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 11:35:41.871399 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.871378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/842bdaf9-d1c6-4228-b276-a461c295e0e2-original-pull-secret\") pod \"global-pull-secret-syncer-8nzpr\" (UID: \"842bdaf9-d1c6-4228-b276-a461c295e0e2\") " pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:41.883247 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.883221 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk"] Jun 10 11:35:41.886774 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:35:41.886743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda70249ba_9c52_4087_997b_cfa3cea57a0a.slice/crio-40900734256eb736332d8058029a056dd2bf3c26fadfd7061f61517606f399cd WatchSource:0}: Error finding container 40900734256eb736332d8058029a056dd2bf3c26fadfd7061f61517606f399cd: Status 404 returned error can't find the container with id 40900734256eb736332d8058029a056dd2bf3c26fadfd7061f61517606f399cd Jun 10 11:35:41.959281 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.959251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:41.961911 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.961894 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 11:35:41.971905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.971886 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 11:35:41.982276 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:41.982258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7jwn\" (UniqueName: \"kubernetes.io/projected/85949759-f0f7-4479-9fe5-def17f7eb285-kube-api-access-w7jwn\") pod \"network-check-target-2fc8l\" (UID: \"85949759-f0f7-4479-9fe5-def17f7eb285\") " pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:42.143209 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.143142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzpr" Jun 10 11:35:42.150817 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.150796 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nt55\"" Jun 10 11:35:42.158678 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.158665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:42.285328 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.285295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" event={"ID":"a70249ba-9c52-4087-997b-cfa3cea57a0a","Type":"ContainerStarted","Data":"40900734256eb736332d8058029a056dd2bf3c26fadfd7061f61517606f399cd"} Jun 10 11:35:42.312562 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.312530 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nzpr"] Jun 10 11:35:42.315908 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:35:42.315864 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842bdaf9_d1c6_4228_b276_a461c295e0e2.slice/crio-bbd176ac4334092a96d2cb7532bc9d61bce43b72444cb7d7a99ea2b81f1edfac WatchSource:0}: Error finding container bbd176ac4334092a96d2cb7532bc9d61bce43b72444cb7d7a99ea2b81f1edfac: Status 404 returned error can't find the container with id bbd176ac4334092a96d2cb7532bc9d61bce43b72444cb7d7a99ea2b81f1edfac Jun 10 11:35:42.337749 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:42.337727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2fc8l"] Jun 10 11:35:42.340092 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:35:42.340065 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85949759_f0f7_4479_9fe5_def17f7eb285.slice/crio-7744c2b4bbb43d50b44606d9eaf2d3229c0f673708013f2480656e573ef70d9b WatchSource:0}: Error finding container 7744c2b4bbb43d50b44606d9eaf2d3229c0f673708013f2480656e573ef70d9b: Status 404 returned error can't find the container with id 7744c2b4bbb43d50b44606d9eaf2d3229c0f673708013f2480656e573ef70d9b Jun 10 11:35:43.291242 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:43.291199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nzpr" event={"ID":"842bdaf9-d1c6-4228-b276-a461c295e0e2","Type":"ContainerStarted","Data":"bbd176ac4334092a96d2cb7532bc9d61bce43b72444cb7d7a99ea2b81f1edfac"} Jun 10 11:35:43.293055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:43.292996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2fc8l" event={"ID":"85949759-f0f7-4479-9fe5-def17f7eb285","Type":"ContainerStarted","Data":"7744c2b4bbb43d50b44606d9eaf2d3229c0f673708013f2480656e573ef70d9b"} Jun 10 11:35:47.307068 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.306980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" event={"ID":"a70249ba-9c52-4087-997b-cfa3cea57a0a","Type":"ContainerStarted","Data":"259040a25d4f7d0ddb310f60223b1301591e35dfc09d2ccb4073502404e51238"} Jun 10 11:35:47.308471 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.308446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nzpr" event={"ID":"842bdaf9-d1c6-4228-b276-a461c295e0e2","Type":"ContainerStarted","Data":"63c0619c110f7be4174a63843b0c874f8d39f7fcc40123b58c42a8dfeb31efaf"} Jun 10 11:35:47.309840 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.309819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2fc8l" event={"ID":"85949759-f0f7-4479-9fe5-def17f7eb285","Type":"ContainerStarted","Data":"8220db26973cf2207a0d6804b9799abe1c5e886d56fef39bc96ceb27cd03971d"} Jun 10 11:35:47.309999 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.309988 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:35:47.323446 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.323394 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" podStartSLOduration=1.258306849 podStartE2EDuration="6.323376599s" totalImagesPullingTime="5.06506975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:47.322855202 +0000 UTC m=+71.751034434" watchObservedRunningTime="2026-06-10 11:35:47.323376599 +0000 UTC m=+71.751555832" Jun 10 11:35:47.337976 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.337935 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2fc8l" podStartSLOduration=66.718264194 podStartE2EDuration="1m11.337920125s" totalImagesPullingTime="4.619655931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:47.337200184 +0000 UTC m=+71.765379420" watchObservedRunningTime="2026-06-10 11:35:47.337920125 +0000 UTC m=+71.766099356" Jun 10 11:35:47.352619 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:35:47.352552 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8nzpr" podStartSLOduration=66.70341065 podStartE2EDuration="1m11.35253495s" totalImagesPullingTime="4.6491243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:35:47.35240608 +0000 UTC m=+71.780585311" watchObservedRunningTime="2026-06-10 11:35:47.35253495 +0000 UTC m=+71.780714179" Jun 10 11:36:13.381702 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:36:13.381670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:36:13.382298 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:36:13.381788 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:36:13.382298 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:36:13.381837 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:37:17.381823269 +0000 UTC m=+161.810002478 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:36:18.314540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:36:18.314507 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2fc8l" Jun 10 11:36:45.795337 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:36:45.795301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:36:45.795834 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:36:45.795424 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 11:36:45.795834 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:36:45.795513 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:38:47.79549755 +0000 UTC m=+252.223676760 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : secret "metrics-daemon-secret" not found Jun 10 11:37:12.460932 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:37:12.460889 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wfb4d" podUID="4c305467-2273-4e5d-9f9b-d2c1ce84db9e" Jun 10 11:37:12.510852 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:12.510825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:37:13.037841 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:37:13.037804 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:37:17.408484 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:17.408379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:37:17.408980 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:37:17.408506 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 11:37:17.408980 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:37:17.408560 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls podName:4c305467-2273-4e5d-9f9b-d2c1ce84db9e nodeName:}" failed. No retries permitted until 2026-06-10 11:39:19.408544491 +0000 UTC m=+283.836723701 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls") pod "dns-default-wfb4d" (UID: "4c305467-2273-4e5d-9f9b-d2c1ce84db9e") : secret "dns-default-metrics-tls" not found Jun 10 11:37:27.026715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:27.026677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:37:47.594272 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:47.594240 2563 generic.go:356] "Generic (PLEG): container finished" podID="a70249ba-9c52-4087-997b-cfa3cea57a0a" containerID="259040a25d4f7d0ddb310f60223b1301591e35dfc09d2ccb4073502404e51238" exitCode=255 Jun 10 11:37:47.594651 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:47.594325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" event={"ID":"a70249ba-9c52-4087-997b-cfa3cea57a0a","Type":"ContainerDied","Data":"259040a25d4f7d0ddb310f60223b1301591e35dfc09d2ccb4073502404e51238"} Jun 10 11:37:47.599838 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:47.599821 2563 scope.go:117] "RemoveContainer" containerID="259040a25d4f7d0ddb310f60223b1301591e35dfc09d2ccb4073502404e51238" Jun 10 11:37:48.600180 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:37:48.600141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6984558d98-5cbgk" event={"ID":"a70249ba-9c52-4087-997b-cfa3cea57a0a","Type":"ContainerStarted","Data":"37cbedd6a3d23e289780bbe7e68b49c168a092cee7b74c39af8fe15f3b150c43"} Jun 10 11:38:37.279341 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.279307 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-74wk7"] Jun 10 11:38:37.280975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.280960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.284885 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.284848 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:38:37.284885 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.284856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 11:38:37.285138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.285125 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-74r5w\"" Jun 10 11:38:37.285842 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.285824 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 11:38:37.285998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.285903 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 11:38:37.290576 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.290559 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 11:38:37.301806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.301789 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-74wk7"] Jun 10 11:38:37.361666 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.361641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-trusted-ca\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.361824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.361674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-config\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.361824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.361706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a3f4909-cca5-4fe5-bd17-3237402c8d59-serving-cert\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.361824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.361768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2rrk\" (UniqueName: \"kubernetes.io/projected/5a3f4909-cca5-4fe5-bd17-3237402c8d59-kube-api-access-q2rrk\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.372046 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.372017 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl"] Jun 10 11:38:37.373710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.373696 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.376308 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.376284 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2mbf9\"" Jun 10 11:38:37.376458 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.376438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 11:38:37.376509 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.376442 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:38:37.376785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.376751 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d4556dc89-rh2gn"] Jun 10 11:38:37.378300 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.378284 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:38:37.378416 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.378395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.379633 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.379614 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 11:38:37.379948 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.379933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.381422 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.381403 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 11:38:37.381422 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.381413 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 11:38:37.382367 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.382351 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 11:38:37.382439 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.382430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 11:38:37.382485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.382435 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4fw6t\"" Jun 10 11:38:37.382485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.382435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 11:38:37.383775 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.383761 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 11:38:37.383975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.383961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 11:38:37.384107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.384092 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 11:38:37.384823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.384801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzlkv\"" Jun 10 11:38:37.384924 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.384858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 11:38:37.385151 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.385135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 11:38:37.389486 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.389465 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 11:38:37.395311 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.395257 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl"] Jun 10 11:38:37.399334 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.399309 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:38:37.400165 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.400145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d4556dc89-rh2gn"] Jun 10 11:38:37.462737 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a3f4909-cca5-4fe5-bd17-3237402c8d59-serving-cert\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.462840 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbc3682-3aeb-4111-bebb-1ad435647e1e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.462840 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.462840 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.462840 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-stats-auth\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhkd\" (UniqueName: \"kubernetes.io/projected/b036be94-0925-4861-9276-419804b2655c-kube-api-access-flhkd\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-trusted-ca\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.462979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-config\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.463016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463249 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6n5c\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463249 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463353 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2rrk\" (UniqueName: \"kubernetes.io/projected/5a3f4909-cca5-4fe5-bd17-3237402c8d59-kube-api-access-q2rrk\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.463353 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbc3682-3aeb-4111-bebb-1ad435647e1e-config\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.463353 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-default-certificate\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.463353 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhlkp\" (UniqueName: \"kubernetes.io/projected/5bbc3682-3aeb-4111-bebb-1ad435647e1e-kube-api-access-nhlkp\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.463549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.463549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.463770 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463752 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-trusted-ca\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.463824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.463767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a3f4909-cca5-4fe5-bd17-3237402c8d59-config\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.465147 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.465131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a3f4909-cca5-4fe5-bd17-3237402c8d59-serving-cert\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.470634 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.470613 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2rrk\" (UniqueName: \"kubernetes.io/projected/5a3f4909-cca5-4fe5-bd17-3237402c8d59-kube-api-access-q2rrk\") pod \"console-operator-668fdbf85c-74wk7\" (UID: \"5a3f4909-cca5-4fe5-bd17-3237402c8d59\") " pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.563898 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbc3682-3aeb-4111-bebb-1ad435647e1e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.563898 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.563898 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-stats-auth\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhkd\" (UniqueName: \"kubernetes.io/projected/b036be94-0925-4861-9276-419804b2655c-kube-api-access-flhkd\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.563983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6n5c\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbc3682-3aeb-4111-bebb-1ad435647e1e-config\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.564129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-default-certificate\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564149 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:38.064127774 +0000 UTC m=+242.492307005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhlkp\" (UniqueName: \"kubernetes.io/projected/5bbc3682-3aeb-4111-bebb-1ad435647e1e-kube-api-access-nhlkp\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564443 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564489 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:38.06447338 +0000 UTC m=+242.492652591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : secret "router-metrics-certs-default" not found Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564511 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.564570 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564525 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcc5f96cb-2rr2t: secret "image-registry-tls" not found Jun 10 11:38:37.565108 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:37.564605 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls podName:13d365f5-4eae-46d3-b9de-d386fee8b5d3 nodeName:}" failed. No retries permitted until 2026-06-10 11:38:38.064587257 +0000 UTC m=+242.492766488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls") pod "image-registry-6bcc5f96cb-2rr2t" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3") : secret "image-registry-tls" not found Jun 10 11:38:37.565108 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.564891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.565108 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.565089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.565278 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.565188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbc3682-3aeb-4111-bebb-1ad435647e1e-config\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.566640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.566605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-default-certificate\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.566794 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.566776 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.571178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.566862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-stats-auth\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.571178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.567276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbc3682-3aeb-4111-bebb-1ad435647e1e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.571178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.567607 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.573136 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.573107 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.573311 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.573292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhlkp\" (UniqueName: \"kubernetes.io/projected/5bbc3682-3aeb-4111-bebb-1ad435647e1e-kube-api-access-nhlkp\") pod \"service-ca-operator-6bc5ff68f5-hm2vl\" (UID: \"5bbc3682-3aeb-4111-bebb-1ad435647e1e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.573563 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.573546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhkd\" (UniqueName: \"kubernetes.io/projected/b036be94-0925-4861-9276-419804b2655c-kube-api-access-flhkd\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:37.574105 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.574088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6n5c\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:37.590164 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.590147 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:37.684284 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.684256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" Jun 10 11:38:37.708496 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.708458 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-74wk7"] Jun 10 11:38:37.711307 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:38:37.711281 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3f4909_cca5_4fe5_bd17_3237402c8d59.slice/crio-8e2fccdb252db04533b1b9e2d961cc7f226a985b03b64a452887e6da8cbbd918 WatchSource:0}: Error finding container 8e2fccdb252db04533b1b9e2d961cc7f226a985b03b64a452887e6da8cbbd918: Status 404 returned error can't find the container with id 8e2fccdb252db04533b1b9e2d961cc7f226a985b03b64a452887e6da8cbbd918 Jun 10 11:38:37.733979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.733951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" event={"ID":"5a3f4909-cca5-4fe5-bd17-3237402c8d59","Type":"ContainerStarted","Data":"8e2fccdb252db04533b1b9e2d961cc7f226a985b03b64a452887e6da8cbbd918"} Jun 10 11:38:37.806239 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:37.806211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl"] Jun 10 11:38:37.808941 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:38:37.808913 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbc3682_3aeb_4111_bebb_1ad435647e1e.slice/crio-f3538125db4d1abc061dff537f961c663bbf68d531cc221877c9ebda0696c6e0 WatchSource:0}: Error finding container f3538125db4d1abc061dff537f961c663bbf68d531cc221877c9ebda0696c6e0: Status 404 returned error can't find the container with id f3538125db4d1abc061dff537f961c663bbf68d531cc221877c9ebda0696c6e0 Jun 10 11:38:38.069400 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:38.069363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:38.069589 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:38.069437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:38.069589 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:38.069483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:38.069589 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069513 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:38:38.069589 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069534 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcc5f96cb-2rr2t: secret "image-registry-tls" not found Jun 10 11:38:38.069751 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069595 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:38:38.069751 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069606 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls podName:13d365f5-4eae-46d3-b9de-d386fee8b5d3 nodeName:}" failed. No retries permitted until 2026-06-10 11:38:39.069582893 +0000 UTC m=+243.497762123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls") pod "image-registry-6bcc5f96cb-2rr2t" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3") : secret "image-registry-tls" not found Jun 10 11:38:38.069751 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069626 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:39.06961646 +0000 UTC m=+243.497795673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:38.069751 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:38.069654 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:39.069632619 +0000 UTC m=+243.497811830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : secret "router-metrics-certs-default" not found Jun 10 11:38:38.738881 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:38.738831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" event={"ID":"5bbc3682-3aeb-4111-bebb-1ad435647e1e","Type":"ContainerStarted","Data":"f3538125db4d1abc061dff537f961c663bbf68d531cc221877c9ebda0696c6e0"} Jun 10 11:38:39.077054 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:39.076951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:39.077054 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:39.077034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:39.077281 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:39.077095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:39.077281 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077248 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:41.077228857 +0000 UTC m=+245.505408071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:39.077524 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077495 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:38:39.077653 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077533 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:38:39.077653 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:41.07754028 +0000 UTC m=+245.505719507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : secret "router-metrics-certs-default" not found Jun 10 11:38:39.077653 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077556 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcc5f96cb-2rr2t: secret "image-registry-tls" not found Jun 10 11:38:39.077653 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:39.077623 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls podName:13d365f5-4eae-46d3-b9de-d386fee8b5d3 nodeName:}" failed. No retries permitted until 2026-06-10 11:38:41.077604912 +0000 UTC m=+245.505784144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls") pod "image-registry-6bcc5f96cb-2rr2t" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3") : secret "image-registry-tls" not found Jun 10 11:38:40.745728 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.745688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" event={"ID":"5bbc3682-3aeb-4111-bebb-1ad435647e1e","Type":"ContainerStarted","Data":"75a8bb5a014a4c3798e2eb8a3f446aa54054a6b1aac19729c57c992dcfdb4d12"} Jun 10 11:38:40.747437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.747413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/0.log" Jun 10 11:38:40.747558 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.747454 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" containerID="91bc59b3418613f8045e35b8b72ec870ba761de23452e565fcb993c48e97efba" exitCode=255 Jun 10 11:38:40.747558 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.747485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" event={"ID":"5a3f4909-cca5-4fe5-bd17-3237402c8d59","Type":"ContainerDied","Data":"91bc59b3418613f8045e35b8b72ec870ba761de23452e565fcb993c48e97efba"} Jun 10 11:38:40.747684 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.747669 2563 scope.go:117] "RemoveContainer" containerID="91bc59b3418613f8045e35b8b72ec870ba761de23452e565fcb993c48e97efba" Jun 10 11:38:40.764687 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:40.764645 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" podStartSLOduration=2.133963284 podStartE2EDuration="3.764631763s" totalImagesPullingTime="1.630668479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:38:40.763658958 +0000 UTC m=+245.191838207" watchObservedRunningTime="2026-06-10 11:38:40.764631763 +0000 UTC m=+245.192810972" Jun 10 11:38:41.093090 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.093010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:41.093090 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.093069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:41.093249 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.093144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:41.093249 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093226 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:38:41.093249 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093245 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcc5f96cb-2rr2t: secret "image-registry-tls" not found Jun 10 11:38:41.093350 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093233 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:38:41.093350 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093307 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls podName:13d365f5-4eae-46d3-b9de-d386fee8b5d3 nodeName:}" failed. No retries permitted until 2026-06-10 11:38:45.093286026 +0000 UTC m=+249.521465255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls") pod "image-registry-6bcc5f96cb-2rr2t" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3") : secret "image-registry-tls" not found Jun 10 11:38:41.093350 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093348 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:45.093331375 +0000 UTC m=+249.521510589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:41.093448 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.093362 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:45.093353562 +0000 UTC m=+249.521532771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : secret "router-metrics-certs-default" not found Jun 10 11:38:41.712166 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.712133 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn"] Jun 10 11:38:41.714063 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.714047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" Jun 10 11:38:41.719106 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.719085 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 11:38:41.719229 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.719127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-s2gmg\"" Jun 10 11:38:41.723506 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.723491 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 11:38:41.735764 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.735736 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn"] Jun 10 11:38:41.751235 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/1.log" Jun 10 11:38:41.751617 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/0.log" Jun 10 11:38:41.751680 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751636 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" exitCode=255 Jun 10 11:38:41.751733 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" event={"ID":"5a3f4909-cca5-4fe5-bd17-3237402c8d59","Type":"ContainerDied","Data":"162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72"} Jun 10 11:38:41.751791 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751770 2563 scope.go:117] "RemoveContainer" containerID="91bc59b3418613f8045e35b8b72ec870ba761de23452e565fcb993c48e97efba" Jun 10 11:38:41.751950 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.751937 2563 scope.go:117] "RemoveContainer" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" Jun 10 11:38:41.752123 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:41.752102 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:38:41.797760 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.797729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25sgj\" (UniqueName: \"kubernetes.io/projected/be311aeb-979f-47f2-aa45-5996de79f3ab-kube-api-access-25sgj\") pod \"migrator-955ffdf5f-szvwn\" (UID: \"be311aeb-979f-47f2-aa45-5996de79f3ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" Jun 10 11:38:41.899172 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.899141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25sgj\" (UniqueName: \"kubernetes.io/projected/be311aeb-979f-47f2-aa45-5996de79f3ab-kube-api-access-25sgj\") pod \"migrator-955ffdf5f-szvwn\" (UID: \"be311aeb-979f-47f2-aa45-5996de79f3ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" Jun 10 11:38:41.906988 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:41.906958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sgj\" (UniqueName: \"kubernetes.io/projected/be311aeb-979f-47f2-aa45-5996de79f3ab-kube-api-access-25sgj\") pod \"migrator-955ffdf5f-szvwn\" (UID: \"be311aeb-979f-47f2-aa45-5996de79f3ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" Jun 10 11:38:42.021809 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:42.021739 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" Jun 10 11:38:42.142031 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:42.142001 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn"] Jun 10 11:38:42.145175 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:38:42.145144 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe311aeb_979f_47f2_aa45_5996de79f3ab.slice/crio-8ac61b3bce23012015a997d12ac360c87572c36c73c522cf294922840609204b WatchSource:0}: Error finding container 8ac61b3bce23012015a997d12ac360c87572c36c73c522cf294922840609204b: Status 404 returned error can't find the container with id 8ac61b3bce23012015a997d12ac360c87572c36c73c522cf294922840609204b Jun 10 11:38:42.756014 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:42.755980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" event={"ID":"be311aeb-979f-47f2-aa45-5996de79f3ab","Type":"ContainerStarted","Data":"8ac61b3bce23012015a997d12ac360c87572c36c73c522cf294922840609204b"} Jun 10 11:38:42.757743 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:42.757719 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/1.log" Jun 10 11:38:42.758119 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:42.758095 2563 scope.go:117] "RemoveContainer" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" Jun 10 11:38:42.758302 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:42.758277 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:38:43.511398 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:43.511372 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jsrxk_b3e746f5-1d3e-4e49-8f33-14ffaf17075b/dns-node-resolver/0.log" Jun 10 11:38:43.762678 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:43.762591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" event={"ID":"be311aeb-979f-47f2-aa45-5996de79f3ab","Type":"ContainerStarted","Data":"4327388d22cd8690c9a7b6c5ce74de730077df1c3b4b81196d65c1db6af0f0a2"} Jun 10 11:38:43.762678 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:43.762636 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" event={"ID":"be311aeb-979f-47f2-aa45-5996de79f3ab","Type":"ContainerStarted","Data":"1e144957892bca426e91f0d84074730c053bf784959dd9a09e93671e159ce06f"} Jun 10 11:38:43.780233 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:43.780189 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-szvwn" podStartSLOduration=1.857292795 podStartE2EDuration="2.780173834s" totalImagesPullingTime="922.881039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:38:43.778662565 +0000 UTC m=+248.206841797" watchObservedRunningTime="2026-06-10 11:38:43.780173834 +0000 UTC m=+248.208353066" Jun 10 11:38:44.114597 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:44.114518 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxs9t_bc2b91ec-a050-43ce-94e3-19dc93a050ee/node-ca/0.log" Jun 10 11:38:45.111816 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:45.111792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvbcb_38187b12-9c42-4730-819c-c849ad36e361/serve-healthcheck-canary/0.log" Jun 10 11:38:45.123998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:45.123973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:45.124107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:45.124020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:45.124107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:45.124054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:45.124173 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124118 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:53.124101588 +0000 UTC m=+257.552280797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:45.124173 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124150 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 11:38:45.124245 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124174 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 11:38:45.124245 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124193 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcc5f96cb-2rr2t: secret "image-registry-tls" not found Jun 10 11:38:45.124245 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124197 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:38:53.124185463 +0000 UTC m=+257.552364674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : secret "router-metrics-certs-default" not found Jun 10 11:38:45.124245 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:45.124228 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls podName:13d365f5-4eae-46d3-b9de-d386fee8b5d3 nodeName:}" failed. No retries permitted until 2026-06-10 11:38:53.124217526 +0000 UTC m=+257.552396736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls") pod "image-registry-6bcc5f96cb-2rr2t" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3") : secret "image-registry-tls" not found Jun 10 11:38:47.590336 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:47.590253 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:47.590336 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:47.590335 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:38:47.590706 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:47.590677 2563 scope.go:117] "RemoveContainer" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" Jun 10 11:38:47.590836 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:47.590814 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:38:47.843234 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:47.843153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:38:47.843376 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:47.843288 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 11:38:47.843376 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:47.843359 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs podName:3606f559-9ccd-442d-b721-3360bf17f37a nodeName:}" failed. No retries permitted until 2026-06-10 11:40:49.843343482 +0000 UTC m=+374.271522692 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs") pod "network-metrics-daemon-gpx7m" (UID: "3606f559-9ccd-442d-b721-3360bf17f37a") : secret "metrics-daemon-secret" not found Jun 10 11:38:53.189859 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.189821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:53.190346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.189908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:53.190346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.189971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:53.190346 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:38:53.189988 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle podName:b036be94-0925-4861-9276-419804b2655c nodeName:}" failed. No retries permitted until 2026-06-10 11:39:09.189969151 +0000 UTC m=+273.618148373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle") pod "router-default-d4556dc89-rh2gn" (UID: "b036be94-0925-4861-9276-419804b2655c") : configmap references non-existent config key: service-ca.crt Jun 10 11:38:53.192254 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.192230 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b036be94-0925-4861-9276-419804b2655c-metrics-certs\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:38:53.192358 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.192287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"image-registry-6bcc5f96cb-2rr2t\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:53.295442 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.295406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:53.423557 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.423529 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:38:53.426475 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:38:53.426451 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d365f5_4eae_46d3_b9de_d386fee8b5d3.slice/crio-8ad567ca8c1dfbe38b9a38c04fae680f4d2f055951ac3cc5360f7b15e6ea7375 WatchSource:0}: Error finding container 8ad567ca8c1dfbe38b9a38c04fae680f4d2f055951ac3cc5360f7b15e6ea7375: Status 404 returned error can't find the container with id 8ad567ca8c1dfbe38b9a38c04fae680f4d2f055951ac3cc5360f7b15e6ea7375 Jun 10 11:38:53.794492 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.794423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" event={"ID":"13d365f5-4eae-46d3-b9de-d386fee8b5d3","Type":"ContainerStarted","Data":"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da"} Jun 10 11:38:53.794492 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.794466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" event={"ID":"13d365f5-4eae-46d3-b9de-d386fee8b5d3","Type":"ContainerStarted","Data":"8ad567ca8c1dfbe38b9a38c04fae680f4d2f055951ac3cc5360f7b15e6ea7375"} Jun 10 11:38:53.794672 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.794560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:38:53.817809 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:38:53.817757 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" podStartSLOduration=16.817741885 podStartE2EDuration="16.817741885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:38:53.816476692 +0000 UTC m=+258.244655922" watchObservedRunningTime="2026-06-10 11:38:53.817741885 +0000 UTC m=+258.245921114" Jun 10 11:39:03.026986 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.026955 2563 scope.go:117] "RemoveContainer" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" Jun 10 11:39:03.823911 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.823858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:39:03.824290 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.824272 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/1.log" Jun 10 11:39:03.824393 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.824310 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" containerID="69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08" exitCode=255 Jun 10 11:39:03.824393 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.824364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" event={"ID":"5a3f4909-cca5-4fe5-bd17-3237402c8d59","Type":"ContainerDied","Data":"69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08"} Jun 10 11:39:03.824497 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.824421 2563 scope.go:117] "RemoveContainer" containerID="162ba82b99553ac61007d5ebdf804de15099eef8ea175b1896755bbee5ec7b72" Jun 10 11:39:03.824710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:03.824693 2563 scope.go:117] "RemoveContainer" containerID="69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08" Jun 10 11:39:03.824898 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:03.824859 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:39:04.452552 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.452525 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:39:04.537307 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.537273 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cc57t"] Jun 10 11:39:04.540370 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.540352 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.543548 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.543531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 11:39:04.543748 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.543725 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 11:39:04.544067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.544046 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7lcrh\"" Jun 10 11:39:04.544159 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.544046 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 11:39:04.544159 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.544099 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 11:39:04.559669 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.559646 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc57t"] Jun 10 11:39:04.670189 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.670161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697a1386-927d-4d1f-a750-a0b48a2f028c-crio-socket\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.670357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.670197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697a1386-927d-4d1f-a750-a0b48a2f028c-data-volume\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.670357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.670215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.670357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.670286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkg6\" (UniqueName: \"kubernetes.io/projected/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-api-access-fpkg6\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.670357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.670331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697a1386-927d-4d1f-a750-a0b48a2f028c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771070 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.770995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697a1386-927d-4d1f-a750-a0b48a2f028c-data-volume\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771070 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771268 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkg6\" (UniqueName: \"kubernetes.io/projected/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-api-access-fpkg6\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771268 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697a1386-927d-4d1f-a750-a0b48a2f028c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771268 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697a1386-927d-4d1f-a750-a0b48a2f028c-crio-socket\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/697a1386-927d-4d1f-a750-a0b48a2f028c-crio-socket\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/697a1386-927d-4d1f-a750-a0b48a2f028c-data-volume\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.771585 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.771566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.773461 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.773443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/697a1386-927d-4d1f-a750-a0b48a2f028c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.779895 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.779863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkg6\" (UniqueName: \"kubernetes.io/projected/697a1386-927d-4d1f-a750-a0b48a2f028c-kube-api-access-fpkg6\") pod \"insights-runtime-extractor-cc57t\" (UID: \"697a1386-927d-4d1f-a750-a0b48a2f028c\") " pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.829611 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.829592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:39:04.849443 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.849419 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cc57t" Jun 10 11:39:04.970445 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:04.970425 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cc57t"] Jun 10 11:39:04.972844 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:04.972816 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697a1386_927d_4d1f_a750_a0b48a2f028c.slice/crio-cba616e26e4dc631495662af14c30d654b5bc24899b1f2d6d76778c74ec88ed3 WatchSource:0}: Error finding container cba616e26e4dc631495662af14c30d654b5bc24899b1f2d6d76778c74ec88ed3: Status 404 returned error can't find the container with id cba616e26e4dc631495662af14c30d654b5bc24899b1f2d6d76778c74ec88ed3 Jun 10 11:39:05.835960 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:05.835927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc57t" event={"ID":"697a1386-927d-4d1f-a750-a0b48a2f028c","Type":"ContainerStarted","Data":"af6e94b0ab42d33f9ff4aca721c67e3609a560cd82b60d97cfbd133fba7f9fc2"} Jun 10 11:39:05.836357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:05.836011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc57t" event={"ID":"697a1386-927d-4d1f-a750-a0b48a2f028c","Type":"ContainerStarted","Data":"3da0bea01d43656aebc5beaea5815d4894c85ab90f007fbc1d0293059bf46480"} Jun 10 11:39:05.836357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:05.836032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc57t" event={"ID":"697a1386-927d-4d1f-a750-a0b48a2f028c","Type":"ContainerStarted","Data":"cba616e26e4dc631495662af14c30d654b5bc24899b1f2d6d76778c74ec88ed3"} Jun 10 11:39:07.590735 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:07.590702 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:39:07.591111 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:07.590763 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:39:07.591111 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:07.591063 2563 scope.go:117] "RemoveContainer" containerID="69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08" Jun 10 11:39:07.591221 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:07.591202 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:39:07.844707 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:07.844624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cc57t" event={"ID":"697a1386-927d-4d1f-a750-a0b48a2f028c","Type":"ContainerStarted","Data":"c888c90905abbb64f777510751438f0532696d54d09753ec8f8a2083ae233bec"} Jun 10 11:39:07.864817 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:07.864766 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cc57t" podStartSLOduration=1.298257746 podStartE2EDuration="3.864753667s" totalImagesPullingTime="2.566495921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 11:39:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:07.863664835 +0000 UTC m=+272.291844067" watchObservedRunningTime="2026-06-10 11:39:07.864753667 +0000 UTC m=+272.292932899" Jun 10 11:39:09.206216 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.206181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:09.206707 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.206690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b036be94-0925-4861-9276-419804b2655c-service-ca-bundle\") pod \"router-default-d4556dc89-rh2gn\" (UID: \"b036be94-0925-4861-9276-419804b2655c\") " pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:09.490741 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.490657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:09.617662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.617634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d4556dc89-rh2gn"] Jun 10 11:39:09.620626 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:09.620601 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb036be94_0925_4861_9276_419804b2655c.slice/crio-8bfdada44e1edde17eed84ec9c10b05782798e84a69d12c05d42947564a6fcae WatchSource:0}: Error finding container 8bfdada44e1edde17eed84ec9c10b05782798e84a69d12c05d42947564a6fcae: Status 404 returned error can't find the container with id 8bfdada44e1edde17eed84ec9c10b05782798e84a69d12c05d42947564a6fcae Jun 10 11:39:09.851754 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.851682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d4556dc89-rh2gn" event={"ID":"b036be94-0925-4861-9276-419804b2655c","Type":"ContainerStarted","Data":"638d7dc5bfa2280172413a5043d1aeff77726a974ec53728a96903df3c020ff2"} Jun 10 11:39:09.851754 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.851728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d4556dc89-rh2gn" event={"ID":"b036be94-0925-4861-9276-419804b2655c","Type":"ContainerStarted","Data":"8bfdada44e1edde17eed84ec9c10b05782798e84a69d12c05d42947564a6fcae"} Jun 10 11:39:09.873760 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:09.873716 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-d4556dc89-rh2gn" podStartSLOduration=32.873700944 podStartE2EDuration="32.873700944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:09.873200857 +0000 UTC m=+274.301380089" watchObservedRunningTime="2026-06-10 11:39:09.873700944 +0000 UTC m=+274.301880176" Jun 10 11:39:10.491057 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:10.491024 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:10.493695 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:10.493675 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:10.854975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:10.854899 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:10.856066 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:10.856048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d4556dc89-rh2gn" Jun 10 11:39:14.457489 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:14.457465 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:39:15.511752 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:15.511705 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wfb4d" podUID="4c305467-2273-4e5d-9f9b-d2c1ce84db9e" Jun 10 11:39:15.869238 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:15.869162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:19.483783 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:19.483732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:19.486032 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:19.486011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c305467-2273-4e5d-9f9b-d2c1ce84db9e-metrics-tls\") pod \"dns-default-wfb4d\" (UID: \"4c305467-2273-4e5d-9f9b-d2c1ce84db9e\") " pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:19.772593 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:19.772523 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-98p9t\"" Jun 10 11:39:19.780523 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:19.780498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:19.902588 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:19.902559 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wfb4d"] Jun 10 11:39:19.905604 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:19.905581 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c305467_2273_4e5d_9f9b_d2c1ce84db9e.slice/crio-d4fc76ff6931ba62cb4af1e4f0ed8d1856154fe6d3a576ef6928f03cc202d2c4 WatchSource:0}: Error finding container d4fc76ff6931ba62cb4af1e4f0ed8d1856154fe6d3a576ef6928f03cc202d2c4: Status 404 returned error can't find the container with id d4fc76ff6931ba62cb4af1e4f0ed8d1856154fe6d3a576ef6928f03cc202d2c4 Jun 10 11:39:20.886326 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:20.886284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfb4d" event={"ID":"4c305467-2273-4e5d-9f9b-d2c1ce84db9e","Type":"ContainerStarted","Data":"d4fc76ff6931ba62cb4af1e4f0ed8d1856154fe6d3a576ef6928f03cc202d2c4"} Jun 10 11:39:21.361984 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.361949 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7x78g"] Jun 10 11:39:21.364579 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.364554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.368147 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.368106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 11:39:21.368264 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.368144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xh45z\"" Jun 10 11:39:21.368964 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.368788 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 11:39:21.369204 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.369180 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 11:39:21.371501 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.371449 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 11:39:21.371501 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.371455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 11:39:21.371674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.371476 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 11:39:21.501824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.501799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.501952 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.501833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-sys\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.501952 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.501855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4zw4\" (UniqueName: \"kubernetes.io/projected/bb85417b-bc0f-4aca-893f-4d85037d5985-kube-api-access-b4zw4\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.501952 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.501923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-accelerators-collector-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.502067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.501954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-metrics-client-ca\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.502067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.502049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-root\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.502139 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.502118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.502176 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.502159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-textfile\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.502209 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.502175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-wtmp\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602501 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-textfile\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-wtmp\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-sys\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4zw4\" (UniqueName: \"kubernetes.io/projected/bb85417b-bc0f-4aca-893f-4d85037d5985-kube-api-access-b4zw4\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602646 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-accelerators-collector-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-sys\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:21.602670 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-metrics-client-ca\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-wtmp\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:21.602744 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls podName:bb85417b-bc0f-4aca-893f-4d85037d5985 nodeName:}" failed. No retries permitted until 2026-06-10 11:39:22.102718712 +0000 UTC m=+286.530897946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls") pod "node-exporter-7x78g" (UID: "bb85417b-bc0f-4aca-893f-4d85037d5985") : secret "node-exporter-tls" not found Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-textfile\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-root\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb85417b-bc0f-4aca-893f-4d85037d5985-root\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.602919 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.602855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.603218 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.603159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-metrics-client-ca\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.603218 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.603163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-accelerators-collector-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.604904 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.604885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.611833 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.611817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4zw4\" (UniqueName: \"kubernetes.io/projected/bb85417b-bc0f-4aca-893f-4d85037d5985-kube-api-access-b4zw4\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:21.890773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.890695 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfb4d" event={"ID":"4c305467-2273-4e5d-9f9b-d2c1ce84db9e","Type":"ContainerStarted","Data":"12359f05ef9eef63275bf908220e9170120fd155112b7641264cc70b86038a99"} Jun 10 11:39:21.890773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.890745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wfb4d" event={"ID":"4c305467-2273-4e5d-9f9b-d2c1ce84db9e","Type":"ContainerStarted","Data":"79fde3b5b829c07e6a0b3e6155fe33c1ce0ec21b0b405c2aed81b6bb62c53ce2"} Jun 10 11:39:21.891185 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.890812 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:21.913946 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:21.913905 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wfb4d" podStartSLOduration=251.368209185 podStartE2EDuration="4m12.913889343s" totalImagesPullingTime="1.545680158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:21.912629563 +0000 UTC m=+286.340808795" watchObservedRunningTime="2026-06-10 11:39:21.913889343 +0000 UTC m=+286.342068569" Jun 10 11:39:22.106736 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.106692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:22.109055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.109032 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb85417b-bc0f-4aca-893f-4d85037d5985-node-exporter-tls\") pod \"node-exporter-7x78g\" (UID: \"bb85417b-bc0f-4aca-893f-4d85037d5985\") " pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:22.277342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.277302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7x78g" Jun 10 11:39:22.288637 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:22.288607 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb85417b_bc0f_4aca_893f_4d85037d5985.slice/crio-e2cc991c5ad7c45884bd94fb9a5528638f5fc11f3694c4a7dd9cf905f584b6da WatchSource:0}: Error finding container e2cc991c5ad7c45884bd94fb9a5528638f5fc11f3694c4a7dd9cf905f584b6da: Status 404 returned error can't find the container with id e2cc991c5ad7c45884bd94fb9a5528638f5fc11f3694c4a7dd9cf905f584b6da Jun 10 11:39:22.510055 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.510023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:39:22.514171 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.514150 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.522563 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.522541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 11:39:22.522680 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.522562 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 11:39:22.522680 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.522541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 11:39:22.522976 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.522959 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 11:39:22.523079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.523004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 11:39:22.523079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.522962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-58cqg\"" Jun 10 11:39:22.523189 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.523086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 11:39:22.523189 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.523092 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 11:39:22.523411 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.523396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 11:39:22.525524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.525507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 11:39:22.547261 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.547211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:39:22.610079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbh5q\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.610521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.610472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.711650 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.711617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh5q\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.711825 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.711683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.711825 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.711709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.711825 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.711738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712001 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:22.711857 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 11:39:22.712001 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:22.711941 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls podName:7dba5b4d-a3a2-4e20-a61f-36e1cf444422 nodeName:}" failed. No retries permitted until 2026-06-10 11:39:23.21192199 +0000 UTC m=+287.640101203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422") : secret "alertmanager-main-tls" not found Jun 10 11:39:22.712001 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.711984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712157 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712157 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712253 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712205 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712309 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712309 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712411 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712411 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712411 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712411 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.712971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.712853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.713454 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.713428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.715346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.715096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.715346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.715310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.715500 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.715447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.715609 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.715584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.715855 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.715833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.716131 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.716110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.716618 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.716595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.717298 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.717274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.722141 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.722123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbh5q\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:22.895324 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:22.895242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7x78g" event={"ID":"bb85417b-bc0f-4aca-893f-4d85037d5985","Type":"ContainerStarted","Data":"e2cc991c5ad7c45884bd94fb9a5528638f5fc11f3694c4a7dd9cf905f584b6da"} Jun 10 11:39:23.026656 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.026622 2563 scope.go:117] "RemoveContainer" containerID="69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08" Jun 10 11:39:23.026848 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:23.026825 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-74wk7_openshift-console-operator(5a3f4909-cca5-4fe5-bd17-3237402c8d59)\"" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podUID="5a3f4909-cca5-4fe5-bd17-3237402c8d59" Jun 10 11:39:23.216614 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.216582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:23.218782 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.218761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:23.423456 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.423430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:39:23.555709 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.555689 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:39:23.558281 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:23.558255 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dba5b4d_a3a2_4e20_a61f_36e1cf444422.slice/crio-e7fbedb1f60b4c474dd64e857da6adc40135a18a1a5cf3da4328b1d2f47fee37 WatchSource:0}: Error finding container e7fbedb1f60b4c474dd64e857da6adc40135a18a1a5cf3da4328b1d2f47fee37: Status 404 returned error can't find the container with id e7fbedb1f60b4c474dd64e857da6adc40135a18a1a5cf3da4328b1d2f47fee37 Jun 10 11:39:23.900045 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.899965 2563 generic.go:356] "Generic (PLEG): container finished" podID="bb85417b-bc0f-4aca-893f-4d85037d5985" containerID="a2f71c4c990f087b47d12e24096a6839eb18a47fc9ccf2c3c62d421e32a57761" exitCode=0 Jun 10 11:39:23.900045 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.900037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7x78g" event={"ID":"bb85417b-bc0f-4aca-893f-4d85037d5985","Type":"ContainerDied","Data":"a2f71c4c990f087b47d12e24096a6839eb18a47fc9ccf2c3c62d421e32a57761"} Jun 10 11:39:23.901268 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:23.901245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"e7fbedb1f60b4c474dd64e857da6adc40135a18a1a5cf3da4328b1d2f47fee37"} Jun 10 11:39:24.905983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:24.905901 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0" exitCode=0 Jun 10 11:39:24.906338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:24.906037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0"} Jun 10 11:39:24.908212 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:24.908192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7x78g" event={"ID":"bb85417b-bc0f-4aca-893f-4d85037d5985","Type":"ContainerStarted","Data":"37a9a598a23ec18d1d7835801406c8957b8589101123a8ab2a4e42c98777ce70"} Jun 10 11:39:24.908348 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:24.908240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7x78g" event={"ID":"bb85417b-bc0f-4aca-893f-4d85037d5985","Type":"ContainerStarted","Data":"24630290c2a8b23bcaa46962305b591ba8af7f135a8f48c369a42830d765f2a7"} Jun 10 11:39:24.951168 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:24.951117 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7x78g" podStartSLOduration=3.072139487 podStartE2EDuration="3.951098311s" totalImagesPullingTime="813.660567ms" totalInitContainerRuntime="65.298257ms" isStatefulPod=true podCreationTimestamp="2026-06-10 11:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:24.949997157 +0000 UTC m=+289.378176400" watchObservedRunningTime="2026-06-10 11:39:24.951098311 +0000 UTC m=+289.379277542" Jun 10 11:39:25.793157 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.793118 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d784c748f-sgknm"] Jun 10 11:39:25.796294 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.796271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.799006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.798979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 11:39:25.799006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.798979 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 11:39:25.799808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.799765 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-s5z7p\"" Jun 10 11:39:25.800195 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.800168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9u8cshba6hvn0\"" Jun 10 11:39:25.800266 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.800201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 11:39:25.800266 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.800237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 11:39:25.813019 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.812995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d784c748f-sgknm"] Jun 10 11:39:25.939472 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmctk\" (UniqueName: \"kubernetes.io/projected/e472ebfb-1544-4f79-8302-18bf29599d6a-kube-api-access-mmctk\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939472 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-metrics-server-audit-profiles\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939934 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939499 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-client-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939934 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e472ebfb-1544-4f79-8302-18bf29599d6a-audit-log\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939934 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-client-certs\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939934 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:25.939934 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:25.939734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-tls\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-metrics-server-audit-profiles\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040450 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-client-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e472ebfb-1544-4f79-8302-18bf29599d6a-audit-log\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-client-certs\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-tls\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.040975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.040755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmctk\" (UniqueName: \"kubernetes.io/projected/e472ebfb-1544-4f79-8302-18bf29599d6a-kube-api-access-mmctk\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.041422 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.041372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e472ebfb-1544-4f79-8302-18bf29599d6a-audit-log\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.041528 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.041502 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-metrics-server-audit-profiles\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.041796 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.041763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e472ebfb-1544-4f79-8302-18bf29599d6a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.043497 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.043432 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-client-ca-bundle\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.044123 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.043761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-client-certs\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.044123 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.044014 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e472ebfb-1544-4f79-8302-18bf29599d6a-secret-metrics-server-tls\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.055198 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.055171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmctk\" (UniqueName: \"kubernetes.io/projected/e472ebfb-1544-4f79-8302-18bf29599d6a-kube-api-access-mmctk\") pod \"metrics-server-6d784c748f-sgknm\" (UID: \"e472ebfb-1544-4f79-8302-18bf29599d6a\") " pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.107221 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.107184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:26.127524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.127497 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq"] Jun 10 11:39:26.130368 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.130351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.132562 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.132543 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g624w\"" Jun 10 11:39:26.132709 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.132691 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 11:39:26.143031 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.143008 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq"] Jun 10 11:39:26.242779 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.242745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72936e51-18f7-483d-917a-d6880431adb5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.242979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.242781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvjmc\" (UniqueName: \"kubernetes.io/projected/72936e51-18f7-483d-917a-d6880431adb5-kube-api-access-kvjmc\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.344296 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.344215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72936e51-18f7-483d-917a-d6880431adb5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.344296 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.344264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvjmc\" (UniqueName: \"kubernetes.io/projected/72936e51-18f7-483d-917a-d6880431adb5-kube-api-access-kvjmc\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.347128 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.347080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72936e51-18f7-483d-917a-d6880431adb5-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.353333 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.353306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvjmc\" (UniqueName: \"kubernetes.io/projected/72936e51-18f7-483d-917a-d6880431adb5-kube-api-access-kvjmc\") pod \"monitoring-plugin-76b68cc874-q6fxq\" (UID: \"72936e51-18f7-483d-917a-d6880431adb5\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.441067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.441044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:26.498653 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.498626 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d784c748f-sgknm"] Jun 10 11:39:26.503232 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:26.503205 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode472ebfb_1544_4f79_8302_18bf29599d6a.slice/crio-7995df1d38540e8867061d0220cea0eb0038abe02a617d0afa8ff90c90fb90f9 WatchSource:0}: Error finding container 7995df1d38540e8867061d0220cea0eb0038abe02a617d0afa8ff90c90fb90f9: Status 404 returned error can't find the container with id 7995df1d38540e8867061d0220cea0eb0038abe02a617d0afa8ff90c90fb90f9 Jun 10 11:39:26.579752 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.579686 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq"] Jun 10 11:39:26.582625 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:26.582599 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72936e51_18f7_483d_917a_d6880431adb5.slice/crio-671351d88b084d078e3a1f802cf40b5a53a88dd1e8604e13c73218cc3f6a732a WatchSource:0}: Error finding container 671351d88b084d078e3a1f802cf40b5a53a88dd1e8604e13c73218cc3f6a732a: Status 404 returned error can't find the container with id 671351d88b084d078e3a1f802cf40b5a53a88dd1e8604e13c73218cc3f6a732a Jun 10 11:39:26.924063 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.924024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8"} Jun 10 11:39:26.924204 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.924137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37"} Jun 10 11:39:26.924204 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.924195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6"} Jun 10 11:39:26.924310 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.924235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72"} Jun 10 11:39:26.924310 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.924267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757"} Jun 10 11:39:26.925138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.925117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" event={"ID":"72936e51-18f7-483d-917a-d6880431adb5","Type":"ContainerStarted","Data":"671351d88b084d078e3a1f802cf40b5a53a88dd1e8604e13c73218cc3f6a732a"} Jun 10 11:39:26.926142 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:26.926120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" event={"ID":"e472ebfb-1544-4f79-8302-18bf29599d6a","Type":"ContainerStarted","Data":"7995df1d38540e8867061d0220cea0eb0038abe02a617d0afa8ff90c90fb90f9"} Jun 10 11:39:28.935638 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.935599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" event={"ID":"72936e51-18f7-483d-917a-d6880431adb5","Type":"ContainerStarted","Data":"1e5e0c85b9f64fe759eadcdcd394db682165c6ac029f45e210262b7201dc5d76"} Jun 10 11:39:28.936107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.935816 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:28.937496 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.937471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" event={"ID":"e472ebfb-1544-4f79-8302-18bf29599d6a","Type":"ContainerStarted","Data":"9c32bcbbd5a377420bd32d8f638a42448345d41bfeb73a05a9e420d873350e27"} Jun 10 11:39:28.940982 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.940959 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" Jun 10 11:39:28.941358 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.941341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerStarted","Data":"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11"} Jun 10 11:39:28.952862 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.952820 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-q6fxq" podStartSLOduration=1.323353469 podStartE2EDuration="2.952773451s" totalImagesPullingTime="1.629419982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:28.951832804 +0000 UTC m=+293.380012039" watchObservedRunningTime="2026-06-10 11:39:28.952773451 +0000 UTC m=+293.380952662" Jun 10 11:39:28.969395 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.969346 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" podStartSLOduration=2.258586706 podStartE2EDuration="3.969329858s" totalImagesPullingTime="1.710743152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:28.969130428 +0000 UTC m=+293.397309659" watchObservedRunningTime="2026-06-10 11:39:28.969329858 +0000 UTC m=+293.397509091" Jun 10 11:39:28.998342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:28.998298 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.943935705 podStartE2EDuration="6.998283902s" totalImagesPullingTime="4.038975748s" totalInitContainerRuntime="15.372449ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:28.996461942 +0000 UTC m=+293.424641198" watchObservedRunningTime="2026-06-10 11:39:28.998283902 +0000 UTC m=+293.426463134" Jun 10 11:39:29.473560 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.473514 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" podUID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" containerName="registry" containerID="cri-o://38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da" gracePeriod=30 Jun 10 11:39:29.707534 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.707510 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:39:29.876230 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876145 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876230 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876192 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876230 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876215 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876250 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876268 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876296 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6n5c\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876317 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876367 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets\") pod \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\" (UID: \"13d365f5-4eae-46d3-b9de-d386fee8b5d3\") " Jun 10 11:39:29.876905 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.876737 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:39:29.877617 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.877584 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:39:29.878636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.878603 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:39:29.878745 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.878656 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:39:29.878805 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.878742 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:39:29.878855 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.878826 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:39:29.878978 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.878910 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c" (OuterVolumeSpecName: "kube-api-access-l6n5c") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "kube-api-access-l6n5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:39:29.885627 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.885600 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13d365f5-4eae-46d3-b9de-d386fee8b5d3" (UID: "13d365f5-4eae-46d3-b9de-d386fee8b5d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:39:29.946168 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.946136 2563 generic.go:356] "Generic (PLEG): container finished" podID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" containerID="38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da" exitCode=0 Jun 10 11:39:29.946460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.946177 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" Jun 10 11:39:29.946460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.946240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" event={"ID":"13d365f5-4eae-46d3-b9de-d386fee8b5d3","Type":"ContainerDied","Data":"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da"} Jun 10 11:39:29.946460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.946286 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcc5f96cb-2rr2t" event={"ID":"13d365f5-4eae-46d3-b9de-d386fee8b5d3","Type":"ContainerDied","Data":"8ad567ca8c1dfbe38b9a38c04fae680f4d2f055951ac3cc5360f7b15e6ea7375"} Jun 10 11:39:29.946460 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.946309 2563 scope.go:117] "RemoveContainer" containerID="38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da" Jun 10 11:39:29.954604 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.954589 2563 scope.go:117] "RemoveContainer" containerID="38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da" Jun 10 11:39:29.954892 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:29.954857 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da\": container with ID starting with 38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da not found: ID does not exist" containerID="38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da" Jun 10 11:39:29.954931 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.954900 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da"} err="failed to get container status \"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da\": rpc error: code = NotFound desc = could not find container \"38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da\": container with ID starting with 38e41447d6166e449a1644a68eb3ee5262e44eceae7d9ebad7055c99a9cce3da not found: ID does not exist" Jun 10 11:39:29.967063 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.967044 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:39:29.970651 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.970631 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bcc5f96cb-2rr2t"] Jun 10 11:39:29.977692 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977669 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-installation-pull-secrets\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977692 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977688 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977697 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-bound-sa-token\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977708 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-registry-certificates\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977716 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d365f5-4eae-46d3-b9de-d386fee8b5d3-trusted-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977725 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d365f5-4eae-46d3-b9de-d386fee8b5d3-image-registry-private-configuration\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977733 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6n5c\" (UniqueName: \"kubernetes.io/projected/13d365f5-4eae-46d3-b9de-d386fee8b5d3-kube-api-access-l6n5c\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:29.977792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:29.977741 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d365f5-4eae-46d3-b9de-d386fee8b5d3-ca-trust-extracted\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:39:30.027539 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:39:30.027498 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gpx7m" podUID="3606f559-9ccd-442d-b721-3360bf17f37a" Jun 10 11:39:30.030926 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:30.030903 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" path="/var/lib/kubelet/pods/13d365f5-4eae-46d3-b9de-d386fee8b5d3/volumes" Jun 10 11:39:31.897596 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:31.897563 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wfb4d" Jun 10 11:39:35.986438 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:35.986409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:39:35.986824 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:35.986475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:39:35.991390 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:35.991369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:39:35.991497 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:35.991369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:39:35.996707 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:35.996689 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 11:39:37.027355 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.027327 2563 scope.go:117] "RemoveContainer" containerID="69000a5d45753c5d8c13fc150b50ef3a3369a42351e340ea02504fc29e9a8f08" Jun 10 11:39:37.976999 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.976973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:39:37.977158 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.977026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" event={"ID":"5a3f4909-cca5-4fe5-bd17-3237402c8d59","Type":"ContainerStarted","Data":"d3b092c456fb9670fddce4f0c2219b34d8e117a5669cfbdc771a23de79966002"} Jun 10 11:39:37.977311 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.977291 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:39:37.981790 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.981769 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" Jun 10 11:39:37.996423 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:37.996365 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-74wk7" podStartSLOduration=58.748346855 podStartE2EDuration="1m0.996346466s" totalImagesPullingTime="2.247999611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:39:37.994246219 +0000 UTC m=+302.422425452" watchObservedRunningTime="2026-06-10 11:39:37.996346466 +0000 UTC m=+302.424525696" Jun 10 11:39:42.026879 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:42.026843 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:39:46.107561 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:46.107523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:46.107974 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:46.107603 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:39:56.357436 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.357395 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:39:56.357801 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.357656 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" containerName="registry" Jun 10 11:39:56.357801 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.357666 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" containerName="registry" Jun 10 11:39:56.357801 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.357708 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d365f5-4eae-46d3-b9de-d386fee8b5d3" containerName="registry" Jun 10 11:39:56.369314 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.369294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.372089 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372065 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:39:56.372303 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372280 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:39:56.372415 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372290 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:39:56.372415 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372317 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:39:56.373001 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372975 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:39:56.373001 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:39:56.373178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.372994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:39:56.373178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.373085 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:39:56.373376 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.373357 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6mvbt\"" Jun 10 11:39:56.377662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.377640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:39:56.473033 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.472994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473033 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473240 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbj9\" (UniqueName: \"kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473240 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473240 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473240 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.473367 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.473240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.573608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbj9\" (UniqueName: \"kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.573608 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.573834 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.573834 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.573834 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574011 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574011 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.573896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574473 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.574447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574473 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.574463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574667 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.574516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.574725 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.574698 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.576286 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.576263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.576377 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.576263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.583705 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.583687 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbj9\" (UniqueName: \"kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9\") pod \"console-7fdbb6988f-wdpht\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.679645 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.679622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:39:56.827520 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.827490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:39:56.830329 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:39:56.830298 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ea1af0_783c_44ea_968f_d3869ec5217d.slice/crio-48940b3c25d6f9cc8c1566db520256f12d1ec6742ba1fc71c067a6e6dff9ad73 WatchSource:0}: Error finding container 48940b3c25d6f9cc8c1566db520256f12d1ec6742ba1fc71c067a6e6dff9ad73: Status 404 returned error can't find the container with id 48940b3c25d6f9cc8c1566db520256f12d1ec6742ba1fc71c067a6e6dff9ad73 Jun 10 11:39:56.832304 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:56.832288 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:39:57.043294 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:39:57.043210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdbb6988f-wdpht" event={"ID":"d1ea1af0-783c-44ea-968f-d3869ec5217d","Type":"ContainerStarted","Data":"48940b3c25d6f9cc8c1566db520256f12d1ec6742ba1fc71c067a6e6dff9ad73"} Jun 10 11:40:00.056547 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:00.056514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdbb6988f-wdpht" event={"ID":"d1ea1af0-783c-44ea-968f-d3869ec5217d","Type":"ContainerStarted","Data":"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245"} Jun 10 11:40:00.074071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:00.074002 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fdbb6988f-wdpht" podStartSLOduration=1.354040758 podStartE2EDuration="4.073961633s" totalImagesPullingTime="2.719920875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:40:00.073648217 +0000 UTC m=+324.501827453" watchObservedRunningTime="2026-06-10 11:40:00.073961633 +0000 UTC m=+324.502140865" Jun 10 11:40:01.066298 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:01.066262 2563 generic.go:356] "Generic (PLEG): container finished" podID="5bbc3682-3aeb-4111-bebb-1ad435647e1e" containerID="75a8bb5a014a4c3798e2eb8a3f446aa54054a6b1aac19729c57c992dcfdb4d12" exitCode=0 Jun 10 11:40:01.066658 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:01.066333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" event={"ID":"5bbc3682-3aeb-4111-bebb-1ad435647e1e","Type":"ContainerDied","Data":"75a8bb5a014a4c3798e2eb8a3f446aa54054a6b1aac19729c57c992dcfdb4d12"} Jun 10 11:40:01.066741 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:01.066725 2563 scope.go:117] "RemoveContainer" containerID="75a8bb5a014a4c3798e2eb8a3f446aa54054a6b1aac19729c57c992dcfdb4d12" Jun 10 11:40:02.071772 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:02.071738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hm2vl" event={"ID":"5bbc3682-3aeb-4111-bebb-1ad435647e1e","Type":"ContainerStarted","Data":"014e181d24267b1fda8f0a0a63630d59d09ea1124cdc307ab60a8eccf646e854"} Jun 10 11:40:06.113241 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:06.113209 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:40:06.117416 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:06.117396 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d784c748f-sgknm" Jun 10 11:40:06.679740 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:06.679707 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:40:06.679965 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:06.679770 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:40:06.684254 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:06.684232 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:40:07.093455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:07.093381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:40:07.353763 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:07.353659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log" Jun 10 11:40:07.369330 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:07.369306 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvbcb_38187b12-9c42-4730-819c-c849ad36e361/serve-healthcheck-canary/0.log" Jun 10 11:40:41.688294 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688263 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688548 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="alertmanager" containerID="cri-o://a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" gracePeriod=120 Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688636 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-metric" containerID="cri-o://340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" gracePeriod=120 Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688670 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="prom-label-proxy" containerID="cri-o://45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" gracePeriod=120 Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688679 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-web" containerID="cri-o://0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" gracePeriod=120 Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688712 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy" containerID="cri-o://2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" gracePeriod=120 Jun 10 11:40:41.688812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:41.688738 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="config-reloader" containerID="cri-o://d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" gracePeriod=120 Jun 10 11:40:42.215739 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215711 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" exitCode=0 Jun 10 11:40:42.215739 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215734 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" exitCode=0 Jun 10 11:40:42.215739 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215740 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" exitCode=0 Jun 10 11:40:42.215979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215747 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" exitCode=0 Jun 10 11:40:42.215979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11"} Jun 10 11:40:42.215979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215843 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37"} Jun 10 11:40:42.215979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72"} Jun 10 11:40:42.215979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.215909 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757"} Jun 10 11:40:42.942160 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.942138 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:42.955353 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955333 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955363 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955389 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955407 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955430 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955446 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955489 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955505 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbh5q\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955526 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955555 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955608 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955954 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955638 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955954 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955669 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web\") pod \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\" (UID: \"7dba5b4d-a3a2-4e20-a61f-36e1cf444422\") " Jun 10 11:40:42.955954 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955792 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:40:42.956101 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.955951 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:42.956509 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.956230 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:40:42.956673 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.956651 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:40:42.958696 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.958668 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q" (OuterVolumeSpecName: "kube-api-access-wbh5q") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "kube-api-access-wbh5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:40:42.959349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.959142 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:40:42.959349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.959152 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out" (OuterVolumeSpecName: "config-out") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 11:40:42.959349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.959210 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.960441 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.960276 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.960441 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.960302 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.960641 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.960612 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume" (OuterVolumeSpecName: "config-volume") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.960853 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.960828 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.962796 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.962768 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:42.968586 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:42.968567 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config" (OuterVolumeSpecName: "web-config") pod "7dba5b4d-a3a2-4e20-a61f-36e1cf444422" (UID: "7dba5b4d-a3a2-4e20-a61f-36e1cf444422"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.056979 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-volume\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057003 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbh5q\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-kube-api-access-wbh5q\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057012 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-metrics-client-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057024 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-main-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057032 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-alertmanager-main-db\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057041 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057049 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057059 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-web-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057067 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-cluster-tls-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057075 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-tls-assets\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057083 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.057342 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.057095 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dba5b4d-a3a2-4e20-a61f-36e1cf444422-config-out\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:40:43.222806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222770 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" exitCode=0 Jun 10 11:40:43.222806 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222799 2563 generic.go:356] "Generic (PLEG): container finished" podID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerID="0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" exitCode=0 Jun 10 11:40:43.223006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8"} Jun 10 11:40:43.223006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222897 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.223006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222915 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6"} Jun 10 11:40:43.223006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7dba5b4d-a3a2-4e20-a61f-36e1cf444422","Type":"ContainerDied","Data":"e7fbedb1f60b4c474dd64e857da6adc40135a18a1a5cf3da4328b1d2f47fee37"} Jun 10 11:40:43.223006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.222980 2563 scope.go:117] "RemoveContainer" containerID="45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" Jun 10 11:40:43.230477 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.230459 2563 scope.go:117] "RemoveContainer" containerID="340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" Jun 10 11:40:43.237185 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.237167 2563 scope.go:117] "RemoveContainer" containerID="2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" Jun 10 11:40:43.243267 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.243251 2563 scope.go:117] "RemoveContainer" containerID="0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" Jun 10 11:40:43.246555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.246537 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:43.250124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.250102 2563 scope.go:117] "RemoveContainer" containerID="d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" Jun 10 11:40:43.251696 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.251676 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:43.256484 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.256465 2563 scope.go:117] "RemoveContainer" containerID="a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" Jun 10 11:40:43.263014 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.262990 2563 scope.go:117] "RemoveContainer" containerID="d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0" Jun 10 11:40:43.269187 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.269152 2563 scope.go:117] "RemoveContainer" containerID="45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" Jun 10 11:40:43.269413 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.269394 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11\": container with ID starting with 45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11 not found: ID does not exist" containerID="45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" Jun 10 11:40:43.269484 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.269436 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11"} err="failed to get container status \"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11\": rpc error: code = NotFound desc = could not find container \"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11\": container with ID starting with 45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11 not found: ID does not exist" Jun 10 11:40:43.269484 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.269453 2563 scope.go:117] "RemoveContainer" containerID="340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" Jun 10 11:40:43.269735 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.269712 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8\": container with ID starting with 340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8 not found: ID does not exist" containerID="340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" Jun 10 11:40:43.269793 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.269744 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8"} err="failed to get container status \"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8\": rpc error: code = NotFound desc = could not find container \"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8\": container with ID starting with 340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8 not found: ID does not exist" Jun 10 11:40:43.269793 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.269762 2563 scope.go:117] "RemoveContainer" containerID="2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" Jun 10 11:40:43.270034 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.270013 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37\": container with ID starting with 2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37 not found: ID does not exist" containerID="2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" Jun 10 11:40:43.270078 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270047 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37"} err="failed to get container status \"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37\": rpc error: code = NotFound desc = could not find container \"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37\": container with ID starting with 2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37 not found: ID does not exist" Jun 10 11:40:43.270078 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270063 2563 scope.go:117] "RemoveContainer" containerID="0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" Jun 10 11:40:43.270308 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.270288 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6\": container with ID starting with 0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6 not found: ID does not exist" containerID="0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" Jun 10 11:40:43.270349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270315 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6"} err="failed to get container status \"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6\": rpc error: code = NotFound desc = could not find container \"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6\": container with ID starting with 0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6 not found: ID does not exist" Jun 10 11:40:43.270349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270329 2563 scope.go:117] "RemoveContainer" containerID="d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" Jun 10 11:40:43.270539 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.270519 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72\": container with ID starting with d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72 not found: ID does not exist" containerID="d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" Jun 10 11:40:43.270627 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270541 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72"} err="failed to get container status \"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72\": rpc error: code = NotFound desc = could not find container \"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72\": container with ID starting with d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72 not found: ID does not exist" Jun 10 11:40:43.270627 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270555 2563 scope.go:117] "RemoveContainer" containerID="a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" Jun 10 11:40:43.270796 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.270781 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757\": container with ID starting with a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757 not found: ID does not exist" containerID="a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" Jun 10 11:40:43.270841 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270797 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757"} err="failed to get container status \"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757\": rpc error: code = NotFound desc = could not find container \"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757\": container with ID starting with a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757 not found: ID does not exist" Jun 10 11:40:43.270841 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.270811 2563 scope.go:117] "RemoveContainer" containerID="d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0" Jun 10 11:40:43.271032 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:40:43.271014 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0\": container with ID starting with d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0 not found: ID does not exist" containerID="d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0" Jun 10 11:40:43.271084 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271036 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0"} err="failed to get container status \"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0\": rpc error: code = NotFound desc = could not find container \"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0\": container with ID starting with d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0 not found: ID does not exist" Jun 10 11:40:43.271084 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271050 2563 scope.go:117] "RemoveContainer" containerID="45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11" Jun 10 11:40:43.271281 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271263 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11"} err="failed to get container status \"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11\": rpc error: code = NotFound desc = could not find container \"45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11\": container with ID starting with 45d1235b90361cb6d034a56138e07e774a2eb6a40105acc3f4232d300486ef11 not found: ID does not exist" Jun 10 11:40:43.271281 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271281 2563 scope.go:117] "RemoveContainer" containerID="340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8" Jun 10 11:40:43.271508 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271490 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8"} err="failed to get container status \"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8\": rpc error: code = NotFound desc = could not find container \"340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8\": container with ID starting with 340e79d088328fab8fe3edb2c0ab2c6ea27ea2e9e26a99b504234ed354cc5cc8 not found: ID does not exist" Jun 10 11:40:43.271549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271508 2563 scope.go:117] "RemoveContainer" containerID="2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37" Jun 10 11:40:43.271725 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271710 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37"} err="failed to get container status \"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37\": rpc error: code = NotFound desc = could not find container \"2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37\": container with ID starting with 2d7d96a43125c34c4d5b1659016e044c256b85d63479b1f185a1c3e8bb1d2d37 not found: ID does not exist" Jun 10 11:40:43.271766 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271725 2563 scope.go:117] "RemoveContainer" containerID="0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6" Jun 10 11:40:43.271943 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271927 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6"} err="failed to get container status \"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6\": rpc error: code = NotFound desc = could not find container \"0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6\": container with ID starting with 0424cdc8961f2e32322995d3a4d8e3361c4cd0dfc0eb18c207adc9a8bc4a79d6 not found: ID does not exist" Jun 10 11:40:43.271997 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.271944 2563 scope.go:117] "RemoveContainer" containerID="d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72" Jun 10 11:40:43.272149 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.272124 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72"} err="failed to get container status \"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72\": rpc error: code = NotFound desc = could not find container \"d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72\": container with ID starting with d92a3492e38b5f28b0307240ff9c4d38d4e21461bd2487dff1b9a24dcafd9c72 not found: ID does not exist" Jun 10 11:40:43.272193 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.272148 2563 scope.go:117] "RemoveContainer" containerID="a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757" Jun 10 11:40:43.272350 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.272335 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757"} err="failed to get container status \"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757\": rpc error: code = NotFound desc = could not find container \"a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757\": container with ID starting with a056dc90c49290c7afe481656545ddc51d5db33072b067dc68d16d77ae23c757 not found: ID does not exist" Jun 10 11:40:43.272396 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.272351 2563 scope.go:117] "RemoveContainer" containerID="d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0" Jun 10 11:40:43.272563 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.272544 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0"} err="failed to get container status \"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0\": rpc error: code = NotFound desc = could not find container \"d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0\": container with ID starting with d4d16c02169552dd9da8f38b685e2794a8edb897070e4a95ba0ab5cfd6e3f3f0 not found: ID does not exist" Jun 10 11:40:43.279488 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279467 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:43.279740 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279725 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="alertmanager" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279743 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="alertmanager" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279758 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-web" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279767 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-web" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279780 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279790 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy" Jun 10 11:40:43.279810 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279805 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="init-config-reloader" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279814 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="init-config-reloader" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279823 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="config-reloader" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279832 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="config-reloader" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279849 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-metric" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279859 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-metric" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279896 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="prom-label-proxy" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279905 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="prom-label-proxy" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279978 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.279992 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="alertmanager" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.280002 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="config-reloader" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.280012 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-metric" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.280021 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="kube-rbac-proxy-web" Jun 10 11:40:43.280134 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.280030 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" containerName="prom-label-proxy" Jun 10 11:40:43.284699 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.284680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.287102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287079 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 11:40:43.287102 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287097 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 11:40:43.287255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287122 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 11:40:43.287255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287139 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 11:40:43.287255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287101 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-58cqg\"" Jun 10 11:40:43.287255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 11:40:43.287447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 11:40:43.287447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 11:40:43.287643 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.287627 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 11:40:43.293169 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.293145 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 11:40:43.303204 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.303179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:43.360785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.360785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.360785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-out\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.360983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzx7\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-kube-api-access-lmzx7\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361002 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.361001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-web-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361235 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.361026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-volume\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361235 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.361053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.361235 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.361082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462061 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462061 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzx7\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-kube-api-access-lmzx7\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-web-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-volume\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-out\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.462640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.463487 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.462937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.463487 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.463027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.463887 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.463851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287a2536-bdc8-4b53-98ce-44cfb7dcf306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465090 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-volume\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465283 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-web-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465645 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465733 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/287a2536-bdc8-4b53-98ce-44cfb7dcf306-config-out\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.465733 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.465686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.466030 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.466014 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.466347 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.466333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.466452 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.466436 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/287a2536-bdc8-4b53-98ce-44cfb7dcf306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.471408 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.471391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzx7\" (UniqueName: \"kubernetes.io/projected/287a2536-bdc8-4b53-98ce-44cfb7dcf306-kube-api-access-lmzx7\") pod \"alertmanager-main-0\" (UID: \"287a2536-bdc8-4b53-98ce-44cfb7dcf306\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.594027 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.593998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 11:40:43.726505 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:43.726468 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 11:40:43.732854 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:40:43.732797 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287a2536_bdc8_4b53_98ce_44cfb7dcf306.slice/crio-57fed9a1282e6edb9298c8e01f89b5a5a8a77e75a1c790d12823494b5a79b88f WatchSource:0}: Error finding container 57fed9a1282e6edb9298c8e01f89b5a5a8a77e75a1c790d12823494b5a79b88f: Status 404 returned error can't find the container with id 57fed9a1282e6edb9298c8e01f89b5a5a8a77e75a1c790d12823494b5a79b88f Jun 10 11:40:44.031379 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:44.031345 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dba5b4d-a3a2-4e20-a61f-36e1cf444422" path="/var/lib/kubelet/pods/7dba5b4d-a3a2-4e20-a61f-36e1cf444422/volumes" Jun 10 11:40:44.228242 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:44.228202 2563 generic.go:356] "Generic (PLEG): container finished" podID="287a2536-bdc8-4b53-98ce-44cfb7dcf306" containerID="0004f87deaa297fa9684a151bc997b557e48242c98efd9da6bad798ae01b05ee" exitCode=0 Jun 10 11:40:44.228387 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:44.228272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerDied","Data":"0004f87deaa297fa9684a151bc997b557e48242c98efd9da6bad798ae01b05ee"} Jun 10 11:40:44.228387 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:44.228338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"57fed9a1282e6edb9298c8e01f89b5a5a8a77e75a1c790d12823494b5a79b88f"} Jun 10 11:40:45.235766 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"d075930e441ebfe53cb597709947585a8441c0e0c71884869324c213e96dc521"} Jun 10 11:40:45.236191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"88fbe64a2bf1938f1fc0402813e0333b272b62094972a508324a69992197c1e4"} Jun 10 11:40:45.236191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"9c97f328e86d33ac48151c790e2149ff4074f970051f6b703cc9f96630e4509d"} Jun 10 11:40:45.236191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"3418953f9d4a2f1e9c6414f77982325fc313db70941d126f110c9baf26f30fb4"} Jun 10 11:40:45.236191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235949 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"f9a004ff71e55b02dbb04267cc9f6bcd4625ab02a9b511bae5f6b659ea02e07b"} Jun 10 11:40:45.236191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.235985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"287a2536-bdc8-4b53-98ce-44cfb7dcf306","Type":"ContainerStarted","Data":"126fd44ba505297aa3889d22c8963ca82919abf1a8bc597f01c7cb685715d2b2"} Jun 10 11:40:45.269794 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.269706 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.251866368 podStartE2EDuration="2.269688105s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.821737ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:40:45.269320804 +0000 UTC m=+369.697500063" watchObservedRunningTime="2026-06-10 11:40:45.269688105 +0000 UTC m=+369.697867339" Jun 10 11:40:45.727452 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.727413 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb"] Jun 10 11:40:45.731433 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.731413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.733681 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.733651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 11:40:45.733798 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.733726 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 11:40:45.733798 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.733774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 11:40:45.733956 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.733726 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zb6tx\"" Jun 10 11:40:45.733956 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.733835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 11:40:45.734137 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.734121 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 11:40:45.739509 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.739476 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 11:40:45.742864 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.742844 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb"] Jun 10 11:40:45.780231 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xltmj\" (UniqueName: \"kubernetes.io/projected/79b185a6-558c-4e14-b46f-24c7bf00b258-kube-api-access-xltmj\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780366 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-federate-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780366 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-serving-certs-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780366 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780366 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-metrics-client-ca\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780528 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780528 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.780528 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.780458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881273 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-serving-certs-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881400 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881400 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-metrics-client-ca\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881400 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881630 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881695 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881747 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xltmj\" (UniqueName: \"kubernetes.io/projected/79b185a6-558c-4e14-b46f-24c7bf00b258-kube-api-access-xltmj\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.881796 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.881742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-federate-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.882163 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.882134 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-metrics-client-ca\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.882251 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.882167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-serving-certs-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.882726 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.882701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.884015 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.883995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-telemeter-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.884111 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.884078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.884233 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.884216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-secret-telemeter-client\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.884233 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.884227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79b185a6-558c-4e14-b46f-24c7bf00b258-federate-client-tls\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:45.890508 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:45.890486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xltmj\" (UniqueName: \"kubernetes.io/projected/79b185a6-558c-4e14-b46f-24c7bf00b258-kube-api-access-xltmj\") pod \"telemeter-client-dbfcc4cd6-sbmrb\" (UID: \"79b185a6-558c-4e14-b46f-24c7bf00b258\") " pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:46.042266 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:46.042187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" Jun 10 11:40:46.175264 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:46.175241 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb"] Jun 10 11:40:46.177625 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:40:46.177593 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b185a6_558c_4e14_b46f_24c7bf00b258.slice/crio-36f0b1cc362ba33d56a11d80d66df9ab1a881b3b80a197add39f4149887cc892 WatchSource:0}: Error finding container 36f0b1cc362ba33d56a11d80d66df9ab1a881b3b80a197add39f4149887cc892: Status 404 returned error can't find the container with id 36f0b1cc362ba33d56a11d80d66df9ab1a881b3b80a197add39f4149887cc892 Jun 10 11:40:46.240543 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:46.240510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" event={"ID":"79b185a6-558c-4e14-b46f-24c7bf00b258","Type":"ContainerStarted","Data":"36f0b1cc362ba33d56a11d80d66df9ab1a881b3b80a197add39f4149887cc892"} Jun 10 11:40:48.250371 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:48.250329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" event={"ID":"79b185a6-558c-4e14-b46f-24c7bf00b258","Type":"ContainerStarted","Data":"b71bfca37931f2e8819821f8a32c0182e85fdb0cc2bd2c737f8de2c340fd6477"} Jun 10 11:40:48.250742 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:48.250383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" event={"ID":"79b185a6-558c-4e14-b46f-24c7bf00b258","Type":"ContainerStarted","Data":"6a86d252560833aba4ccc797d01469557a1f6001ca07721091e51b91733e3edf"} Jun 10 11:40:48.250742 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:48.250405 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" event={"ID":"79b185a6-558c-4e14-b46f-24c7bf00b258","Type":"ContainerStarted","Data":"90d30741196900adfd5521bd328b41f027812eec8dc9e09312f3ab3740d302b7"} Jun 10 11:40:48.277079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:48.277018 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dbfcc4cd6-sbmrb" podStartSLOduration=1.420627999 podStartE2EDuration="3.276997303s" totalImagesPullingTime="1.856369304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:40:48.275976215 +0000 UTC m=+372.704155447" watchObservedRunningTime="2026-06-10 11:40:48.276997303 +0000 UTC m=+372.705176539" Jun 10 11:40:49.920551 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:49.920512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:40:49.922860 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:49.922839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3606f559-9ccd-442d-b721-3360bf17f37a-metrics-certs\") pod \"network-metrics-daemon-gpx7m\" (UID: \"3606f559-9ccd-442d-b721-3360bf17f37a\") " pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:40:50.130704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:50.130675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d86hz\"" Jun 10 11:40:50.138718 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:50.138698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpx7m" Jun 10 11:40:50.260017 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:50.259995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gpx7m"] Jun 10 11:40:50.262498 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:40:50.262470 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3606f559_9ccd_442d_b721_3360bf17f37a.slice/crio-fa56d9793461d952a1b14f7acf1fb14916c8864bdb9c9d8691c571ce26b609ca WatchSource:0}: Error finding container fa56d9793461d952a1b14f7acf1fb14916c8864bdb9c9d8691c571ce26b609ca: Status 404 returned error can't find the container with id fa56d9793461d952a1b14f7acf1fb14916c8864bdb9c9d8691c571ce26b609ca Jun 10 11:40:51.263107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:51.263075 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpx7m" event={"ID":"3606f559-9ccd-442d-b721-3360bf17f37a","Type":"ContainerStarted","Data":"951b460d6a5b59369dd543311b6e487c6bff219ec3b1e7f1caea65bf79324a27"} Jun 10 11:40:51.263383 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:51.263127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpx7m" event={"ID":"3606f559-9ccd-442d-b721-3360bf17f37a","Type":"ContainerStarted","Data":"fa56d9793461d952a1b14f7acf1fb14916c8864bdb9c9d8691c571ce26b609ca"} Jun 10 11:40:52.268098 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:52.268067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpx7m" event={"ID":"3606f559-9ccd-442d-b721-3360bf17f37a","Type":"ContainerStarted","Data":"4025e1591d2557173344d710359093f52b4499aeb2bd7db0b0a9661129674099"} Jun 10 11:40:52.286042 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:52.285988 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gpx7m" podStartSLOduration=375.432471001 podStartE2EDuration="6m16.285973438s" totalImagesPullingTime="853.502437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:40:52.284602623 +0000 UTC m=+376.712781856" watchObservedRunningTime="2026-06-10 11:40:52.285973438 +0000 UTC m=+376.714152669" Jun 10 11:40:59.749280 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:40:59.749245 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:41:24.771123 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:24.771059 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fdbb6988f-wdpht" podUID="d1ea1af0-783c-44ea-968f-d3869ec5217d" containerName="console" containerID="cri-o://402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245" gracePeriod=15 Jun 10 11:41:25.008973 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.008950 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:41:25.107485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107387 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107445 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107472 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107492 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107526 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107553 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhbj9\" (UniqueName: \"kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107773 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107708 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert\") pod \"d1ea1af0-783c-44ea-968f-d3869ec5217d\" (UID: \"d1ea1af0-783c-44ea-968f-d3869ec5217d\") " Jun 10 11:41:25.107993 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.107899 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:41:25.108045 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.108004 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config" (OuterVolumeSpecName: "console-config") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:41:25.108045 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.108023 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.108151 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.108030 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:41:25.108379 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.108352 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:41:25.109916 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.109888 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9" (OuterVolumeSpecName: "kube-api-access-jhbj9") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "kube-api-access-jhbj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:41:25.110012 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.109915 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:41:25.110053 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.110003 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1ea1af0-783c-44ea-968f-d3869ec5217d" (UID: "d1ea1af0-783c-44ea-968f-d3869ec5217d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:41:25.209101 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209056 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.209101 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209094 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.209101 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209104 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.209101 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209113 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ea1af0-783c-44ea-968f-d3869ec5217d-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.209354 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209122 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhbj9\" (UniqueName: \"kubernetes.io/projected/d1ea1af0-783c-44ea-968f-d3869ec5217d-kube-api-access-jhbj9\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.209354 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.209131 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ea1af0-783c-44ea-968f-d3869ec5217d-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:41:25.396610 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.396522 2563 generic.go:356] "Generic (PLEG): container finished" podID="d1ea1af0-783c-44ea-968f-d3869ec5217d" containerID="402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245" exitCode=0 Jun 10 11:41:25.396610 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.396567 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdbb6988f-wdpht" Jun 10 11:41:25.396856 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.396608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdbb6988f-wdpht" event={"ID":"d1ea1af0-783c-44ea-968f-d3869ec5217d","Type":"ContainerDied","Data":"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245"} Jun 10 11:41:25.396856 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.396665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdbb6988f-wdpht" event={"ID":"d1ea1af0-783c-44ea-968f-d3869ec5217d","Type":"ContainerDied","Data":"48940b3c25d6f9cc8c1566db520256f12d1ec6742ba1fc71c067a6e6dff9ad73"} Jun 10 11:41:25.396856 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.396686 2563 scope.go:117] "RemoveContainer" containerID="402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245" Jun 10 11:41:25.404998 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.404973 2563 scope.go:117] "RemoveContainer" containerID="402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245" Jun 10 11:41:25.405284 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:41:25.405267 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245\": container with ID starting with 402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245 not found: ID does not exist" containerID="402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245" Jun 10 11:41:25.405340 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.405295 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245"} err="failed to get container status \"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245\": rpc error: code = NotFound desc = could not find container \"402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245\": container with ID starting with 402be7997423ca94d8049789aff1f49eeedd0c1d35cf248104eb618f1a10f245 not found: ID does not exist" Jun 10 11:41:25.418216 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.418192 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:41:25.424390 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:25.424366 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fdbb6988f-wdpht"] Jun 10 11:41:26.031720 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:26.031687 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ea1af0-783c-44ea-968f-d3869ec5217d" path="/var/lib/kubelet/pods/d1ea1af0-783c-44ea-968f-d3869ec5217d/volumes" Jun 10 11:41:57.764161 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.764126 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:41:57.764662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.764424 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ea1af0-783c-44ea-968f-d3869ec5217d" containerName="console" Jun 10 11:41:57.764662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.764438 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ea1af0-783c-44ea-968f-d3869ec5217d" containerName="console" Jun 10 11:41:57.764662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.764494 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ea1af0-783c-44ea-968f-d3869ec5217d" containerName="console" Jun 10 11:41:57.767722 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.767699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.770079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.770057 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 11:41:57.770189 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.770074 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 11:41:57.770990 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.770970 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6mvbt\"" Jun 10 11:41:57.771087 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.770997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 11:41:57.771087 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.770975 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 11:41:57.771087 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.771064 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 11:41:57.771290 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.771275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 11:41:57.771363 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.771347 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 11:41:57.776949 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.776928 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 11:41:57.779717 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.779698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:41:57.855034 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855170 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcjmm\" (UniqueName: \"kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855170 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855170 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855170 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855303 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855181 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.855303 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.855206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956381 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956381 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.956555 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.956518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcjmm\" (UniqueName: \"kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.957158 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.957132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.957273 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.957234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.957339 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.957274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.957567 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.957545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.958915 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.958888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.959008 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.958942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:57.965006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:57.964987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcjmm\" (UniqueName: \"kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm\") pod \"console-f458f9f44-z84zh\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:58.079797 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:58.079722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:41:58.206766 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:58.206689 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:41:58.209026 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:41:58.208989 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a24339_4443_4b32_845d_394f54109630.slice/crio-7cbb8bda07fc990cd70d5317b7b37eef2798138debf7709233d36c796c64f6c0 WatchSource:0}: Error finding container 7cbb8bda07fc990cd70d5317b7b37eef2798138debf7709233d36c796c64f6c0: Status 404 returned error can't find the container with id 7cbb8bda07fc990cd70d5317b7b37eef2798138debf7709233d36c796c64f6c0 Jun 10 11:41:58.519448 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:58.519408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f458f9f44-z84zh" event={"ID":"25a24339-4443-4b32-845d-394f54109630","Type":"ContainerStarted","Data":"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64"} Jun 10 11:41:58.519636 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:58.519461 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f458f9f44-z84zh" event={"ID":"25a24339-4443-4b32-845d-394f54109630","Type":"ContainerStarted","Data":"7cbb8bda07fc990cd70d5317b7b37eef2798138debf7709233d36c796c64f6c0"} Jun 10 11:41:58.539156 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:41:58.539109 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f458f9f44-z84zh" podStartSLOduration=1.539093846 podStartE2EDuration="1.539093846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:41:58.537953852 +0000 UTC m=+442.966133087" watchObservedRunningTime="2026-06-10 11:41:58.539093846 +0000 UTC m=+442.967273078" Jun 10 11:42:08.080047 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:42:08.080017 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:42:08.080424 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:42:08.080068 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:42:08.084524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:42:08.084503 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:42:08.564072 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:42:08.564047 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:44:19.831181 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.831147 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x"] Jun 10 11:44:19.834088 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.834073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:19.836782 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.836753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gb7vd\"" Jun 10 11:44:19.837604 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.837585 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 11:44:19.837604 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.837598 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 11:44:19.847947 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.847926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x"] Jun 10 11:44:19.967019 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.966985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:19.967179 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:19.967044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjj7\" (UniqueName: \"kubernetes.io/projected/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-kube-api-access-7bjj7\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.068270 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.068237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjj7\" (UniqueName: \"kubernetes.io/projected/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-kube-api-access-7bjj7\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.068426 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.068284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.068595 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.068579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.077546 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.077518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjj7\" (UniqueName: \"kubernetes.io/projected/c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d-kube-api-access-7bjj7\") pod \"openshift-lws-operator-fd8ccff4c-w5k8x\" (UID: \"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.143216 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.143149 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" Jun 10 11:44:20.267340 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:20.267318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x"] Jun 10 11:44:20.269474 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:44:20.269446 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0622ae5_ff01_4d7c_8c54_cb0c4ef8894d.slice/crio-2b850f86f99868ebd01522e0a5f613f29aead85edbd4ec1bc54da390c2273468 WatchSource:0}: Error finding container 2b850f86f99868ebd01522e0a5f613f29aead85edbd4ec1bc54da390c2273468: Status 404 returned error can't find the container with id 2b850f86f99868ebd01522e0a5f613f29aead85edbd4ec1bc54da390c2273468 Jun 10 11:44:21.058273 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:21.058240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" event={"ID":"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d","Type":"ContainerStarted","Data":"2b850f86f99868ebd01522e0a5f613f29aead85edbd4ec1bc54da390c2273468"} Jun 10 11:44:24.072600 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:24.072561 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" event={"ID":"c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d","Type":"ContainerStarted","Data":"2cc3a06c42a38670c64e13f33a7a66ea21b6b14260719b993d4b3abd0fbb840f"} Jun 10 11:44:24.096619 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:24.096569 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w5k8x" podStartSLOduration=2.120221874 podStartE2EDuration="5.09655618s" totalImagesPullingTime="2.976334306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:44:24.094081901 +0000 UTC m=+588.522261133" watchObservedRunningTime="2026-06-10 11:44:24.09655618 +0000 UTC m=+588.524735411" Jun 10 11:44:36.011124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:36.011101 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:44:36.011597 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:36.011132 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:44:36.015598 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:36.015580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:44:36.015923 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:36.015907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:44:39.273665 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.273635 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp"] Jun 10 11:44:39.277062 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.277044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.279841 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.279818 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 11:44:39.280480 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.280464 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 11:44:39.280546 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.280528 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 11:44:39.280593 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.280531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 11:44:39.280814 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.280801 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-85tx7\"" Jun 10 11:44:39.297524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.297501 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp"] Jun 10 11:44:39.430928 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.430901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.431079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.430944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-tmp\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.431079 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.430966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqs9\" (UniqueName: \"kubernetes.io/projected/4392c4cc-e9e7-4d3c-a030-386262d366f7-kube-api-access-6pqs9\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.431150 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.431069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.431150 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.431111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-manifests\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532492 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-manifests\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532492 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-tmp\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532640 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqs9\" (UniqueName: \"kubernetes.io/projected/4392c4cc-e9e7-4d3c-a030-386262d366f7-kube-api-access-6pqs9\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532708 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.532847 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.532826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-manifests\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.534906 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.534859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4392c4cc-e9e7-4d3c-a030-386262d366f7-tmp\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.534999 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.534980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.535044 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.535006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4392c4cc-e9e7-4d3c-a030-386262d366f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.545266 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.545248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqs9\" (UniqueName: \"kubernetes.io/projected/4392c4cc-e9e7-4d3c-a030-386262d366f7-kube-api-access-6pqs9\") pod \"opendatahub-operator-controller-manager-65f4bbdb8d-975qp\" (UID: \"4392c4cc-e9e7-4d3c-a030-386262d366f7\") " pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.586958 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.586925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:39.725127 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:39.725100 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp"] Jun 10 11:44:39.727582 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:44:39.727554 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4392c4cc_e9e7_4d3c_a030_386262d366f7.slice/crio-48c769adaaef1b86bf41a8ce6c60528916ae4fe054336c7156391a081e3e805e WatchSource:0}: Error finding container 48c769adaaef1b86bf41a8ce6c60528916ae4fe054336c7156391a081e3e805e: Status 404 returned error can't find the container with id 48c769adaaef1b86bf41a8ce6c60528916ae4fe054336c7156391a081e3e805e Jun 10 11:44:40.131821 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:40.131782 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" event={"ID":"4392c4cc-e9e7-4d3c-a030-386262d366f7","Type":"ContainerStarted","Data":"48c769adaaef1b86bf41a8ce6c60528916ae4fe054336c7156391a081e3e805e"} Jun 10 11:44:43.148392 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:43.148360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" event={"ID":"4392c4cc-e9e7-4d3c-a030-386262d366f7","Type":"ContainerStarted","Data":"f662957305b2b4e0c5a82e40dfcb688c4eb101c18c0208a4a7658d1b52fbd331"} Jun 10 11:44:44.153960 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:44.153923 2563 generic.go:356] "Generic (PLEG): container finished" podID="4392c4cc-e9e7-4d3c-a030-386262d366f7" containerID="f662957305b2b4e0c5a82e40dfcb688c4eb101c18c0208a4a7658d1b52fbd331" exitCode=0 Jun 10 11:44:44.154357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:44.154017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" event={"ID":"4392c4cc-e9e7-4d3c-a030-386262d366f7","Type":"ContainerDied","Data":"f662957305b2b4e0c5a82e40dfcb688c4eb101c18c0208a4a7658d1b52fbd331"} Jun 10 11:44:45.160710 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:45.160666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" event={"ID":"4392c4cc-e9e7-4d3c-a030-386262d366f7","Type":"ContainerStarted","Data":"9e64907c2fdf4cd9723afd6c012a483af8623b7e8474cd2349583c5725ab1b03"} Jun 10 11:44:45.161127 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:45.160821 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:45.192889 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:45.192815 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" podStartSLOduration=2.02553355 podStartE2EDuration="6.19279316s" totalImagesPullingTime="3.233425327s" totalInitContainerRuntime="933.834283ms" isStatefulPod=false podCreationTimestamp="2026-06-10 11:44:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:44:45.191807162 +0000 UTC m=+609.619986438" watchObservedRunningTime="2026-06-10 11:44:45.19279316 +0000 UTC m=+609.620972392" Jun 10 11:44:56.165970 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:56.165934 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65f4bbdb8d-975qp" Jun 10 11:44:59.427677 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.427643 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-w4nbw"] Jun 10 11:44:59.432831 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.432809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:44:59.436804 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.436767 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-j5x98\"" Jun 10 11:44:59.439414 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.437553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 11:44:59.446642 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.446614 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-w4nbw"] Jun 10 11:44:59.494522 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.494490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw52c\" (UniqueName: \"kubernetes.io/projected/2a100da7-06f8-4347-a539-214b5499ed75-kube-api-access-rw52c\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:44:59.494707 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.494595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:44:59.595938 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.595905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw52c\" (UniqueName: \"kubernetes.io/projected/2a100da7-06f8-4347-a539-214b5499ed75-kube-api-access-rw52c\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:44:59.596083 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.595994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:44:59.596140 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:44:59.596120 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 11:44:59.596204 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:44:59.596193 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert podName:2a100da7-06f8-4347-a539-214b5499ed75 nodeName:}" failed. No retries permitted until 2026-06-10 11:45:00.096171472 +0000 UTC m=+624.524350741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert") pod "odh-model-controller-6dc94f689f-w4nbw" (UID: "2a100da7-06f8-4347-a539-214b5499ed75") : secret "odh-model-controller-webhook-cert" not found Jun 10 11:44:59.607424 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:44:59.607395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw52c\" (UniqueName: \"kubernetes.io/projected/2a100da7-06f8-4347-a539-214b5499ed75-kube-api-access-rw52c\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:00.101078 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.101040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:00.103406 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.103386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a100da7-06f8-4347-a539-214b5499ed75-cert\") pod \"odh-model-controller-6dc94f689f-w4nbw\" (UID: \"2a100da7-06f8-4347-a539-214b5499ed75\") " pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:00.330409 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.330377 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c6q48"] Jun 10 11:45:00.333855 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.333835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:00.336178 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.336153 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 11:45:00.347787 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.347762 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c6q48"] Jun 10 11:45:00.349201 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.349180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:00.403498 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.403379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxptc\" (UniqueName: \"kubernetes.io/projected/9df7c992-85d3-4379-8158-1b987ca72a82-kube-api-access-gxptc\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:00.403498 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.403466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:00.504586 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.504550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:00.505083 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.504652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxptc\" (UniqueName: \"kubernetes.io/projected/9df7c992-85d3-4379-8158-1b987ca72a82-kube-api-access-gxptc\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:00.505083 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:00.504697 2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 10 11:45:00.505083 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:00.504762 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs podName:9df7c992-85d3-4379-8158-1b987ca72a82 nodeName:}" failed. No retries permitted until 2026-06-10 11:45:01.004745832 +0000 UTC m=+625.432925045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs") pod "model-serving-api-5dd488fc48-c6q48" (UID: "9df7c992-85d3-4379-8158-1b987ca72a82") : secret "model-serving-api-tls" not found Jun 10 11:45:00.509164 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.509142 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-w4nbw"] Jun 10 11:45:00.510823 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:00.510795 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a100da7_06f8_4347_a539_214b5499ed75.slice/crio-9e4c542a2c4b1c7a8b7fc52a0554b7ee0b4dbcbd615e81be246eefb95e8147ba WatchSource:0}: Error finding container 9e4c542a2c4b1c7a8b7fc52a0554b7ee0b4dbcbd615e81be246eefb95e8147ba: Status 404 returned error can't find the container with id 9e4c542a2c4b1c7a8b7fc52a0554b7ee0b4dbcbd615e81be246eefb95e8147ba Jun 10 11:45:00.512148 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.512132 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:45:00.518686 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:00.518662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxptc\" (UniqueName: \"kubernetes.io/projected/9df7c992-85d3-4379-8158-1b987ca72a82-kube-api-access-gxptc\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:01.008949 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:01.008911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:01.011437 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:01.011412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df7c992-85d3-4379-8158-1b987ca72a82-tls-certs\") pod \"model-serving-api-5dd488fc48-c6q48\" (UID: \"9df7c992-85d3-4379-8158-1b987ca72a82\") " pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:01.230168 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:01.230087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" event={"ID":"2a100da7-06f8-4347-a539-214b5499ed75","Type":"ContainerStarted","Data":"9e4c542a2c4b1c7a8b7fc52a0554b7ee0b4dbcbd615e81be246eefb95e8147ba"} Jun 10 11:45:01.246843 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:01.246609 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:01.444704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:01.444607 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c6q48"] Jun 10 11:45:01.449260 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:01.449232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df7c992_85d3_4379_8158_1b987ca72a82.slice/crio-c1de546c8c237be28cb45819648e353e3970734ff7b67dae057c5d1fa4308903 WatchSource:0}: Error finding container c1de546c8c237be28cb45819648e353e3970734ff7b67dae057c5d1fa4308903: Status 404 returned error can't find the container with id c1de546c8c237be28cb45819648e353e3970734ff7b67dae057c5d1fa4308903 Jun 10 11:45:02.166099 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.166019 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2"] Jun 10 11:45:02.175124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.175102 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.178148 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.178124 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 11:45:02.178263 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.178215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 11:45:02.178486 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.178452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w62wc\"" Jun 10 11:45:02.186390 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.186368 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2"] Jun 10 11:45:02.221885 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.221837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8689e67f-5c7b-45a8-a345-62a451a9191f-tls-certs\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.222039 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.221898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckp2\" (UniqueName: \"kubernetes.io/projected/8689e67f-5c7b-45a8-a345-62a451a9191f-kube-api-access-mckp2\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.222039 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.221935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8689e67f-5c7b-45a8-a345-62a451a9191f-tmp\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.238665 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.238626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" event={"ID":"9df7c992-85d3-4379-8158-1b987ca72a82","Type":"ContainerStarted","Data":"c1de546c8c237be28cb45819648e353e3970734ff7b67dae057c5d1fa4308903"} Jun 10 11:45:02.323455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.323421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8689e67f-5c7b-45a8-a345-62a451a9191f-tls-certs\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.323635 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.323472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckp2\" (UniqueName: \"kubernetes.io/projected/8689e67f-5c7b-45a8-a345-62a451a9191f-kube-api-access-mckp2\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.323635 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.323518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8689e67f-5c7b-45a8-a345-62a451a9191f-tmp\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.326129 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.326103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8689e67f-5c7b-45a8-a345-62a451a9191f-tmp\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.326338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.326299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8689e67f-5c7b-45a8-a345-62a451a9191f-tls-certs\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.332439 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.332409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckp2\" (UniqueName: \"kubernetes.io/projected/8689e67f-5c7b-45a8-a345-62a451a9191f-kube-api-access-mckp2\") pod \"kube-auth-proxy-77789cbd49-2vbf2\" (UID: \"8689e67f-5c7b-45a8-a345-62a451a9191f\") " pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.488575 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.488530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" Jun 10 11:45:02.657937 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:02.657906 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2"] Jun 10 11:45:03.139159 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:03.139124 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8689e67f_5c7b_45a8_a345_62a451a9191f.slice/crio-1416e20095a4c07d9759ea14ec3574498cd8d0df7775386f0ddcb2f5986b40ec WatchSource:0}: Error finding container 1416e20095a4c07d9759ea14ec3574498cd8d0df7775386f0ddcb2f5986b40ec: Status 404 returned error can't find the container with id 1416e20095a4c07d9759ea14ec3574498cd8d0df7775386f0ddcb2f5986b40ec Jun 10 11:45:03.244914 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:03.244882 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" event={"ID":"8689e67f-5c7b-45a8-a345-62a451a9191f","Type":"ContainerStarted","Data":"1416e20095a4c07d9759ea14ec3574498cd8d0df7775386f0ddcb2f5986b40ec"} Jun 10 11:45:04.253595 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:04.253014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" event={"ID":"2a100da7-06f8-4347-a539-214b5499ed75","Type":"ContainerStarted","Data":"50514f40e815a9342d660e5a1a02d4e1232dc9cbcb991234d47ca1696dcf591e"} Jun 10 11:45:04.253595 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:04.253318 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:04.279788 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:04.279168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" podStartSLOduration=2.601234825 podStartE2EDuration="5.279146437s" totalImagesPullingTime="2.677911612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:04.277098138 +0000 UTC m=+628.705277365" watchObservedRunningTime="2026-06-10 11:45:04.279146437 +0000 UTC m=+628.707325672" Jun 10 11:45:06.267893 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:06.267767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" event={"ID":"9df7c992-85d3-4379-8158-1b987ca72a82","Type":"ContainerStarted","Data":"bfcf62c7a6f646bc203fe129552d4848c1d837af726f04417b3670b42f063012"} Jun 10 11:45:06.268374 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:06.268010 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:06.269805 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:06.269777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" event={"ID":"8689e67f-5c7b-45a8-a345-62a451a9191f","Type":"ContainerStarted","Data":"3c9f8820cd467b1cfa6333926becdba1f86d326dea24fd3ebaaa244cfd0fe0fb"} Jun 10 11:45:06.289163 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:06.289111 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" podStartSLOduration=1.699417747 podStartE2EDuration="6.289098712s" totalImagesPullingTime="4.589680965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:06.288031938 +0000 UTC m=+630.716211171" watchObservedRunningTime="2026-06-10 11:45:06.289098712 +0000 UTC m=+630.717277945" Jun 10 11:45:06.312108 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:06.312030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77789cbd49-2vbf2" podStartSLOduration=1.404123739 podStartE2EDuration="4.31201716s" totalImagesPullingTime="2.907893421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:06.310773026 +0000 UTC m=+630.738952261" watchObservedRunningTime="2026-06-10 11:45:06.31201716 +0000 UTC m=+630.740196391" Jun 10 11:45:10.758388 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.758355 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mj25g"] Jun 10 11:45:10.761972 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.761956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:10.765146 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.765127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 11:45:10.765146 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.765138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-thpsw\"" Jun 10 11:45:10.792228 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.792203 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mj25g"] Jun 10 11:45:10.805766 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.805737 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd"] Jun 10 11:45:10.809357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.809338 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:10.816386 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.816366 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n2v62\"" Jun 10 11:45:10.816514 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.816495 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 11:45:10.827425 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.827402 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd"] Jun 10 11:45:10.905198 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.905176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlm5t\" (UniqueName: \"kubernetes.io/projected/d5dda62f-4026-45b6-bd7c-b77869168f79-kube-api-access-vlm5t\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:10.905338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.905203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5dda62f-4026-45b6-bd7c-b77869168f79-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:10.905338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.905226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:10.905338 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:10.905242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45jr\" (UniqueName: \"kubernetes.io/projected/61dd2bae-00d2-4e61-83d7-f77f42f546d7-kube-api-access-q45jr\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:11.006573 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.006543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5dda62f-4026-45b6-bd7c-b77869168f79-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:11.006686 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.006580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:11.006686 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.006599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q45jr\" (UniqueName: \"kubernetes.io/projected/61dd2bae-00d2-4e61-83d7-f77f42f546d7-kube-api-access-q45jr\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:11.006686 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.006662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlm5t\" (UniqueName: \"kubernetes.io/projected/d5dda62f-4026-45b6-bd7c-b77869168f79-kube-api-access-vlm5t\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:11.006804 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:11.006689 2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 11:45:11.006804 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:11.006748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert podName:61dd2bae-00d2-4e61-83d7-f77f42f546d7 nodeName:}" failed. No retries permitted until 2026-06-10 11:45:11.50673102 +0000 UTC m=+635.934910230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert") pod "kserve-controller-manager-69fc866d76-mj25g" (UID: "61dd2bae-00d2-4e61-83d7-f77f42f546d7") : secret "kserve-webhook-server-cert" not found Jun 10 11:45:11.008950 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.008895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5dda62f-4026-45b6-bd7c-b77869168f79-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:11.020058 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.020040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45jr\" (UniqueName: \"kubernetes.io/projected/61dd2bae-00d2-4e61-83d7-f77f42f546d7-kube-api-access-q45jr\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:11.028759 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.028738 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlm5t\" (UniqueName: \"kubernetes.io/projected/d5dda62f-4026-45b6-bd7c-b77869168f79-kube-api-access-vlm5t\") pod \"llmisvc-controller-manager-864bfd7bc9-tphhd\" (UID: \"d5dda62f-4026-45b6-bd7c-b77869168f79\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:11.118483 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.118455 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:11.261494 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.261467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd"] Jun 10 11:45:11.262816 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:11.262787 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd5dda62f_4026_45b6_bd7c_b77869168f79.slice/crio-b97a39260d3a6d6236c301da421af876d45b165122a2e2800d54bac35139ca2a WatchSource:0}: Error finding container b97a39260d3a6d6236c301da421af876d45b165122a2e2800d54bac35139ca2a: Status 404 returned error can't find the container with id b97a39260d3a6d6236c301da421af876d45b165122a2e2800d54bac35139ca2a Jun 10 11:45:11.291949 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.291918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" event={"ID":"d5dda62f-4026-45b6-bd7c-b77869168f79","Type":"ContainerStarted","Data":"b97a39260d3a6d6236c301da421af876d45b165122a2e2800d54bac35139ca2a"} Jun 10 11:45:11.511816 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:11.511738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:11.511974 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:11.511909 2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 11:45:11.512015 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:45:11.511975 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert podName:61dd2bae-00d2-4e61-83d7-f77f42f546d7 nodeName:}" failed. No retries permitted until 2026-06-10 11:45:12.511956891 +0000 UTC m=+636.940136101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert") pod "kserve-controller-manager-69fc866d76-mj25g" (UID: "61dd2bae-00d2-4e61-83d7-f77f42f546d7") : secret "kserve-webhook-server-cert" not found Jun 10 11:45:12.522245 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:12.522202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:12.524755 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:12.524729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61dd2bae-00d2-4e61-83d7-f77f42f546d7-cert\") pod \"kserve-controller-manager-69fc866d76-mj25g\" (UID: \"61dd2bae-00d2-4e61-83d7-f77f42f546d7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:12.572451 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:12.572423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:12.799769 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:12.799741 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mj25g"] Jun 10 11:45:12.801113 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:12.801080 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61dd2bae_00d2_4e61_83d7_f77f42f546d7.slice/crio-75079f59b2b533c9789e34e76b3e6cdc4c8ef531979b1d22b5fbcc6b967a2d73 WatchSource:0}: Error finding container 75079f59b2b533c9789e34e76b3e6cdc4c8ef531979b1d22b5fbcc6b967a2d73: Status 404 returned error can't find the container with id 75079f59b2b533c9789e34e76b3e6cdc4c8ef531979b1d22b5fbcc6b967a2d73 Jun 10 11:45:13.301715 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:13.301680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" event={"ID":"61dd2bae-00d2-4e61-83d7-f77f42f546d7","Type":"ContainerStarted","Data":"75079f59b2b533c9789e34e76b3e6cdc4c8ef531979b1d22b5fbcc6b967a2d73"} Jun 10 11:45:15.262693 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:15.262665 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-w4nbw" Jun 10 11:45:15.311333 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:15.311307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" event={"ID":"d5dda62f-4026-45b6-bd7c-b77869168f79","Type":"ContainerStarted","Data":"2e4d5ece6e67b4fdb40b89522ac2bfee879030f047d44693f8c04fad518fd367"} Jun 10 11:45:15.311472 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:15.311455 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:15.357730 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:15.357676 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" podStartSLOduration=2.401615479 podStartE2EDuration="5.357653869s" totalImagesPullingTime="2.95603839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:15.35567999 +0000 UTC m=+639.783859233" watchObservedRunningTime="2026-06-10 11:45:15.357653869 +0000 UTC m=+639.785833102" Jun 10 11:45:16.317048 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:16.317012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" event={"ID":"61dd2bae-00d2-4e61-83d7-f77f42f546d7","Type":"ContainerStarted","Data":"2515ada67fda5803d80762eb5dbe8bb13ea0d9ea7bac5c89466c9cad5a273e20"} Jun 10 11:45:16.317408 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:16.317101 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:45:16.346687 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:16.346631 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" podStartSLOduration=3.844757781 podStartE2EDuration="6.34661555s" totalImagesPullingTime="2.501857769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:16.345401867 +0000 UTC m=+640.773581100" watchObservedRunningTime="2026-06-10 11:45:16.34661555 +0000 UTC m=+640.774794783" Jun 10 11:45:17.279329 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:17.279299 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-c6q48" Jun 10 11:45:18.960983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.960946 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw"] Jun 10 11:45:18.964074 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.964058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:18.969191 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.969160 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 11:45:18.969339 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.969264 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6rzvc\"" Jun 10 11:45:18.970476 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.970425 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 11:45:18.984292 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:18.984274 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw"] Jun 10 11:45:19.083545 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.083515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86xj\" (UniqueName: \"kubernetes.io/projected/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-kube-api-access-c86xj\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.083692 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.083556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.184549 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.184520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86xj\" (UniqueName: \"kubernetes.io/projected/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-kube-api-access-c86xj\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.184728 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.184571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.186977 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.186954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.204738 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.204713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86xj\" (UniqueName: \"kubernetes.io/projected/7bfddb55-382a-4213-8c2d-ef3feb2e36a2-kube-api-access-c86xj\") pod \"servicemesh-operator3-57f65f65fb-jdvlw\" (UID: \"7bfddb55-382a-4213-8c2d-ef3feb2e36a2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.258503 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.258431 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-66d5f69bf8-bb826"] Jun 10 11:45:19.261721 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.261701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.267851 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.267827 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ggggf\"" Jun 10 11:45:19.267992 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.267957 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 11:45:19.272957 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.272940 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:19.290363 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.290338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66d5f69bf8-bb826"] Jun 10 11:45:19.385836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.385800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vxq\" (UniqueName: \"kubernetes.io/projected/784ca7bd-c003-4a09-8c14-30b2993f1536-kube-api-access-75vxq\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.386012 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.385853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/784ca7bd-c003-4a09-8c14-30b2993f1536-redirect-config\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.435642 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.435618 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw"] Jun 10 11:45:19.437699 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:19.437671 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfddb55_382a_4213_8c2d_ef3feb2e36a2.slice/crio-bb9226adbe07d5a7192548ea495110c49a9611af22549602f5c1d9408d09cc57 WatchSource:0}: Error finding container bb9226adbe07d5a7192548ea495110c49a9611af22549602f5c1d9408d09cc57: Status 404 returned error can't find the container with id bb9226adbe07d5a7192548ea495110c49a9611af22549602f5c1d9408d09cc57 Jun 10 11:45:19.487316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.487283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/784ca7bd-c003-4a09-8c14-30b2993f1536-redirect-config\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.487422 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.487368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vxq\" (UniqueName: \"kubernetes.io/projected/784ca7bd-c003-4a09-8c14-30b2993f1536-kube-api-access-75vxq\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.487924 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.487908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/784ca7bd-c003-4a09-8c14-30b2993f1536-redirect-config\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.518067 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.518013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vxq\" (UniqueName: \"kubernetes.io/projected/784ca7bd-c003-4a09-8c14-30b2993f1536-kube-api-access-75vxq\") pod \"dashboard-redirect-66d5f69bf8-bb826\" (UID: \"784ca7bd-c003-4a09-8c14-30b2993f1536\") " pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.571847 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.571819 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" Jun 10 11:45:19.727285 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:19.727261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66d5f69bf8-bb826"] Jun 10 11:45:19.729517 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:19.729489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784ca7bd_c003_4a09_8c14_30b2993f1536.slice/crio-7171baefa67f403aab4bbd78ce4d3e6143eadab383da86765fb06cf564cf5f71 WatchSource:0}: Error finding container 7171baefa67f403aab4bbd78ce4d3e6143eadab383da86765fb06cf564cf5f71: Status 404 returned error can't find the container with id 7171baefa67f403aab4bbd78ce4d3e6143eadab383da86765fb06cf564cf5f71 Jun 10 11:45:20.340113 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:20.340067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" event={"ID":"784ca7bd-c003-4a09-8c14-30b2993f1536","Type":"ContainerStarted","Data":"7171baefa67f403aab4bbd78ce4d3e6143eadab383da86765fb06cf564cf5f71"} Jun 10 11:45:20.342038 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:20.342009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" event={"ID":"7bfddb55-382a-4213-8c2d-ef3feb2e36a2","Type":"ContainerStarted","Data":"bb9226adbe07d5a7192548ea495110c49a9611af22549602f5c1d9408d09cc57"} Jun 10 11:45:25.371051 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:25.371009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" event={"ID":"7bfddb55-382a-4213-8c2d-ef3feb2e36a2","Type":"ContainerStarted","Data":"37d5ff3962004553294bb48f7494a3cce80cb3c4e4330f2a203c08a2a2301587"} Jun 10 11:45:25.371533 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:25.371126 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:25.372673 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:25.372644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" event={"ID":"784ca7bd-c003-4a09-8c14-30b2993f1536","Type":"ContainerStarted","Data":"a1ae6f0629039de8800f5766defd322222be9228f8fb512f2f33a72adc2822f9"} Jun 10 11:45:25.398662 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:25.398618 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" podStartSLOduration=2.1146432649999998 podStartE2EDuration="7.398604883s" totalImagesPullingTime="5.283961618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:25.397207038 +0000 UTC m=+649.825386292" watchObservedRunningTime="2026-06-10 11:45:25.398604883 +0000 UTC m=+649.826784115" Jun 10 11:45:25.418412 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:25.418366 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-66d5f69bf8-bb826" podStartSLOduration=1.350047931 podStartE2EDuration="6.418353636s" totalImagesPullingTime="5.068305705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:25.417042114 +0000 UTC m=+649.845221346" watchObservedRunningTime="2026-06-10 11:45:25.418353636 +0000 UTC m=+649.846532867" Jun 10 11:45:32.936167 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.936131 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk"] Jun 10 11:45:32.940787 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.940771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:32.943193 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.943168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 11:45:32.944252 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.944236 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 11:45:32.944634 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.944612 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 11:45:32.944752 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.944640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 11:45:32.945220 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.945204 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6zr4z\"" Jun 10 11:45:32.956522 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:32.956496 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk"] Jun 10 11:45:33.009518 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009518 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009688 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009688 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009688 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbrq6\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-kube-api-access-gbrq6\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009688 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.009815 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.009693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110578 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110729 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110729 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110729 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbrq6\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-kube-api-access-gbrq6\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110729 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110729 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.110996 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.110759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.111308 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.111276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.113026 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.112999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.113119 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.113057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.113257 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.113245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.113534 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.113512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.128527 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.128505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.128664 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.128641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbrq6\" (UniqueName: \"kubernetes.io/projected/47b631d4-bdf0-43ee-865d-ea3683fa7dc0-kube-api-access-gbrq6\") pod \"istiod-openshift-gateway-75c67f8887-mdxqk\" (UID: \"47b631d4-bdf0-43ee-865d-ea3683fa7dc0\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.250161 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.250073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:33.381863 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.381836 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk"] Jun 10 11:45:33.383748 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:45:33.383714 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b631d4_bdf0_43ee_865d_ea3683fa7dc0.slice/crio-6de312b0d207715bf9c42bbc7fba3e3229646e62db0f0302e9108b1d005e00cd WatchSource:0}: Error finding container 6de312b0d207715bf9c42bbc7fba3e3229646e62db0f0302e9108b1d005e00cd: Status 404 returned error can't find the container with id 6de312b0d207715bf9c42bbc7fba3e3229646e62db0f0302e9108b1d005e00cd Jun 10 11:45:33.417412 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:33.417377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" event={"ID":"47b631d4-bdf0-43ee-865d-ea3683fa7dc0","Type":"ContainerStarted","Data":"6de312b0d207715bf9c42bbc7fba3e3229646e62db0f0302e9108b1d005e00cd"} Jun 10 11:45:36.380168 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:36.380144 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-jdvlw" Jun 10 11:45:36.813956 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:36.813917 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 11:45:36.814044 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:36.813985 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 11:45:37.442408 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:37.442373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" event={"ID":"47b631d4-bdf0-43ee-865d-ea3683fa7dc0","Type":"ContainerStarted","Data":"c252e4caed982a23389ac3923042bc865d5468fe9ea56a3f4542897c2b07fa60"} Jun 10 11:45:37.442899 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:37.442583 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:37.444023 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:37.443992 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-mdxqk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 11:45:37.444140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:37.444051 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" podUID="47b631d4-bdf0-43ee-865d-ea3683fa7dc0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 11:45:38.448725 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:38.448700 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" Jun 10 11:45:38.499574 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:38.499522 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mdxqk" podStartSLOduration=3.071621779 podStartE2EDuration="6.499505757s" totalImagesPullingTime="3.427883978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:45:37.478166073 +0000 UTC m=+661.906345330" watchObservedRunningTime="2026-06-10 11:45:38.499505757 +0000 UTC m=+662.927684989" Jun 10 11:45:46.319674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:46.319646 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tphhd" Jun 10 11:45:47.326610 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:45:47.326582 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mj25g" Jun 10 11:46:29.446026 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.445949 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb"] Jun 10 11:46:29.448219 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.448197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:29.450846 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.450824 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vrfpg\"" Jun 10 11:46:29.450980 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.450854 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 11:46:29.451866 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.451846 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 11:46:29.468535 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.468515 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb"] Jun 10 11:46:29.493885 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.493850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pmd\" (UniqueName: \"kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd\") pod \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" (UID: \"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:29.595260 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.595229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pmd\" (UniqueName: \"kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd\") pod \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" (UID: \"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:29.609004 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.608964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pmd\" (UniqueName: \"kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd\") pod \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" (UID: \"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:29.758654 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.758563 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:29.891436 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:29.891412 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb"] Jun 10 11:46:29.893852 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:46:29.893823 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50f6e7f_b6b0_4749_a5ad_d1de154bd133.slice/crio-911f3983b8836417f473e00122f9b4259667f6a6893c3b8a3878e11b4538661e WatchSource:0}: Error finding container 911f3983b8836417f473e00122f9b4259667f6a6893c3b8a3878e11b4538661e: Status 404 returned error can't find the container with id 911f3983b8836417f473e00122f9b4259667f6a6893c3b8a3878e11b4538661e Jun 10 11:46:30.692487 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:30.692456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" event={"ID":"e50f6e7f-b6b0-4749-a5ad-d1de154bd133","Type":"ContainerStarted","Data":"911f3983b8836417f473e00122f9b4259667f6a6893c3b8a3878e11b4538661e"} Jun 10 11:46:32.703940 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:32.703907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" event={"ID":"e50f6e7f-b6b0-4749-a5ad-d1de154bd133","Type":"ContainerStarted","Data":"588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca"} Jun 10 11:46:32.704279 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:32.704001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:32.729893 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:32.729811 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" podStartSLOduration=1.842490637 podStartE2EDuration="3.729792005s" totalImagesPullingTime="1.887301368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:46:32.726238267 +0000 UTC m=+717.154417658" watchObservedRunningTime="2026-06-10 11:46:32.729792005 +0000 UTC m=+717.157971238" Jun 10 11:46:38.700033 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.699994 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf"] Jun 10 11:46:38.702486 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.702466 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:38.705415 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.705394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gwg8x\"" Jun 10 11:46:38.715396 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.715373 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf"] Jun 10 11:46:38.778714 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.778674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7f9t\" (UniqueName: \"kubernetes.io/projected/172cde76-5649-41a2-b957-75744d9a080d-kube-api-access-g7f9t\") pod \"authorino-operator-75cc8d5cb7-m9lmf\" (UID: \"172cde76-5649-41a2-b957-75744d9a080d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:38.879510 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.879483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7f9t\" (UniqueName: \"kubernetes.io/projected/172cde76-5649-41a2-b957-75744d9a080d-kube-api-access-g7f9t\") pod \"authorino-operator-75cc8d5cb7-m9lmf\" (UID: \"172cde76-5649-41a2-b957-75744d9a080d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:38.892896 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:38.892844 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7f9t\" (UniqueName: \"kubernetes.io/projected/172cde76-5649-41a2-b957-75744d9a080d-kube-api-access-g7f9t\") pod \"authorino-operator-75cc8d5cb7-m9lmf\" (UID: \"172cde76-5649-41a2-b957-75744d9a080d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:39.012401 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:39.012318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:39.146852 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:39.146819 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf"] Jun 10 11:46:39.149781 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:46:39.149756 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172cde76_5649_41a2_b957_75744d9a080d.slice/crio-bfabaa32ac446be65efc319ff5f879c63237e0691d6fd824f6dae31cc33b8f3a WatchSource:0}: Error finding container bfabaa32ac446be65efc319ff5f879c63237e0691d6fd824f6dae31cc33b8f3a: Status 404 returned error can't find the container with id bfabaa32ac446be65efc319ff5f879c63237e0691d6fd824f6dae31cc33b8f3a Jun 10 11:46:39.737826 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:39.737792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" event={"ID":"172cde76-5649-41a2-b957-75744d9a080d","Type":"ContainerStarted","Data":"bfabaa32ac446be65efc319ff5f879c63237e0691d6fd824f6dae31cc33b8f3a"} Jun 10 11:46:41.749349 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:41.749309 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" event={"ID":"172cde76-5649-41a2-b957-75744d9a080d","Type":"ContainerStarted","Data":"824f7c1603396089978784ce700073744d11d12bccfde7b191f4bcfcc1b45adc"} Jun 10 11:46:41.749711 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:41.749445 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:41.767823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:41.767773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" podStartSLOduration=1.702439912 podStartE2EDuration="3.767759098s" totalImagesPullingTime="2.065319186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:46:41.766051536 +0000 UTC m=+726.194230768" watchObservedRunningTime="2026-06-10 11:46:41.767759098 +0000 UTC m=+726.195938329" Jun 10 11:46:43.710316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:43.710290 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:52.757097 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:52.757062 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m9lmf" Jun 10 11:46:55.734384 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.734348 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb"] Jun 10 11:46:55.734827 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.734613 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" containerName="manager" containerID="cri-o://588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca" gracePeriod=2 Jun 10 11:46:55.747838 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.747810 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb"] Jun 10 11:46:55.760781 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:46:55.760749 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-zlhkb\": pods \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:55.764540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.764516 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd"] Jun 10 11:46:55.764929 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.764915 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" containerName="manager" Jun 10 11:46:55.765011 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.764932 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" containerName="manager" Jun 10 11:46:55.765065 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.765056 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" containerName="manager" Jun 10 11:46:55.767394 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.767375 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:55.769625 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:46:55.769601 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" is forbidden: User \"system:node:ip-10-0-132-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-117.ec2.internal' and this object" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:55.780744 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.780717 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd"] Jun 10 11:46:55.934682 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.934646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcn7j\" (UniqueName: \"kubernetes.io/projected/7fecbe0f-dfa8-4898-8183-0632e6d3d2a6-kube-api-access-lcn7j\") pod \"limitador-operator-controller-manager-859d7b78bd-vlpnd\" (UID: \"7fecbe0f-dfa8-4898-8183-0632e6d3d2a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:55.976542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:55.976522 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:55.978788 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:46:55.978766 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" is forbidden: User \"system:node:ip-10-0-132-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-117.ec2.internal' and this object" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:56.031253 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:46:56.031176 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zlhkb\" is forbidden: User \"system:node:ip-10-0-132-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-117.ec2.internal' and this object" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:56.035582 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.035558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcn7j\" (UniqueName: \"kubernetes.io/projected/7fecbe0f-dfa8-4898-8183-0632e6d3d2a6-kube-api-access-lcn7j\") pod \"limitador-operator-controller-manager-859d7b78bd-vlpnd\" (UID: \"7fecbe0f-dfa8-4898-8183-0632e6d3d2a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:56.055077 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.055050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcn7j\" (UniqueName: \"kubernetes.io/projected/7fecbe0f-dfa8-4898-8183-0632e6d3d2a6-kube-api-access-lcn7j\") pod \"limitador-operator-controller-manager-859d7b78bd-vlpnd\" (UID: \"7fecbe0f-dfa8-4898-8183-0632e6d3d2a6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:56.123847 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.123817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:56.136324 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.136302 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7pmd\" (UniqueName: \"kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd\") pod \"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\" (UID: \"e50f6e7f-b6b0-4749-a5ad-d1de154bd133\") " Jun 10 11:46:56.138614 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.138582 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd" (OuterVolumeSpecName: "kube-api-access-q7pmd") pod "e50f6e7f-b6b0-4749-a5ad-d1de154bd133" (UID: "e50f6e7f-b6b0-4749-a5ad-d1de154bd133"). InnerVolumeSpecName "kube-api-access-q7pmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:46:56.237674 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.237643 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7pmd\" (UniqueName: \"kubernetes.io/projected/e50f6e7f-b6b0-4749-a5ad-d1de154bd133-kube-api-access-q7pmd\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:46:56.280098 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.280052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd"] Jun 10 11:46:56.282317 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:46:56.282264 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fecbe0f_dfa8_4898_8183_0632e6d3d2a6.slice/crio-0d4ce977f5f75365fee537ceca46f7b6f118bc99d80c6c926df54b181918750c WatchSource:0}: Error finding container 0d4ce977f5f75365fee537ceca46f7b6f118bc99d80c6c926df54b181918750c: Status 404 returned error can't find the container with id 0d4ce977f5f75365fee537ceca46f7b6f118bc99d80c6c926df54b181918750c Jun 10 11:46:56.822528 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.822493 2563 generic.go:356] "Generic (PLEG): container finished" podID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" containerID="588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca" exitCode=0 Jun 10 11:46:56.822971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.822557 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zlhkb" Jun 10 11:46:56.822971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.822581 2563 scope.go:117] "RemoveContainer" containerID="588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca" Jun 10 11:46:56.824477 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.824452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" event={"ID":"7fecbe0f-dfa8-4898-8183-0632e6d3d2a6","Type":"ContainerStarted","Data":"a99445ac397413189386288d31dc84bf29b8e8154cafb021ee136ffe801dfbaa"} Jun 10 11:46:56.824615 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.824544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" event={"ID":"7fecbe0f-dfa8-4898-8183-0632e6d3d2a6","Type":"ContainerStarted","Data":"0d4ce977f5f75365fee537ceca46f7b6f118bc99d80c6c926df54b181918750c"} Jun 10 11:46:56.824731 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.824712 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:46:56.831544 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.831527 2563 scope.go:117] "RemoveContainer" containerID="588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca" Jun 10 11:46:56.831851 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:46:56.831829 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca\": container with ID starting with 588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca not found: ID does not exist" containerID="588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca" Jun 10 11:46:56.831923 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.831858 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca"} err="failed to get container status \"588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca\": rpc error: code = NotFound desc = could not find container \"588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca\": container with ID starting with 588b707d9929ea39e6cbfb42a9479e5fe46ae48b1fe790a94d2aaa204133a8ca not found: ID does not exist" Jun 10 11:46:56.887030 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:56.886984 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" podStartSLOduration=1.8869700059999999 podStartE2EDuration="1.886970006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:46:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:46:56.886144018 +0000 UTC m=+741.314323269" watchObservedRunningTime="2026-06-10 11:46:56.886970006 +0000 UTC m=+741.315149237" Jun 10 11:46:58.032521 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:46:58.032489 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50f6e7f-b6b0-4749-a5ad-d1de154bd133" path="/var/lib/kubelet/pods/e50f6e7f-b6b0-4749-a5ad-d1de154bd133/volumes" Jun 10 11:47:07.832569 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:07.832537 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlpnd" Jun 10 11:47:30.930277 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:30.930240 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:47:30.933676 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:30.933657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:47:30.936328 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:30.936303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w5nhd\"" Jun 10 11:47:30.937737 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:30.937717 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:47:31.043049 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.043020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmf6\" (UniqueName: \"kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6\") pod \"authorino-75d556bd77-jnqs2\" (UID: \"4a519336-716c-472d-bb68-e63ed028ac71\") " pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:47:31.143703 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.143675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmf6\" (UniqueName: \"kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6\") pod \"authorino-75d556bd77-jnqs2\" (UID: \"4a519336-716c-472d-bb68-e63ed028ac71\") " pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:47:31.152350 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.152320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmf6\" (UniqueName: \"kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6\") pod \"authorino-75d556bd77-jnqs2\" (UID: \"4a519336-716c-472d-bb68-e63ed028ac71\") " pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:47:31.244380 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.244308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:47:31.376811 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.376785 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:47:31.378730 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:47:31.378703 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a519336_716c_472d_bb68_e63ed028ac71.slice/crio-b8f8694c26339969a3494f778e31299eaf59bb619a665ff8592e61da31114ec8 WatchSource:0}: Error finding container b8f8694c26339969a3494f778e31299eaf59bb619a665ff8592e61da31114ec8: Status 404 returned error can't find the container with id b8f8694c26339969a3494f778e31299eaf59bb619a665ff8592e61da31114ec8 Jun 10 11:47:31.999910 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:31.999860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jnqs2" event={"ID":"4a519336-716c-472d-bb68-e63ed028ac71","Type":"ContainerStarted","Data":"b8f8694c26339969a3494f778e31299eaf59bb619a665ff8592e61da31114ec8"} Jun 10 11:47:35.017912 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:35.017856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jnqs2" event={"ID":"4a519336-716c-472d-bb68-e63ed028ac71","Type":"ContainerStarted","Data":"7ecd479b19328fd2e1755ef577002553835dc076cf9adc353988814b3a5b3c18"} Jun 10 11:47:35.033787 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:47:35.033744 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jnqs2" podStartSLOduration=1.8821569519999999 podStartE2EDuration="5.03372985s" totalImagesPullingTime="3.151572898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:47:35.033039642 +0000 UTC m=+779.461218877" watchObservedRunningTime="2026-06-10 11:47:35.03372985 +0000 UTC m=+779.461909082" Jun 10 11:48:59.004161 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.004125 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:48:59.006350 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.006334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:48:59.016403 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.016379 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:48:59.111893 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.111828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcj8z\" (UniqueName: \"kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z\") pod \"authorino-5d4b67c446-m5gvm\" (UID: \"ddbeeca7-7246-40a5-9610-5b790134ab9b\") " pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:48:59.213098 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.213063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcj8z\" (UniqueName: \"kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z\") pod \"authorino-5d4b67c446-m5gvm\" (UID: \"ddbeeca7-7246-40a5-9610-5b790134ab9b\") " pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:48:59.225014 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.224994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcj8z\" (UniqueName: \"kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z\") pod \"authorino-5d4b67c446-m5gvm\" (UID: \"ddbeeca7-7246-40a5-9610-5b790134ab9b\") " pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:48:59.267980 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.267913 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:48:59.268169 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.268157 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:48:59.608293 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:48:59.608267 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:48:59.610295 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:48:59.610270 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddbeeca7_7246_40a5_9610_5b790134ab9b.slice/crio-a15eab5b4fafa2a7adcdbb1f9ce9d975dfc3ad579e2ffc8e2a2dd90ab8484a67 WatchSource:0}: Error finding container a15eab5b4fafa2a7adcdbb1f9ce9d975dfc3ad579e2ffc8e2a2dd90ab8484a67: Status 404 returned error can't find the container with id a15eab5b4fafa2a7adcdbb1f9ce9d975dfc3ad579e2ffc8e2a2dd90ab8484a67 Jun 10 11:49:00.421649 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.421618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" event={"ID":"ddbeeca7-7246-40a5-9610-5b790134ab9b","Type":"ContainerStarted","Data":"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc"} Jun 10 11:49:00.422135 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.421656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" event={"ID":"ddbeeca7-7246-40a5-9610-5b790134ab9b","Type":"ContainerStarted","Data":"a15eab5b4fafa2a7adcdbb1f9ce9d975dfc3ad579e2ffc8e2a2dd90ab8484a67"} Jun 10 11:49:00.422135 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.421656 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" podUID="ddbeeca7-7246-40a5-9610-5b790134ab9b" containerName="authorino" containerID="cri-o://139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc" gracePeriod=30 Jun 10 11:49:00.440917 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.440837 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" podStartSLOduration=2.126942127 podStartE2EDuration="2.440820864s" totalImagesPullingTime="313.878737ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:00.440318928 +0000 UTC m=+864.868498160" watchObservedRunningTime="2026-06-10 11:49:00.440820864 +0000 UTC m=+864.869000095" Jun 10 11:49:00.669552 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.669525 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:49:00.726818 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.726745 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcj8z\" (UniqueName: \"kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z\") pod \"ddbeeca7-7246-40a5-9610-5b790134ab9b\" (UID: \"ddbeeca7-7246-40a5-9610-5b790134ab9b\") " Jun 10 11:49:00.728720 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.728692 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z" (OuterVolumeSpecName: "kube-api-access-kcj8z") pod "ddbeeca7-7246-40a5-9610-5b790134ab9b" (UID: "ddbeeca7-7246-40a5-9610-5b790134ab9b"). InnerVolumeSpecName "kube-api-access-kcj8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:49:00.828346 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:00.828302 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcj8z\" (UniqueName: \"kubernetes.io/projected/ddbeeca7-7246-40a5-9610-5b790134ab9b-kube-api-access-kcj8z\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:49:01.245821 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.245774 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:49:01.246012 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.245989 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jnqs2" podUID="4a519336-716c-472d-bb68-e63ed028ac71" containerName="authorino" containerID="cri-o://7ecd479b19328fd2e1755ef577002553835dc076cf9adc353988814b3a5b3c18" gracePeriod=30 Jun 10 11:49:01.429619 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.429587 2563 generic.go:356] "Generic (PLEG): container finished" podID="ddbeeca7-7246-40a5-9610-5b790134ab9b" containerID="139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc" exitCode=0 Jun 10 11:49:01.430068 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.429705 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" Jun 10 11:49:01.430068 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.429764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" event={"ID":"ddbeeca7-7246-40a5-9610-5b790134ab9b","Type":"ContainerDied","Data":"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc"} Jun 10 11:49:01.430068 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.429802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m5gvm" event={"ID":"ddbeeca7-7246-40a5-9610-5b790134ab9b","Type":"ContainerDied","Data":"a15eab5b4fafa2a7adcdbb1f9ce9d975dfc3ad579e2ffc8e2a2dd90ab8484a67"} Jun 10 11:49:01.430068 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.429822 2563 scope.go:117] "RemoveContainer" containerID="139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc" Jun 10 11:49:01.432719 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.432619 2563 generic.go:356] "Generic (PLEG): container finished" podID="4a519336-716c-472d-bb68-e63ed028ac71" containerID="7ecd479b19328fd2e1755ef577002553835dc076cf9adc353988814b3a5b3c18" exitCode=0 Jun 10 11:49:01.432719 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.432680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jnqs2" event={"ID":"4a519336-716c-472d-bb68-e63ed028ac71","Type":"ContainerDied","Data":"7ecd479b19328fd2e1755ef577002553835dc076cf9adc353988814b3a5b3c18"} Jun 10 11:49:01.441496 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.441476 2563 scope.go:117] "RemoveContainer" containerID="139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc" Jun 10 11:49:01.441829 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:01.441812 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc\": container with ID starting with 139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc not found: ID does not exist" containerID="139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc" Jun 10 11:49:01.441921 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.441838 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc"} err="failed to get container status \"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc\": rpc error: code = NotFound desc = could not find container \"139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc\": container with ID starting with 139c38114a53b3f27495c44814ed5c4dba0cc584c56770204903e064e9b10bbc not found: ID does not exist" Jun 10 11:49:01.466768 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.466740 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:49:01.481011 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.480989 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m5gvm"] Jun 10 11:49:01.500062 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.500017 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:49:01.535463 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.535438 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qmf6\" (UniqueName: \"kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6\") pod \"4a519336-716c-472d-bb68-e63ed028ac71\" (UID: \"4a519336-716c-472d-bb68-e63ed028ac71\") " Jun 10 11:49:01.537357 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.537326 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6" (OuterVolumeSpecName: "kube-api-access-7qmf6") pod "4a519336-716c-472d-bb68-e63ed028ac71" (UID: "4a519336-716c-472d-bb68-e63ed028ac71"). InnerVolumeSpecName "kube-api-access-7qmf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:49:01.636781 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:01.636746 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qmf6\" (UniqueName: \"kubernetes.io/projected/4a519336-716c-472d-bb68-e63ed028ac71-kube-api-access-7qmf6\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:49:02.032748 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.032714 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbeeca7-7246-40a5-9610-5b790134ab9b" path="/var/lib/kubelet/pods/ddbeeca7-7246-40a5-9610-5b790134ab9b/volumes" Jun 10 11:49:02.439672 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.439632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jnqs2" event={"ID":"4a519336-716c-472d-bb68-e63ed028ac71","Type":"ContainerDied","Data":"b8f8694c26339969a3494f778e31299eaf59bb619a665ff8592e61da31114ec8"} Jun 10 11:49:02.439672 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.439663 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jnqs2" Jun 10 11:49:02.440183 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.439685 2563 scope.go:117] "RemoveContainer" containerID="7ecd479b19328fd2e1755ef577002553835dc076cf9adc353988814b3a5b3c18" Jun 10 11:49:02.457082 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.457058 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:49:02.462914 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:02.462864 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jnqs2"] Jun 10 11:49:04.032492 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.032459 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a519336-716c-472d-bb68-e63ed028ac71" path="/var/lib/kubelet/pods/4a519336-716c-472d-bb68-e63ed028ac71/volumes" Jun 10 11:49:04.952444 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952412 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:04.952771 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952759 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddbeeca7-7246-40a5-9610-5b790134ab9b" containerName="authorino" Jun 10 11:49:04.952823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952772 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbeeca7-7246-40a5-9610-5b790134ab9b" containerName="authorino" Jun 10 11:49:04.952823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952791 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a519336-716c-472d-bb68-e63ed028ac71" containerName="authorino" Jun 10 11:49:04.952823 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952797 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a519336-716c-472d-bb68-e63ed028ac71" containerName="authorino" Jun 10 11:49:04.953006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952852 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a519336-716c-472d-bb68-e63ed028ac71" containerName="authorino" Jun 10 11:49:04.953006 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.952862 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddbeeca7-7246-40a5-9610-5b790134ab9b" containerName="authorino" Jun 10 11:49:04.955401 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.955383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:04.957776 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.957756 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 11:49:04.957915 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.957893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dmfl9\"" Jun 10 11:49:04.958570 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.958555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 11:49:04.968584 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:04.968561 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:05.066532 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.066501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f22vv\" (UniqueName: \"kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.066916 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.066568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.123035 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.122998 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:49:05.125655 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.125634 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.133803 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.133772 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:49:05.167198 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.167172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnqr\" (UniqueName: \"kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.167317 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.167204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f22vv\" (UniqueName: \"kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.167317 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.167259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.167317 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.167289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.167489 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:05.167383 2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 11:49:05.167489 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:05.167445 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert podName:0bad609f-0e36-43d2-8b88-98006af8f1d1 nodeName:}" failed. No retries permitted until 2026-06-10 11:49:05.667430735 +0000 UTC m=+870.095609951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert") pod "maas-controller-7df696b5f7-w8tgk" (UID: "0bad609f-0e36-43d2-8b88-98006af8f1d1") : secret "maas-controller-webhook-cert" not found Jun 10 11:49:05.177373 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.177347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f22vv\" (UniqueName: \"kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.268030 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.267957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.268030 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.268001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnqr\" (UniqueName: \"kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.268207 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:05.268097 2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 11:49:05.268207 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:05.268153 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert podName:1027e3ef-6343-41bb-ba83-5f7af4a991d7 nodeName:}" failed. No retries permitted until 2026-06-10 11:49:05.768138607 +0000 UTC m=+870.196317820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert") pod "maas-controller-84759b5687-46gk5" (UID: "1027e3ef-6343-41bb-ba83-5f7af4a991d7") : secret "maas-controller-webhook-cert" not found Jun 10 11:49:05.280242 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.280222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnqr\" (UniqueName: \"kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.671095 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.671063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.673370 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.673345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") pod \"maas-controller-7df696b5f7-w8tgk\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.771780 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.771745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.774140 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.774117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") pod \"maas-controller-84759b5687-46gk5\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:05.865007 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.864975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:05.992144 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:05.992119 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:05.994419 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:49:05.994392 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bad609f_0e36_43d2_8b88_98006af8f1d1.slice/crio-3d0c154ef5d752685a44d32ab22395a9d0e7af92a4f835f3e43f571ef9846294 WatchSource:0}: Error finding container 3d0c154ef5d752685a44d32ab22395a9d0e7af92a4f835f3e43f571ef9846294: Status 404 returned error can't find the container with id 3d0c154ef5d752685a44d32ab22395a9d0e7af92a4f835f3e43f571ef9846294 Jun 10 11:49:06.036489 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:06.036467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:06.174119 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:06.174092 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:49:06.175395 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:49:06.175368 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1027e3ef_6343_41bb_ba83_5f7af4a991d7.slice/crio-ad85c63235f8029d20e428974cce4ee244ec48c5ea97fd012198bb6c08e3d812 WatchSource:0}: Error finding container ad85c63235f8029d20e428974cce4ee244ec48c5ea97fd012198bb6c08e3d812: Status 404 returned error can't find the container with id ad85c63235f8029d20e428974cce4ee244ec48c5ea97fd012198bb6c08e3d812 Jun 10 11:49:06.463449 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:06.463412 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-46gk5" event={"ID":"1027e3ef-6343-41bb-ba83-5f7af4a991d7","Type":"ContainerStarted","Data":"ad85c63235f8029d20e428974cce4ee244ec48c5ea97fd012198bb6c08e3d812"} Jun 10 11:49:06.464513 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:06.464491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" event={"ID":"0bad609f-0e36-43d2-8b88-98006af8f1d1","Type":"ContainerStarted","Data":"3d0c154ef5d752685a44d32ab22395a9d0e7af92a4f835f3e43f571ef9846294"} Jun 10 11:49:09.482516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.482472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" event={"ID":"0bad609f-0e36-43d2-8b88-98006af8f1d1","Type":"ContainerStarted","Data":"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b"} Jun 10 11:49:09.482969 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.482608 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:09.483974 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.483948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-46gk5" event={"ID":"1027e3ef-6343-41bb-ba83-5f7af4a991d7","Type":"ContainerStarted","Data":"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045"} Jun 10 11:49:09.484083 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.484068 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:09.501185 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.501144 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" podStartSLOduration=2.880128108 podStartE2EDuration="5.501130344s" totalImagesPullingTime="2.621002236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:09.499710373 +0000 UTC m=+873.927889606" watchObservedRunningTime="2026-06-10 11:49:09.501130344 +0000 UTC m=+873.929309576" Jun 10 11:49:09.531970 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:09.531914 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84759b5687-46gk5" podStartSLOduration=2.101602894 podStartE2EDuration="4.531895889s" totalImagesPullingTime="2.430292995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:09.530122066 +0000 UTC m=+873.958301299" watchObservedRunningTime="2026-06-10 11:49:09.531895889 +0000 UTC m=+873.960075112" Jun 10 11:49:20.496734 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:20.496622 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:20.497289 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:20.497089 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:49:20.589692 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:20.589652 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:20.589864 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:20.589843 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" podUID="0bad609f-0e36-43d2-8b88-98006af8f1d1" containerName="manager" containerID="cri-o://2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b" gracePeriod=30 Jun 10 11:49:20.840529 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:20.840504 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:21.018099 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.018011 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") pod \"0bad609f-0e36-43d2-8b88-98006af8f1d1\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " Jun 10 11:49:21.018099 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.018067 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f22vv\" (UniqueName: \"kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv\") pod \"0bad609f-0e36-43d2-8b88-98006af8f1d1\" (UID: \"0bad609f-0e36-43d2-8b88-98006af8f1d1\") " Jun 10 11:49:21.020175 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.020150 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0bad609f-0e36-43d2-8b88-98006af8f1d1" (UID: "0bad609f-0e36-43d2-8b88-98006af8f1d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:49:21.020272 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.020247 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv" (OuterVolumeSpecName: "kube-api-access-f22vv") pod "0bad609f-0e36-43d2-8b88-98006af8f1d1" (UID: "0bad609f-0e36-43d2-8b88-98006af8f1d1"). InnerVolumeSpecName "kube-api-access-f22vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:49:21.119698 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.119667 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f22vv\" (UniqueName: \"kubernetes.io/projected/0bad609f-0e36-43d2-8b88-98006af8f1d1-kube-api-access-f22vv\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:49:21.119698 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.119693 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0bad609f-0e36-43d2-8b88-98006af8f1d1-webhook-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:49:21.544150 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.544118 2563 generic.go:356] "Generic (PLEG): container finished" podID="0bad609f-0e36-43d2-8b88-98006af8f1d1" containerID="2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b" exitCode=0 Jun 10 11:49:21.544516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.544167 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" Jun 10 11:49:21.544516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.544206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" event={"ID":"0bad609f-0e36-43d2-8b88-98006af8f1d1","Type":"ContainerDied","Data":"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b"} Jun 10 11:49:21.544516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.544260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7df696b5f7-w8tgk" event={"ID":"0bad609f-0e36-43d2-8b88-98006af8f1d1","Type":"ContainerDied","Data":"3d0c154ef5d752685a44d32ab22395a9d0e7af92a4f835f3e43f571ef9846294"} Jun 10 11:49:21.544516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.544287 2563 scope.go:117] "RemoveContainer" containerID="2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b" Jun 10 11:49:21.553007 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.552985 2563 scope.go:117] "RemoveContainer" containerID="2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b" Jun 10 11:49:21.553252 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:49:21.553235 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b\": container with ID starting with 2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b not found: ID does not exist" containerID="2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b" Jun 10 11:49:21.553291 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.553260 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b"} err="failed to get container status \"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b\": rpc error: code = NotFound desc = could not find container \"2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b\": container with ID starting with 2e1e20a353373e445e1bab8437f787d98bb596fc3c1a1487e7b775f0dd351d8b not found: ID does not exist" Jun 10 11:49:21.565689 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.565666 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:21.573883 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:21.573848 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df696b5f7-w8tgk"] Jun 10 11:49:22.033499 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:22.033468 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bad609f-0e36-43d2-8b88-98006af8f1d1" path="/var/lib/kubelet/pods/0bad609f-0e36-43d2-8b88-98006af8f1d1/volumes" Jun 10 11:49:36.048203 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:36.048172 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:49:36.049803 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:36.049771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:49:36.053334 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:36.053315 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:49:36.054430 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:36.054411 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:49:40.033335 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.033305 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7bb8bbb794-j84lc"] Jun 10 11:49:40.034542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.033658 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bad609f-0e36-43d2-8b88-98006af8f1d1" containerName="manager" Jun 10 11:49:40.034542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.033668 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bad609f-0e36-43d2-8b88-98006af8f1d1" containerName="manager" Jun 10 11:49:40.034542 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.033731 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bad609f-0e36-43d2-8b88-98006af8f1d1" containerName="manager" Jun 10 11:49:40.035534 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.035519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.038303 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.038281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 11:49:40.045255 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.045234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bb8bbb794-j84lc"] Jun 10 11:49:40.081621 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.081589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44dh4\" (UniqueName: \"kubernetes.io/projected/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-kube-api-access-44dh4\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.081768 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.081628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-maas-api-tls\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.182509 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.182478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44dh4\" (UniqueName: \"kubernetes.io/projected/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-kube-api-access-44dh4\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.182704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.182520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-maas-api-tls\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.184915 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.184895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-maas-api-tls\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.198071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.198050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44dh4\" (UniqueName: \"kubernetes.io/projected/f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d-kube-api-access-44dh4\") pod \"maas-api-7bb8bbb794-j84lc\" (UID: \"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d\") " pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.346765 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.346697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:40.489352 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.489329 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bb8bbb794-j84lc"] Jun 10 11:49:40.491313 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:49:40.491287 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92cc6c7_7ea5_4367_b58b_cc9ee0e0582d.slice/crio-c2b7ca6fa1333e86c197f1fd2f71bf36658c61e3b58495d903ebab69fd0cca25 WatchSource:0}: Error finding container c2b7ca6fa1333e86c197f1fd2f71bf36658c61e3b58495d903ebab69fd0cca25: Status 404 returned error can't find the container with id c2b7ca6fa1333e86c197f1fd2f71bf36658c61e3b58495d903ebab69fd0cca25 Jun 10 11:49:40.642665 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.642566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bb8bbb794-j84lc" event={"ID":"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d","Type":"ContainerStarted","Data":"c2b7ca6fa1333e86c197f1fd2f71bf36658c61e3b58495d903ebab69fd0cca25"} Jun 10 11:49:40.741635 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.741605 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-t2jp6"] Jun 10 11:49:40.747274 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.747255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:40.750474 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.750454 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 11:49:40.777173 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.777136 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-t2jp6"] Jun 10 11:49:40.786385 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.786362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkr8\" (UniqueName: \"kubernetes.io/projected/c59abf4c-af5e-44d8-a295-1a4f3ade84a2-kube-api-access-qnkr8\") pod \"payload-processing-699b6cd6c-t2jp6\" (UID: \"c59abf4c-af5e-44d8-a295-1a4f3ade84a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:40.824912 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.824860 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-h6xqc"] Jun 10 11:49:40.828316 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.828298 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:40.830994 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.830976 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pgttv\"" Jun 10 11:49:40.840459 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.840438 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-h6xqc"] Jun 10 11:49:40.887654 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.887615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j9qz\" (UniqueName: \"kubernetes.io/projected/4a77395f-cff3-4ee7-92df-329d6e4417bf-kube-api-access-9j9qz\") pod \"payload-pre-processing-579785bc64-h6xqc\" (UID: \"4a77395f-cff3-4ee7-92df-329d6e4417bf\") " pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:40.887814 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.887678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkr8\" (UniqueName: \"kubernetes.io/projected/c59abf4c-af5e-44d8-a295-1a4f3ade84a2-kube-api-access-qnkr8\") pod \"payload-processing-699b6cd6c-t2jp6\" (UID: \"c59abf4c-af5e-44d8-a295-1a4f3ade84a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:40.910383 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.910316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkr8\" (UniqueName: \"kubernetes.io/projected/c59abf4c-af5e-44d8-a295-1a4f3ade84a2-kube-api-access-qnkr8\") pod \"payload-processing-699b6cd6c-t2jp6\" (UID: \"c59abf4c-af5e-44d8-a295-1a4f3ade84a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:40.988391 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:40.988355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j9qz\" (UniqueName: \"kubernetes.io/projected/4a77395f-cff3-4ee7-92df-329d6e4417bf-kube-api-access-9j9qz\") pod \"payload-pre-processing-579785bc64-h6xqc\" (UID: \"4a77395f-cff3-4ee7-92df-329d6e4417bf\") " pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:41.001257 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.001231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j9qz\" (UniqueName: \"kubernetes.io/projected/4a77395f-cff3-4ee7-92df-329d6e4417bf-kube-api-access-9j9qz\") pod \"payload-pre-processing-579785bc64-h6xqc\" (UID: \"4a77395f-cff3-4ee7-92df-329d6e4417bf\") " pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:41.057513 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.057482 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:41.138678 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.138647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:41.227196 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.227164 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-t2jp6"] Jun 10 11:49:41.321173 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.321151 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-h6xqc"] Jun 10 11:49:41.323903 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:49:41.323862 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a77395f_cff3_4ee7_92df_329d6e4417bf.slice/crio-51b24144f0b5303f45f2cce79c3e4edd74a784798b447e8ef30dfbe2223148c9 WatchSource:0}: Error finding container 51b24144f0b5303f45f2cce79c3e4edd74a784798b447e8ef30dfbe2223148c9: Status 404 returned error can't find the container with id 51b24144f0b5303f45f2cce79c3e4edd74a784798b447e8ef30dfbe2223148c9 Jun 10 11:49:41.649146 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.649067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" event={"ID":"c59abf4c-af5e-44d8-a295-1a4f3ade84a2","Type":"ContainerStarted","Data":"f9c0aaa89fec9bb0298828371e162e760517159b9133a1a3b622f4604d1f349d"} Jun 10 11:49:41.650223 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:41.650199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" event={"ID":"4a77395f-cff3-4ee7-92df-329d6e4417bf","Type":"ContainerStarted","Data":"51b24144f0b5303f45f2cce79c3e4edd74a784798b447e8ef30dfbe2223148c9"} Jun 10 11:49:42.659369 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:42.659282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bb8bbb794-j84lc" event={"ID":"f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d","Type":"ContainerStarted","Data":"f9aee607862569bb2eab6e895258e45ab09e87cc1281ef508418138580e5af83"} Jun 10 11:49:42.659792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:42.659389 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:42.684054 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:42.683995 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7bb8bbb794-j84lc" podStartSLOduration=0.803261258 podStartE2EDuration="2.683974522s" totalImagesPullingTime="1.880713264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:42.683966474 +0000 UTC m=+907.112145707" watchObservedRunningTime="2026-06-10 11:49:42.683974522 +0000 UTC m=+907.112153755" Jun 10 11:49:44.671291 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.671246 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" event={"ID":"c59abf4c-af5e-44d8-a295-1a4f3ade84a2","Type":"ContainerStarted","Data":"5a55915fd9ed53666afbc87330f0d10f93cb17a902c023eeda6e2cf5c418d747"} Jun 10 11:49:44.671727 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.671397 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:44.672741 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.672720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" event={"ID":"4a77395f-cff3-4ee7-92df-329d6e4417bf","Type":"ContainerStarted","Data":"d94185291141cd9657efdd35248ac399c1f7c7b6a0867937c89db5c5748e1881"} Jun 10 11:49:44.672861 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.672836 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:49:44.689946 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.689902 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" podStartSLOduration=2.211282166 podStartE2EDuration="4.689890604s" totalImagesPullingTime="2.478608438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:44.689049987 +0000 UTC m=+909.117229318" watchObservedRunningTime="2026-06-10 11:49:44.689890604 +0000 UTC m=+909.118069833" Jun 10 11:49:44.707683 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:44.707639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" podStartSLOduration=2.328067413 podStartE2EDuration="4.707625948s" totalImagesPullingTime="2.379558535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:49:44.706077538 +0000 UTC m=+909.134256792" watchObservedRunningTime="2026-06-10 11:49:44.707625948 +0000 UTC m=+909.135805179" Jun 10 11:49:48.669564 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:48.669537 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7bb8bbb794-j84lc" Jun 10 11:49:55.680222 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:55.680194 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-t2jp6" Jun 10 11:49:55.680602 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:49:55.680259 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-h6xqc" Jun 10 11:50:28.236566 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.236535 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:50:28.239880 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.239857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.245583 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.245556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 11:50:28.245725 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.245608 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w5nhd\"" Jun 10 11:50:28.245725 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.245608 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 11:50:28.282904 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.282861 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:50:28.306704 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.306680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm5ck\" (UniqueName: \"kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.306836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.306747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.306836 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.306784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.407363 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.407331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.407363 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.407369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.407534 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.407453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm5ck\" (UniqueName: \"kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.408072 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.408055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.409762 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.409745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.418259 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.418238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm5ck\" (UniqueName: \"kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck\") pod \"authorino-75b44d5978-knb5j\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.548179 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.548103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:50:28.689728 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.689703 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:50:28.691977 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:50:28.691941 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4e764fa_8c6f_4052_9a79_e3a3ff5d2a50.slice/crio-af3b2462ee101457c743594f8d8e88bd3c02f075955d5a4c9294c0c3c861bee0 WatchSource:0}: Error finding container af3b2462ee101457c743594f8d8e88bd3c02f075955d5a4c9294c0c3c861bee0: Status 404 returned error can't find the container with id af3b2462ee101457c743594f8d8e88bd3c02f075955d5a4c9294c0c3c861bee0 Jun 10 11:50:28.693329 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.693310 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 11:50:28.896159 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:28.896073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b44d5978-knb5j" event={"ID":"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50","Type":"ContainerStarted","Data":"af3b2462ee101457c743594f8d8e88bd3c02f075955d5a4c9294c0c3c861bee0"} Jun 10 11:50:29.902046 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:29.902011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b44d5978-knb5j" event={"ID":"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50","Type":"ContainerStarted","Data":"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4"} Jun 10 11:50:29.959808 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:29.959758 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75b44d5978-knb5j" podStartSLOduration=1.563486573 podStartE2EDuration="1.959744314s" totalImagesPullingTime="396.257741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:50:29.959074802 +0000 UTC m=+954.387254058" watchObservedRunningTime="2026-06-10 11:50:29.959744314 +0000 UTC m=+954.387923545" Jun 10 11:50:39.454001 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.453963 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz"] Jun 10 11:50:39.457695 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.457678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.464374 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.464093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 11:50:39.464986 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.464967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 11:50:39.465036 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.465003 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 11:50:39.466405 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.466389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-prw45\"" Jun 10 11:50:39.505167 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.505130 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz"] Jun 10 11:50:39.506853 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.506828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.506986 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.506861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.506986 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.506940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.506986 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.506970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00633b45-b251-429f-83fd-25c5f27dfc76-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.507110 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.507035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvz5\" (UniqueName: \"kubernetes.io/projected/00633b45-b251-429f-83fd-25c5f27dfc76-kube-api-access-fxvz5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.507110 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.507068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608203 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608203 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00633b45-b251-429f-83fd-25c5f27dfc76-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608396 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvz5\" (UniqueName: \"kubernetes.io/projected/00633b45-b251-429f-83fd-25c5f27dfc76-kube-api-access-fxvz5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608396 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608531 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608591 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608785 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608764 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608887 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608858 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.608937 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.608914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.611032 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.611012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00633b45-b251-429f-83fd-25c5f27dfc76-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.611347 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.611328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00633b45-b251-429f-83fd-25c5f27dfc76-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.618512 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.618489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvz5\" (UniqueName: \"kubernetes.io/projected/00633b45-b251-429f-83fd-25c5f27dfc76-kube-api-access-fxvz5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jr9pz\" (UID: \"00633b45-b251-429f-83fd-25c5f27dfc76\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.768697 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.768621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:50:39.918658 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.918635 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz"] Jun 10 11:50:39.921043 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:50:39.921009 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00633b45_b251_429f_83fd_25c5f27dfc76.slice/crio-779dc74e4a479eb04c776246dce0b7568f8a16ce33d3904475262f5f65f666d9 WatchSource:0}: Error finding container 779dc74e4a479eb04c776246dce0b7568f8a16ce33d3904475262f5f65f666d9: Status 404 returned error can't find the container with id 779dc74e4a479eb04c776246dce0b7568f8a16ce33d3904475262f5f65f666d9 Jun 10 11:50:39.952565 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:39.952532 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" event={"ID":"00633b45-b251-429f-83fd-25c5f27dfc76","Type":"ContainerStarted","Data":"779dc74e4a479eb04c776246dce0b7568f8a16ce33d3904475262f5f65f666d9"} Jun 10 11:50:42.969784 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:50:42.969755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" event={"ID":"00633b45-b251-429f-83fd-25c5f27dfc76","Type":"ContainerStarted","Data":"000e74d61528bb45448c17726db83ba470d2cc806901f019bfdef04786ea9d8c"} Jun 10 11:51:15.370803 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.370773 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg"] Jun 10 11:51:15.383148 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.383124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.391069 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.390533 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 11:51:15.392403 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.392372 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg"] Jun 10 11:51:15.522113 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522072 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02313cef-5add-45b0-af95-2375934a3f5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.522271 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hq4\" (UniqueName: \"kubernetes.io/projected/02313cef-5add-45b0-af95-2375934a3f5d-kube-api-access-j5hq4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.522328 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.522366 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.522433 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.522491 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.522443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623056 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.622973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623056 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02313cef-5add-45b0-af95-2375934a3f5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hq4\" (UniqueName: \"kubernetes.io/projected/02313cef-5add-45b0-af95-2375934a3f5d-kube-api-access-j5hq4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623472 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623515 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.623613 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.623585 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.625374 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.625350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02313cef-5add-45b0-af95-2375934a3f5d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.625530 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.625512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02313cef-5add-45b0-af95-2375934a3f5d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.636190 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.636171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hq4\" (UniqueName: \"kubernetes.io/projected/02313cef-5add-45b0-af95-2375934a3f5d-kube-api-access-j5hq4\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tc8qg\" (UID: \"02313cef-5add-45b0-af95-2375934a3f5d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.694718 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.694694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:51:15.840375 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:15.840348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg"] Jun 10 11:51:15.842119 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:51:15.842093 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02313cef_5add_45b0_af95_2375934a3f5d.slice/crio-9fdad39c25e2b16b15323025cbf483473d190381054dc3299cc1007572bd8fda WatchSource:0}: Error finding container 9fdad39c25e2b16b15323025cbf483473d190381054dc3299cc1007572bd8fda: Status 404 returned error can't find the container with id 9fdad39c25e2b16b15323025cbf483473d190381054dc3299cc1007572bd8fda Jun 10 11:51:16.146720 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:16.146633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" event={"ID":"02313cef-5add-45b0-af95-2375934a3f5d","Type":"ContainerStarted","Data":"f7c6aa546776b2ac7c788aee3b124cdf1cfcb20b4e9e9ff04fd521b1b63a0191"} Jun 10 11:51:16.146720 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:16.146676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" event={"ID":"02313cef-5add-45b0-af95-2375934a3f5d","Type":"ContainerStarted","Data":"9fdad39c25e2b16b15323025cbf483473d190381054dc3299cc1007572bd8fda"} Jun 10 11:51:37.252253 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:37.252220 2563 generic.go:356] "Generic (PLEG): container finished" podID="00633b45-b251-429f-83fd-25c5f27dfc76" containerID="000e74d61528bb45448c17726db83ba470d2cc806901f019bfdef04786ea9d8c" exitCode=0 Jun 10 11:51:37.252637 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:37.252301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" event={"ID":"00633b45-b251-429f-83fd-25c5f27dfc76","Type":"ContainerDied","Data":"000e74d61528bb45448c17726db83ba470d2cc806901f019bfdef04786ea9d8c"} Jun 10 11:51:39.265028 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:39.264990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" event={"ID":"00633b45-b251-429f-83fd-25c5f27dfc76","Type":"ContainerStarted","Data":"ad291afd235804516f2b8d1d87e395a2a0272932424a8004b96cd6fc6e4d9a92"} Jun 10 11:51:39.302812 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:39.302758 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" podStartSLOduration=2.680631498 podStartE2EDuration="1m0.30274186s" totalImagesPullingTime="3.710098945s" totalInitContainerRuntime="53.912011417s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:50:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:51:39.301455075 +0000 UTC m=+1023.729634307" watchObservedRunningTime="2026-06-10 11:51:39.30274186 +0000 UTC m=+1023.730921091" Jun 10 11:51:39.769668 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:39.769641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:51:39.769827 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:39.769761 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:51:39.782226 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:39.782200 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:51:40.280967 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:51:40.280939 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jr9pz" Jun 10 11:52:10.425010 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:10.424973 2563 generic.go:356] "Generic (PLEG): container finished" podID="02313cef-5add-45b0-af95-2375934a3f5d" containerID="f7c6aa546776b2ac7c788aee3b124cdf1cfcb20b4e9e9ff04fd521b1b63a0191" exitCode=0 Jun 10 11:52:10.425400 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:10.425044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" event={"ID":"02313cef-5add-45b0-af95-2375934a3f5d","Type":"ContainerDied","Data":"f7c6aa546776b2ac7c788aee3b124cdf1cfcb20b4e9e9ff04fd521b1b63a0191"} Jun 10 11:52:11.432135 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:11.432103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" event={"ID":"02313cef-5add-45b0-af95-2375934a3f5d","Type":"ContainerStarted","Data":"3d76af24f6c3f7f4e71d0f7dce891b4aa1e904138126d7bdc8d423d3ee8eeec3"} Jun 10 11:52:11.466516 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:11.466451 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" podStartSLOduration=2.621113012 podStartE2EDuration="56.466430317s" totalImagesPullingTime="245.610215ms" totalInitContainerRuntime="53.59970709s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:52:11.466399926 +0000 UTC m=+1055.894579160" watchObservedRunningTime="2026-06-10 11:52:11.466430317 +0000 UTC m=+1055.894609550" Jun 10 11:52:15.695825 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:15.695788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:52:15.696298 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:15.695839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:52:15.708447 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:15.708420 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:52:16.468170 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:16.468139 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tc8qg" Jun 10 11:52:23.409125 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.409093 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:52:23.409606 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.409331 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75b44d5978-knb5j" podUID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" containerName="authorino" containerID="cri-o://39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4" gracePeriod=30 Jun 10 11:52:23.673975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.673952 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:52:23.708139 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.708111 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert\") pod \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " Jun 10 11:52:23.708269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.708176 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca\") pod \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " Jun 10 11:52:23.708269 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.708262 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm5ck\" (UniqueName: \"kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck\") pod \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\" (UID: \"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50\") " Jun 10 11:52:23.710224 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.710185 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck" (OuterVolumeSpecName: "kube-api-access-vm5ck") pod "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" (UID: "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50"). InnerVolumeSpecName "kube-api-access-vm5ck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:52:23.713524 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.713496 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" (UID: "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:52:23.721535 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.721509 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" (UID: "d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:52:23.809975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.809943 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-tls-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:52:23.809975 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.809969 2563 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-oidc-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:52:23.810136 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:23.809984 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm5ck\" (UniqueName: \"kubernetes.io/projected/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50-kube-api-access-vm5ck\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:52:24.496713 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.496681 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" containerID="39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4" exitCode=0 Jun 10 11:52:24.497187 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.496725 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b44d5978-knb5j" Jun 10 11:52:24.497187 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.496758 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b44d5978-knb5j" event={"ID":"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50","Type":"ContainerDied","Data":"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4"} Jun 10 11:52:24.497187 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.496788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b44d5978-knb5j" event={"ID":"d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50","Type":"ContainerDied","Data":"af3b2462ee101457c743594f8d8e88bd3c02f075955d5a4c9294c0c3c861bee0"} Jun 10 11:52:24.497187 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.496804 2563 scope.go:117] "RemoveContainer" containerID="39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4" Jun 10 11:52:24.505686 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.505670 2563 scope.go:117] "RemoveContainer" containerID="39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4" Jun 10 11:52:24.506005 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:52:24.505983 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4\": container with ID starting with 39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4 not found: ID does not exist" containerID="39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4" Jun 10 11:52:24.506077 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.506013 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4"} err="failed to get container status \"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4\": rpc error: code = NotFound desc = could not find container \"39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4\": container with ID starting with 39c6b01e3637277f34265b944772b1f2af7f0fd53f17cd34e37697c39267c1b4 not found: ID does not exist" Jun 10 11:52:24.521654 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.521629 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:52:24.523538 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:24.523517 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75b44d5978-knb5j"] Jun 10 11:52:26.032884 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:52:26.032839 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" path="/var/lib/kubelet/pods/d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50/volumes" Jun 10 11:54:29.133543 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.133514 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:54:29.134070 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.133695 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84759b5687-46gk5" podUID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" containerName="manager" containerID="cri-o://8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045" gracePeriod=30 Jun 10 11:54:29.389223 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.389170 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:54:29.518910 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.518859 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnnqr\" (UniqueName: \"kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr\") pod \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " Jun 10 11:54:29.519071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.518964 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") pod \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\" (UID: \"1027e3ef-6343-41bb-ba83-5f7af4a991d7\") " Jun 10 11:54:29.520798 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.520767 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr" (OuterVolumeSpecName: "kube-api-access-pnnqr") pod "1027e3ef-6343-41bb-ba83-5f7af4a991d7" (UID: "1027e3ef-6343-41bb-ba83-5f7af4a991d7"). InnerVolumeSpecName "kube-api-access-pnnqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:54:29.520930 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.520851 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1027e3ef-6343-41bb-ba83-5f7af4a991d7" (UID: "1027e3ef-6343-41bb-ba83-5f7af4a991d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:54:29.620071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.620044 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnnqr\" (UniqueName: \"kubernetes.io/projected/1027e3ef-6343-41bb-ba83-5f7af4a991d7-kube-api-access-pnnqr\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:54:29.620071 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:29.620066 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1027e3ef-6343-41bb-ba83-5f7af4a991d7-webhook-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:54:30.126110 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.126077 2563 generic.go:356] "Generic (PLEG): container finished" podID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" containerID="8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045" exitCode=0 Jun 10 11:54:30.126262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.126136 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-46gk5" Jun 10 11:54:30.126262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.126168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-46gk5" event={"ID":"1027e3ef-6343-41bb-ba83-5f7af4a991d7","Type":"ContainerDied","Data":"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045"} Jun 10 11:54:30.126262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.126226 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-46gk5" event={"ID":"1027e3ef-6343-41bb-ba83-5f7af4a991d7","Type":"ContainerDied","Data":"ad85c63235f8029d20e428974cce4ee244ec48c5ea97fd012198bb6c08e3d812"} Jun 10 11:54:30.126262 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.126256 2563 scope.go:117] "RemoveContainer" containerID="8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045" Jun 10 11:54:30.134612 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.134595 2563 scope.go:117] "RemoveContainer" containerID="8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045" Jun 10 11:54:30.134907 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:54:30.134888 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045\": container with ID starting with 8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045 not found: ID does not exist" containerID="8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045" Jun 10 11:54:30.134971 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.134915 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045"} err="failed to get container status \"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045\": rpc error: code = NotFound desc = could not find container \"8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045\": container with ID starting with 8c54eab2e3438a2dee00accaefda73eaf9ca98914909aa0454fe31a3b90e8045 not found: ID does not exist" Jun 10 11:54:30.144036 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.144013 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:54:30.148783 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.148757 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84759b5687-46gk5"] Jun 10 11:54:30.927786 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.927750 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84759b5687-z9627"] Jun 10 11:54:30.928156 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928142 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" containerName="authorino" Jun 10 11:54:30.928206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928157 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" containerName="authorino" Jun 10 11:54:30.928206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928182 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" containerName="manager" Jun 10 11:54:30.928206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928188 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" containerName="manager" Jun 10 11:54:30.928527 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928249 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" containerName="manager" Jun 10 11:54:30.928527 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.928257 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e764fa-8c6f-4052-9a79-e3a3ff5d2a50" containerName="authorino" Jun 10 11:54:30.932531 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.932513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:30.935153 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.935132 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dmfl9\"" Jun 10 11:54:30.936023 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.936005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 11:54:30.936105 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.936012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 11:54:30.941884 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:30.941852 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84759b5687-z9627"] Jun 10 11:54:31.032305 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.032273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113535e4-080b-420b-92a5-706e8aa11bbf-webhook-cert\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.032465 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.032372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhc8g\" (UniqueName: \"kubernetes.io/projected/113535e4-080b-420b-92a5-706e8aa11bbf-kube-api-access-mhc8g\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.133485 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.133461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhc8g\" (UniqueName: \"kubernetes.io/projected/113535e4-080b-420b-92a5-706e8aa11bbf-kube-api-access-mhc8g\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.133620 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.133512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113535e4-080b-420b-92a5-706e8aa11bbf-webhook-cert\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.135979 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.135955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113535e4-080b-420b-92a5-706e8aa11bbf-webhook-cert\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.142594 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.142570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhc8g\" (UniqueName: \"kubernetes.io/projected/113535e4-080b-420b-92a5-706e8aa11bbf-kube-api-access-mhc8g\") pod \"maas-controller-84759b5687-z9627\" (UID: \"113535e4-080b-420b-92a5-706e8aa11bbf\") " pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.243857 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.243787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:31.375059 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:31.375036 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84759b5687-z9627"] Jun 10 11:54:31.377034 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:54:31.376998 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113535e4_080b_420b_92a5_706e8aa11bbf.slice/crio-c43081cf7cb8e9afe99ba3f3ce880ffda5653dcc52e63ff5568724fd5c7f4b9b WatchSource:0}: Error finding container c43081cf7cb8e9afe99ba3f3ce880ffda5653dcc52e63ff5568724fd5c7f4b9b: Status 404 returned error can't find the container with id c43081cf7cb8e9afe99ba3f3ce880ffda5653dcc52e63ff5568724fd5c7f4b9b Jun 10 11:54:32.032428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:32.032396 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1027e3ef-6343-41bb-ba83-5f7af4a991d7" path="/var/lib/kubelet/pods/1027e3ef-6343-41bb-ba83-5f7af4a991d7/volumes" Jun 10 11:54:32.138706 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:32.138630 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-z9627" event={"ID":"113535e4-080b-420b-92a5-706e8aa11bbf","Type":"ContainerStarted","Data":"9c6d3d51435398b0136b1817935524bc2073047fc8ceaccba753c7e328ea69c0"} Jun 10 11:54:32.138706 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:32.138679 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84759b5687-z9627" event={"ID":"113535e4-080b-420b-92a5-706e8aa11bbf","Type":"ContainerStarted","Data":"c43081cf7cb8e9afe99ba3f3ce880ffda5653dcc52e63ff5568724fd5c7f4b9b"} Jun 10 11:54:32.139107 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:32.138710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:54:32.161264 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:32.161221 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84759b5687-z9627" podStartSLOduration=1.66901573 podStartE2EDuration="2.161203096s" totalImagesPullingTime="492.187366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:54:32.159201858 +0000 UTC m=+1196.587381090" watchObservedRunningTime="2026-06-10 11:54:32.161203096 +0000 UTC m=+1196.589382332" Jun 10 11:54:36.079223 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:36.079199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:54:36.081797 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:36.081773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:54:36.083792 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:36.083770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:54:36.086264 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:36.086246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:54:43.149584 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:54:43.149555 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84759b5687-z9627" Jun 10 11:56:08.405670 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.405634 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8898879-zdnkc"] Jun 10 11:56:08.409354 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.409332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.420666 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.420642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8898879-zdnkc"] Jun 10 11:56:08.493387 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-oauth-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-oauth-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczrg\" (UniqueName: \"kubernetes.io/projected/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-kube-api-access-kczrg\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493540 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493675 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-trusted-ca-bundle\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.493675 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.493575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-service-ca\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-trusted-ca-bundle\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594206 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-service-ca\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-oauth-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-oauth-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczrg\" (UniqueName: \"kubernetes.io/projected/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-kube-api-access-kczrg\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.594428 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.594346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.595084 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.595060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.595084 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.595066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-service-ca\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.595277 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.595170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-trusted-ca-bundle\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.595277 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.595187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-oauth-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.596830 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.596800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-oauth-config\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.596962 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.596905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-console-serving-cert\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.603082 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.603066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczrg\" (UniqueName: \"kubernetes.io/projected/ecf41f6c-49cc-42ba-aa4b-151fcdca7712-kube-api-access-kczrg\") pod \"console-5f8898879-zdnkc\" (UID: \"ecf41f6c-49cc-42ba-aa4b-151fcdca7712\") " pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.718962 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.718931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:08.852780 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:08.852751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8898879-zdnkc"] Jun 10 11:56:08.854691 ip-10-0-132-117 kubenswrapper[2563]: W0610 11:56:08.854665 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf41f6c_49cc_42ba_aa4b_151fcdca7712.slice/crio-957ce8cd9bf06406d37dc8ac6d96f0ac81fbb375d72ec4484d0ccb92f1594480 WatchSource:0}: Error finding container 957ce8cd9bf06406d37dc8ac6d96f0ac81fbb375d72ec4484d0ccb92f1594480: Status 404 returned error can't find the container with id 957ce8cd9bf06406d37dc8ac6d96f0ac81fbb375d72ec4484d0ccb92f1594480 Jun 10 11:56:09.638983 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:09.638945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8898879-zdnkc" event={"ID":"ecf41f6c-49cc-42ba-aa4b-151fcdca7712","Type":"ContainerStarted","Data":"303423db4878213b07aca966905a9de4707a2fc64a0626d9874ec84666df0b4c"} Jun 10 11:56:09.639408 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:09.639000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8898879-zdnkc" event={"ID":"ecf41f6c-49cc-42ba-aa4b-151fcdca7712","Type":"ContainerStarted","Data":"957ce8cd9bf06406d37dc8ac6d96f0ac81fbb375d72ec4484d0ccb92f1594480"} Jun 10 11:56:09.660458 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:09.660412 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8898879-zdnkc" podStartSLOduration=1.6603986659999999 podStartE2EDuration="1.660398666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 11:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 11:56:09.657759173 +0000 UTC m=+1294.085938415" watchObservedRunningTime="2026-06-10 11:56:09.660398666 +0000 UTC m=+1294.088577897" Jun 10 11:56:18.720112 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:18.720078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:18.720584 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:18.720150 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:18.724698 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:18.724675 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:19.693754 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:19.693720 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8898879-zdnkc" Jun 10 11:56:19.743888 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:19.743819 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:56:44.773927 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:44.773855 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f458f9f44-z84zh" podUID="25a24339-4443-4b32-845d-394f54109630" containerName="console" containerID="cri-o://61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64" gracePeriod=15 Jun 10 11:56:45.037802 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.037731 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:56:45.127572 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127540 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.127749 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127590 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.127749 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127617 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.127749 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127650 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcjmm\" (UniqueName: \"kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.127749 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127691 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.128016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127773 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.128016 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127803 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle\") pod \"25a24339-4443-4b32-845d-394f54109630\" (UID: \"25a24339-4443-4b32-845d-394f54109630\") " Jun 10 11:56:45.128124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.128024 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca" (OuterVolumeSpecName: "service-ca") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:56:45.128124 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.127995 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config" (OuterVolumeSpecName: "console-config") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:56:45.128244 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.128223 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-console-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.128244 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.128241 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-service-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.128343 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.128265 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:56:45.128436 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.128414 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 11:56:45.130062 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.130027 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:56:45.130062 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.130052 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm" (OuterVolumeSpecName: "kube-api-access-jcjmm") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "kube-api-access-jcjmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 11:56:45.130244 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.130077 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25a24339-4443-4b32-845d-394f54109630" (UID: "25a24339-4443-4b32-845d-394f54109630"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 11:56:45.229138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.229110 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-oauth-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.229138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.229136 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25a24339-4443-4b32-845d-394f54109630-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.229138 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.229145 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-oauth-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.229352 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.229153 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcjmm\" (UniqueName: \"kubernetes.io/projected/25a24339-4443-4b32-845d-394f54109630-kube-api-access-jcjmm\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.229352 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.229163 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a24339-4443-4b32-845d-394f54109630-console-serving-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 11:56:45.821432 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.821394 2563 generic.go:356] "Generic (PLEG): container finished" podID="25a24339-4443-4b32-845d-394f54109630" containerID="61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64" exitCode=0 Jun 10 11:56:45.821854 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.821438 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f458f9f44-z84zh" Jun 10 11:56:45.821854 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.821480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f458f9f44-z84zh" event={"ID":"25a24339-4443-4b32-845d-394f54109630","Type":"ContainerDied","Data":"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64"} Jun 10 11:56:45.821854 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.821527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f458f9f44-z84zh" event={"ID":"25a24339-4443-4b32-845d-394f54109630","Type":"ContainerDied","Data":"7cbb8bda07fc990cd70d5317b7b37eef2798138debf7709233d36c796c64f6c0"} Jun 10 11:56:45.821854 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.821547 2563 scope.go:117] "RemoveContainer" containerID="61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64" Jun 10 11:56:45.831039 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.831008 2563 scope.go:117] "RemoveContainer" containerID="61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64" Jun 10 11:56:45.831298 ip-10-0-132-117 kubenswrapper[2563]: E0610 11:56:45.831280 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64\": container with ID starting with 61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64 not found: ID does not exist" containerID="61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64" Jun 10 11:56:45.831369 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.831307 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64"} err="failed to get container status \"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64\": rpc error: code = NotFound desc = could not find container \"61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64\": container with ID starting with 61d4e04797a942dd44b1aa046e2a5a414d96863da355a20b4d884838d5404b64 not found: ID does not exist" Jun 10 11:56:45.848285 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.848261 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:56:45.856486 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:45.856464 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f458f9f44-z84zh"] Jun 10 11:56:46.034356 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:56:46.034315 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a24339-4443-4b32-845d-394f54109630" path="/var/lib/kubelet/pods/25a24339-4443-4b32-845d-394f54109630/volumes" Jun 10 11:59:36.110033 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:59:36.110002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:59:36.113933 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:59:36.113907 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 11:59:36.114553 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:59:36.114537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 11:59:36.118455 ip-10-0-132-117 kubenswrapper[2563]: I0610 11:59:36.118433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:04:36.141042 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:04:36.141008 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:04:36.145613 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:04:36.145588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:04:36.145738 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:04:36.145670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:04:36.150004 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:04:36.149987 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:09:36.172073 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:09:36.172039 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:09:36.176280 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:09:36.176260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:09:36.176531 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:09:36.176517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:09:36.181399 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:09:36.181383 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:14:36.203309 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:36.203276 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:14:36.208218 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:36.208199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:14:36.210107 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:36.210091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:14:36.214454 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:36.214434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tx78s_8700e99d-c3f9-4c5f-aa17-100e7ae43dd7/ovn-acl-logging/0.log" Jun 10 12:14:50.488744 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.488662 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:14:50.489354 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.489320 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a24339-4443-4b32-845d-394f54109630" containerName="console" Jun 10 12:14:50.489354 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.489345 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a24339-4443-4b32-845d-394f54109630" containerName="console" Jun 10 12:14:50.489547 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.489454 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a24339-4443-4b32-845d-394f54109630" containerName="console" Jun 10 12:14:50.491596 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.491579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.494763 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.494744 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f576e782-openshift-default-dockercfg-th27j\"" Jun 10 12:14:50.519792 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.519766 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:14:50.586291 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586291 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8hn\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.586620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.586587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687077 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687077 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687340 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687340 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8hn\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687340 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687340 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687340 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687614 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687614 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687719 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687719 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687637 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687719 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.687914 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.687800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.688258 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.688235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.689788 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.689769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.690002 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.689972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.704620 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.704592 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8hn\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.704952 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.704930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token\") pod \"e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.811457 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.811373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:50.988603 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.988571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:14:50.991951 ip-10-0-132-117 kubenswrapper[2563]: W0610 12:14:50.991921 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178ea407_6b38_42fb_b097_b652bf5d1507.slice/crio-ded3db18e68da2cbc4fed6f768a0d8c2929c29a9b9e7f2a22c80382b970e202c WatchSource:0}: Error finding container ded3db18e68da2cbc4fed6f768a0d8c2929c29a9b9e7f2a22c80382b970e202c: Status 404 returned error can't find the container with id ded3db18e68da2cbc4fed6f768a0d8c2929c29a9b9e7f2a22c80382b970e202c Jun 10 12:14:50.993808 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:50.993793 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:14:51.316472 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:51.316438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" event={"ID":"178ea407-6b38-42fb-b097-b652bf5d1507","Type":"ContainerStarted","Data":"ded3db18e68da2cbc4fed6f768a0d8c2929c29a9b9e7f2a22c80382b970e202c"} Jun 10 12:14:53.346792 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:53.346754 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 12:14:53.347074 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:53.346829 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 12:14:53.347074 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:53.346857 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 12:14:54.335025 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:54.334993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" event={"ID":"178ea407-6b38-42fb-b097-b652bf5d1507","Type":"ContainerStarted","Data":"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6"} Jun 10 12:14:54.362704 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:54.362658 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" podStartSLOduration=2.010155963 podStartE2EDuration="4.362640964s" totalImagesPullingTime="2.352485001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:54.360963101 +0000 UTC m=+2418.789142337" watchObservedRunningTime="2026-06-10 12:14:54.362640964 +0000 UTC m=+2418.790820255" Jun 10 12:14:54.811957 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:54.811922 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:54.816782 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:54.816759 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:55.339745 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:55.339715 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:55.340575 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:55.340553 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:14:56.964201 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:56.964162 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:14:57.350395 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:57.350319 2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" secret="" err="secret \"e2e-ait-f576e782-openshift-default-dockercfg-th27j\" not found" Jun 10 12:14:58.355213 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:14:58.355171 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" podUID="178ea407-6b38-42fb-b097-b652bf5d1507" containerName="istio-proxy" containerID="cri-o://ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6" gracePeriod=30 Jun 10 12:15:03.613859 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.613801 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:15:03.707689 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707647 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707689 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707693 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707729 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707774 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707804 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707838 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs8hn\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707884 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.707969 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707967 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.708272 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.707964 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data" (OuterVolumeSpecName: "istio-data") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:03.708272 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708020 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert\") pod \"178ea407-6b38-42fb-b097-b652bf5d1507\" (UID: \"178ea407-6b38-42fb-b097-b652bf5d1507\") " Jun 10 12:15:03.708377 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708018 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:03.708377 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708200 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:03.708377 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708238 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:03.708377 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708328 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:15:03.708377 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.708341 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-data\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.710214 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.710193 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:03.710349 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.710319 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token" (OuterVolumeSpecName: "istio-token") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:03.710349 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.710330 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 12:15:03.710479 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.710364 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn" (OuterVolumeSpecName: "kube-api-access-cs8hn") pod "178ea407-6b38-42fb-b097-b652bf5d1507" (UID: "178ea407-6b38-42fb-b097-b652bf5d1507"). InnerVolumeSpecName "kube-api-access-cs8hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:03.809784 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809751 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-istio-token\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809784 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809785 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-istio-envoy\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809796 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs8hn\" (UniqueName: \"kubernetes.io/projected/178ea407-6b38-42fb-b097-b652bf5d1507-kube-api-access-cs8hn\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809809 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-credential-socket\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809818 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809826 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/178ea407-6b38-42fb-b097-b652bf5d1507-istiod-ca-cert\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809834 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/178ea407-6b38-42fb-b097-b652bf5d1507-istio-podinfo\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:03.809997 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:03.809842 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/178ea407-6b38-42fb-b097-b652bf5d1507-workload-socket\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" Jun 10 12:15:04.386063 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.385977 2563 generic.go:356] "Generic (PLEG): container finished" podID="178ea407-6b38-42fb-b097-b652bf5d1507" containerID="ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6" exitCode=0 Jun 10 12:15:04.386063 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.386030 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" Jun 10 12:15:04.386252 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.386058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" event={"ID":"178ea407-6b38-42fb-b097-b652bf5d1507","Type":"ContainerDied","Data":"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6"} Jun 10 12:15:04.386252 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.386109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6" event={"ID":"178ea407-6b38-42fb-b097-b652bf5d1507","Type":"ContainerDied","Data":"ded3db18e68da2cbc4fed6f768a0d8c2929c29a9b9e7f2a22c80382b970e202c"} Jun 10 12:15:04.386252 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.386132 2563 scope.go:117] "RemoveContainer" containerID="ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6" Jun 10 12:15:04.395525 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.395506 2563 scope.go:117] "RemoveContainer" containerID="ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6" Jun 10 12:15:04.395781 ip-10-0-132-117 kubenswrapper[2563]: E0610 12:15:04.395762 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6\": container with ID starting with ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6 not found: ID does not exist" containerID="ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6" Jun 10 12:15:04.395827 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.395786 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6"} err="failed to get container status \"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6\": rpc error: code = NotFound desc = could not find container \"ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6\": container with ID starting with ed0740afae5cff37e8b269d558ed300b81adefe504380e22c4b54a24da32a2c6 not found: ID does not exist" Jun 10 12:15:04.428111 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.428080 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:15:04.442402 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:04.442381 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f576e782-openshift-default-7446cf94f8-kdzf6"] Jun 10 12:15:06.034429 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:06.034396 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="178ea407-6b38-42fb-b097-b652bf5d1507" path="/var/lib/kubelet/pods/178ea407-6b38-42fb-b097-b652bf5d1507/volumes" Jun 10 12:15:29.222188 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:29.222156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66d5f69bf8-bb826_784ca7bd-c003-4a09-8c14-30b2993f1536/nginx/0.log" Jun 10 12:15:29.332675 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:29.332644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mj25g_61dd2bae-00d2-4e61-83d7-f77f42f546d7/manager/0.log" Jun 10 12:15:29.461148 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:29.461119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tphhd_d5dda62f-4026-45b6-bd7c-b77869168f79/manager/0.log" Jun 10 12:15:29.585315 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:29.585237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bb8bbb794-j84lc_f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d/maas-api/0.log" Jun 10 12:15:29.942681 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:29.942649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84759b5687-z9627_113535e4-080b-420b-92a5-706e8aa11bbf/manager/0.log" Jun 10 12:15:30.055723 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:30.055697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c6q48_9df7c992-85d3-4379-8158-1b987ca72a82/server/0.log" Jun 10 12:15:30.176597 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:30.176570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-w4nbw_2a100da7-06f8-4347-a539-214b5499ed75/manager/0.log" Jun 10 12:15:30.296287 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:30.296218 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f4bbdb8d-975qp_4392c4cc-e9e7-4d3c-a030-386262d366f7/copy-manifests/0.log" Jun 10 12:15:30.317182 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:30.317153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f4bbdb8d-975qp_4392c4cc-e9e7-4d3c-a030-386262d366f7/manager/0.log" Jun 10 12:15:32.106076 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:32.106043 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9lmf_172cde76-5649-41a2-b957-75744d9a080d/manager/0.log" Jun 10 12:15:32.834771 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:32.834741 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlpnd_7fecbe0f-dfa8-4898-8183-0632e6d3d2a6/manager/0.log" Jun 10 12:15:33.354578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:33.354548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mdxqk_47b631d4-bdf0-43ee-865d-ea3683fa7dc0/discovery/0.log" Jun 10 12:15:33.471516 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:33.471487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77789cbd49-2vbf2_8689e67f-5c7b-45a8-a345-62a451a9191f/kube-auth-proxy/0.log" Jun 10 12:15:33.848854 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:33.848828 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-h6xqc_4a77395f-cff3-4ee7-92df-329d6e4417bf/payload-pre-processing/0.log" Jun 10 12:15:33.967926 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:33.967894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-t2jp6_c59abf4c-af5e-44d8-a295-1a4f3ade84a2/payload-processing/0.log" Jun 10 12:15:34.084946 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:34.084912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log" Jun 10 12:15:34.574694 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:34.574637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jr9pz_00633b45-b251-429f-83fd-25c5f27dfc76/storage-initializer/0.log" Jun 10 12:15:34.585082 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:34.585058 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jr9pz_00633b45-b251-429f-83fd-25c5f27dfc76/main/0.log" Jun 10 12:15:35.064579 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:35.064542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tc8qg_02313cef-5add-45b0-af95-2375934a3f5d/storage-initializer/0.log" Jun 10 12:15:35.074950 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:35.074927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tc8qg_02313cef-5add-45b0-af95-2375934a3f5d/main/0.log" Jun 10 12:15:42.676023 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:42.675994 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8nzpr_842bdaf9-d1c6-4228-b276-a461c295e0e2/global-pull-secret-syncer/0.log" Jun 10 12:15:42.940309 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:42.940227 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9k5pg_99146453-42b7-446d-ba6a-6a6c22e8e86f/konnectivity-agent/0.log" Jun 10 12:15:43.029808 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:43.029782 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-117.ec2.internal_9c31271bbde5f4411a9e783b19068f04/haproxy/0.log" Jun 10 12:15:45.319603 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:45.319567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-jdvlw_7bfddb55-382a-4213-8c2d-ef3feb2e36a2/sail-operator/0.log" Jun 10 12:15:47.595941 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:47.595912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m9lmf_172cde76-5649-41a2-b957-75744d9a080d/manager/0.log" Jun 10 12:15:48.041403 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:48.041359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlpnd_7fecbe0f-dfa8-4898-8183-0632e6d3d2a6/manager/0.log" Jun 10 12:15:49.680401 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.680373 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/alertmanager/0.log" Jun 10 12:15:49.721890 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.721837 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/config-reloader/0.log" Jun 10 12:15:49.756618 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.756588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/kube-rbac-proxy-web/0.log" Jun 10 12:15:49.793890 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.793855 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/kube-rbac-proxy/0.log" Jun 10 12:15:49.834319 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.834294 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/kube-rbac-proxy-metric/0.log" Jun 10 12:15:49.865351 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.865330 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/prom-label-proxy/0.log" Jun 10 12:15:49.898518 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:49.898499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_287a2536-bdc8-4b53-98ce-44cfb7dcf306/init-config-reloader/0.log" Jun 10 12:15:50.146300 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:50.146224 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d784c748f-sgknm_e472ebfb-1544-4f79-8302-18bf29599d6a/metrics-server/0.log" Jun 10 12:15:50.212995 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:50.212966 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-q6fxq_72936e51-18f7-483d-917a-d6880431adb5/monitoring-plugin/0.log" Jun 10 12:15:50.452289 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:50.452260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7x78g_bb85417b-bc0f-4aca-893f-4d85037d5985/node-exporter/0.log" Jun 10 12:15:50.505619 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:50.505594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7x78g_bb85417b-bc0f-4aca-893f-4d85037d5985/kube-rbac-proxy/0.log" Jun 10 12:15:50.575827 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:50.575793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7x78g_bb85417b-bc0f-4aca-893f-4d85037d5985/init-textfile/0.log" Jun 10 12:15:51.219334 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:51.219301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbfcc4cd6-sbmrb_79b185a6-558c-4e14-b46f-24c7bf00b258/telemeter-client/0.log" Jun 10 12:15:51.248438 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:51.248413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbfcc4cd6-sbmrb_79b185a6-558c-4e14-b46f-24c7bf00b258/reload/0.log" Jun 10 12:15:51.277193 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:51.277172 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dbfcc4cd6-sbmrb_79b185a6-558c-4e14-b46f-24c7bf00b258/kube-rbac-proxy/0.log" Jun 10 12:15:53.459116 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:53.459086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/2.log" Jun 10 12:15:53.466520 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:53.466493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-74wk7_5a3f4909-cca5-4fe5-bd17-3237402c8d59/console-operator/3.log" Jun 10 12:15:54.048723 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.048690 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb"] Jun 10 12:15:54.049184 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.049164 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178ea407-6b38-42fb-b097-b652bf5d1507" containerName="istio-proxy" Jun 10 12:15:54.049278 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.049185 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="178ea407-6b38-42fb-b097-b652bf5d1507" containerName="istio-proxy" Jun 10 12:15:54.049341 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.049309 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="178ea407-6b38-42fb-b097-b652bf5d1507" containerName="istio-proxy" Jun 10 12:15:54.053585 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.053562 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.056425 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.056406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rsbl\"/\"kube-root-ca.crt\"" Jun 10 12:15:54.056553 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.056536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7rsbl\"/\"default-dockercfg-z6l8n\"" Jun 10 12:15:54.057170 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.057153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rsbl\"/\"openshift-service-ca.crt\"" Jun 10 12:15:54.066600 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.066580 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb"] Jun 10 12:15:54.069476 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.069442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f8898879-zdnkc_ecf41f6c-49cc-42ba-aa4b-151fcdca7712/console/0.log" Jun 10 12:15:54.174537 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.174505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-proc\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.174687 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.174569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-sys\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.174687 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.174605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-lib-modules\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.174687 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.174625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvm5\" (UniqueName: \"kubernetes.io/projected/b8be4841-e44a-4612-b10b-2195128d7e55-kube-api-access-bnvm5\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.174810 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.174698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-podres\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275411 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-podres\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-proc\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-sys\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-lib-modules\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-podres\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275558 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-proc\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275578 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-sys\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275836 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvm5\" (UniqueName: \"kubernetes.io/projected/b8be4841-e44a-4612-b10b-2195128d7e55-kube-api-access-bnvm5\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.275836 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.275667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8be4841-e44a-4612-b10b-2195128d7e55-lib-modules\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.284474 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.284451 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvm5\" (UniqueName: \"kubernetes.io/projected/b8be4841-e44a-4612-b10b-2195128d7e55-kube-api-access-bnvm5\") pod \"perf-node-gather-daemonset-wfmdb\" (UID: \"b8be4841-e44a-4612-b10b-2195128d7e55\") " pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.363624 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.363548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.493927 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.493905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb"] Jun 10 12:15:54.496719 ip-10-0-132-117 kubenswrapper[2563]: W0610 12:15:54.496689 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8be4841_e44a_4612_b10b_2195128d7e55.slice/crio-4e05d27dcf520c632c1c82d22f86a545d8b11fd11d8b06f3a6893a3ccc944a42 WatchSource:0}: Error finding container 4e05d27dcf520c632c1c82d22f86a545d8b11fd11d8b06f3a6893a3ccc944a42: Status 404 returned error can't find the container with id 4e05d27dcf520c632c1c82d22f86a545d8b11fd11d8b06f3a6893a3ccc944a42 Jun 10 12:15:54.640431 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.640346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" event={"ID":"b8be4841-e44a-4612-b10b-2195128d7e55","Type":"ContainerStarted","Data":"624c798669194ca53ceda36e2eedd5558d773821c576934336143b6f8d0c887f"} Jun 10 12:15:54.640431 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.640398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" event={"ID":"b8be4841-e44a-4612-b10b-2195128d7e55","Type":"ContainerStarted","Data":"4e05d27dcf520c632c1c82d22f86a545d8b11fd11d8b06f3a6893a3ccc944a42"} Jun 10 12:15:54.640613 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.640478 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:15:54.661323 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:54.661281 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" podStartSLOduration=0.661267324 podStartE2EDuration="661.267324ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:54.659741451 +0000 UTC m=+2479.087920677" watchObservedRunningTime="2026-06-10 12:15:54.661267324 +0000 UTC m=+2479.089446555" Jun 10 12:15:56.317303 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:56.317267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfb4d_4c305467-2273-4e5d-9f9b-d2c1ce84db9e/dns/0.log" Jun 10 12:15:56.358684 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:56.358652 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wfb4d_4c305467-2273-4e5d-9f9b-d2c1ce84db9e/kube-rbac-proxy/0.log" Jun 10 12:15:56.472712 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:56.472685 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jsrxk_b3e746f5-1d3e-4e49-8f33-14ffaf17075b/dns-node-resolver/0.log" Jun 10 12:15:57.070118 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:57.070089 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxs9t_bc2b91ec-a050-43ce-94e3-19dc93a050ee/node-ca/0.log" Jun 10 12:15:58.238128 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:58.238094 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mdxqk_47b631d4-bdf0-43ee-865d-ea3683fa7dc0/discovery/0.log" Jun 10 12:15:58.263301 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:58.263274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77789cbd49-2vbf2_8689e67f-5c7b-45a8-a345-62a451a9191f/kube-auth-proxy/0.log" Jun 10 12:15:58.429965 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:58.429935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-h6xqc_4a77395f-cff3-4ee7-92df-329d6e4417bf/payload-pre-processing/0.log" Jun 10 12:15:58.533633 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:58.533551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-t2jp6_c59abf4c-af5e-44d8-a295-1a4f3ade84a2/payload-processing/0.log" Jun 10 12:15:58.556589 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:58.556566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log" Jun 10 12:15:59.246937 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:59.246901 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bvbcb_38187b12-9c42-4730-819c-c849ad36e361/serve-healthcheck-canary/0.log" Jun 10 12:15:59.838200 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:59.838170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc57t_697a1386-927d-4d1f-a750-a0b48a2f028c/kube-rbac-proxy/0.log" Jun 10 12:15:59.869810 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:59.869778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc57t_697a1386-927d-4d1f-a750-a0b48a2f028c/exporter/0.log" Jun 10 12:15:59.899800 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:15:59.899775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cc57t_697a1386-927d-4d1f-a750-a0b48a2f028c/extractor/0.log" Jun 10 12:16:00.655654 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:00.655628 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7rsbl/perf-node-gather-daemonset-wfmdb" Jun 10 12:16:02.576822 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:02.576792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66d5f69bf8-bb826_784ca7bd-c003-4a09-8c14-30b2993f1536/nginx/0.log" Jun 10 12:16:02.612094 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:02.612062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mj25g_61dd2bae-00d2-4e61-83d7-f77f42f546d7/manager/0.log" Jun 10 12:16:02.754601 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:02.754573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tphhd_d5dda62f-4026-45b6-bd7c-b77869168f79/manager/0.log" Jun 10 12:16:02.816477 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:02.816442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bb8bbb794-j84lc_f92cc6c7-7ea5-4367-b58b-cc9ee0e0582d/maas-api/0.log" Jun 10 12:16:02.990495 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:02.990460 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84759b5687-z9627_113535e4-080b-420b-92a5-706e8aa11bbf/manager/0.log" Jun 10 12:16:03.063441 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:03.063414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c6q48_9df7c992-85d3-4379-8158-1b987ca72a82/server/0.log" Jun 10 12:16:03.148163 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:03.148139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-w4nbw_2a100da7-06f8-4347-a539-214b5499ed75/manager/0.log" Jun 10 12:16:03.301079 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:03.301051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f4bbdb8d-975qp_4392c4cc-e9e7-4d3c-a030-386262d366f7/manager/0.log" Jun 10 12:16:03.323407 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:03.323387 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65f4bbdb8d-975qp_4392c4cc-e9e7-4d3c-a030-386262d366f7/copy-manifests/0.log" Jun 10 12:16:05.262826 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:05.262790 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w5k8x_c0622ae5-ff01-4d7c-8c54-cb0c4ef8894d/openshift-lws-operator/0.log" Jun 10 12:16:07.115775 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:07.115738 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mdxqk_47b631d4-bdf0-43ee-865d-ea3683fa7dc0/discovery/0.log" Jun 10 12:16:07.128103 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:07.128067 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77789cbd49-2vbf2_8689e67f-5c7b-45a8-a345-62a451a9191f/kube-auth-proxy/0.log" Jun 10 12:16:07.265084 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:07.265052 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-h6xqc_4a77395f-cff3-4ee7-92df-329d6e4417bf/payload-pre-processing/0.log" Jun 10 12:16:07.359685 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:07.359659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-t2jp6_c59abf4c-af5e-44d8-a295-1a4f3ade84a2/payload-processing/0.log" Jun 10 12:16:07.389830 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:07.389760 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log" Jun 10 12:16:08.614386 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:08.614357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mdxqk_47b631d4-bdf0-43ee-865d-ea3683fa7dc0/discovery/0.log" Jun 10 12:16:08.628220 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:08.628189 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77789cbd49-2vbf2_8689e67f-5c7b-45a8-a345-62a451a9191f/kube-auth-proxy/0.log" Jun 10 12:16:08.770413 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:08.770378 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-h6xqc_4a77395f-cff3-4ee7-92df-329d6e4417bf/payload-pre-processing/0.log" Jun 10 12:16:08.878531 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:08.878441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-t2jp6_c59abf4c-af5e-44d8-a295-1a4f3ade84a2/payload-processing/0.log" Jun 10 12:16:08.902860 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:08.902834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log" Jun 10 12:16:10.805586 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:10.805555 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mdxqk_47b631d4-bdf0-43ee-865d-ea3683fa7dc0/discovery/0.log" Jun 10 12:16:10.864187 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:10.864160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77789cbd49-2vbf2_8689e67f-5c7b-45a8-a345-62a451a9191f/kube-auth-proxy/0.log" Jun 10 12:16:10.864658 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:10.864635 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szvwn_be311aeb-979f-47f2-aa45-5996de79f3ab/migrator/0.log" Jun 10 12:16:10.909154 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:10.909129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-szvwn_be311aeb-979f-47f2-aa45-5996de79f3ab/graceful-termination/0.log" Jun 10 12:16:11.015545 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:11.015515 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-h6xqc_4a77395f-cff3-4ee7-92df-329d6e4417bf/payload-pre-processing/0.log" Jun 10 12:16:11.110314 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:11.110232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-t2jp6_c59abf4c-af5e-44d8-a295-1a4f3ade84a2/payload-processing/0.log" Jun 10 12:16:11.137884 ip-10-0-132-117 kubenswrapper[2563]: I0610 12:16:11.137852 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d4556dc89-rh2gn_b036be94-0925-4861-9276-419804b2655c/router/0.log"