Jun 11 16:31:30.469124 ip-10-0-129-45 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:31:30.898961 ip-10-0-129-45 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:30.898961 ip-10-0-129-45 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:31:30.898961 ip-10-0-129-45 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:30.898961 ip-10-0-129-45 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:31:30.898961 ip-10-0-129-45 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:31:30.899930 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.899830 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906310 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906332 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906336 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906339 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906343 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906346 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906349 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906351 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906354 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.906343 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906357 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906361 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906363 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906366 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906369 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906371 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906374 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906376 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906379 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906382 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906384 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906387 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906390 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906392 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906401 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906403 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906406 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906409 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906411 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906414 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.906681 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906416 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906419 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906422 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906424 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906427 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906429 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906432 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906435 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906437 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906439 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906442 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906445 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906447 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906450 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906453 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906456 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906459 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906461 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906464 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906467 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.907190 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906469 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906472 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906474 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906478 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906481 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906484 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906487 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906489 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906491 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906494 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906496 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906499 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906501 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906504 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906506 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906509 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906511 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906514 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906516 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906519 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.907676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906522 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906524 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906527 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906529 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906532 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906534 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906538 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906541 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906543 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906546 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906548 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906551 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906553 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906556 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906561 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906565 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906568 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906571 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906576 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.908212 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906580 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906583 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906587 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906591 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906594 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906597 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906600 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906602 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906605 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906608 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.906610 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907426 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907434 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907437 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907440 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907443 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907446 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907449 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907451 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.908672 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907455 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907458 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907461 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907464 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907467 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907469 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907472 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907475 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907477 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907487 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907490 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907493 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907496 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907498 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907501 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907503 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907506 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907509 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907511 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907514 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.909153 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907517 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907520 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907522 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907524 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907527 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907529 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907532 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907534 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907538 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907540 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907543 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907545 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907548 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907552 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907554 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907557 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907560 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907562 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907565 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.909661 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907569 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907574 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907577 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907581 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907584 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907586 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907589 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907592 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907594 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907598 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907601 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907604 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907606 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907609 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907611 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907614 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907617 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907619 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907622 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.910157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907624 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907627 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907629 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907633 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907635 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907638 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907640 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907643 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907646 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907649 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907651 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907654 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907656 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907660 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907664 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907667 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907669 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907673 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907675 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907678 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.910639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907680 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907683 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907686 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907689 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907692 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907694 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907697 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907699 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907701 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907704 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907707 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907709 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.907712 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908135 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908140 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908143 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908146 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908148 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908152 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908155 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.911157 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908158 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908161 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908163 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908166 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908168 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908171 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908174 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908176 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908179 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908182 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908185 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908187 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908190 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908192 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908196 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908198 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908201 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908204 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908206 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.911654 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908209 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908212 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908214 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908217 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908220 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908222 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908225 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908228 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908230 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908233 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908236 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908238 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908241 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908244 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908246 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908249 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908252 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908254 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908257 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908260 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.912145 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908262 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908267 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908270 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908274 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908277 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908280 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908283 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908286 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908289 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908292 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908294 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908297 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908299 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908302 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908304 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908308 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908310 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908313 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908315 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.912641 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908317 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908320 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908323 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908325 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908328 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908330 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908333 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908336 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908340 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908344 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908347 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908350 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908353 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908356 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908358 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908361 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908363 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908366 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908369 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908371 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.913173 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908374 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908376 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908379 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908381 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908384 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908386 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908388 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908391 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908395 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908398 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908401 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908403 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908406 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.908408 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908488 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908496 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908503 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908508 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908512 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908516 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908520 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:31:30.913676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908525 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908528 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908531 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908535 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908539 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908542 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908546 2554 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908551 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908555 2554 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908561 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908567 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908574 2554 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908577 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908580 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908583 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908587 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908591 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908594 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908597 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908601 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908604 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908607 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908610 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908613 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:31:30.914302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908615 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908620 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908623 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908626 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908629 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908632 2554 flags.go:64] FLAG: --enable-server="true" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908635 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908639 2554 flags.go:64] FLAG: --event-burst="100" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908642 2554 flags.go:64] FLAG: --event-qps="50" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908645 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908648 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908651 2554 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908655 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908657 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908660 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908663 2554 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908666 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908669 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908673 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908676 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908679 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908682 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908685 2554 flags.go:64] FLAG: --feature-gates="" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908689 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908692 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:31:30.914917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908695 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908698 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908701 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908704 2554 flags.go:64] FLAG: --help="false" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908707 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-129-45.ec2.internal" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908710 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908713 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908716 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908719 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908722 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908725 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908727 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908730 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908733 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908736 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908739 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908741 2554 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908744 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908750 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908767 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908770 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908773 2554 flags.go:64] FLAG: --lock-file="" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908776 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908779 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:31:30.915577 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908782 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908787 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908791 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908794 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908797 2554 flags.go:64] FLAG: --logging-format="text" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908800 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908803 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908806 2554 flags.go:64] FLAG: --manifest-url="" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908809 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908813 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908821 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908825 2554 flags.go:64] FLAG: --max-pods="110" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908828 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908831 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908834 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908837 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908840 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908843 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908846 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908854 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908857 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908861 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908864 2554 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:31:30.916197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908867 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908872 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908875 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908880 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908883 2554 flags.go:64] FLAG: --port="10250" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908886 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908889 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075a6c967f6b2522e" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908892 2554 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908895 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908898 2554 flags.go:64] FLAG: --register-node="true" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908901 2554 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908905 2554 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908908 2554 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908911 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908914 2554 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908918 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908921 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908924 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908927 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908930 2554 flags.go:64] FLAG: --runonce="false" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908934 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908937 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908940 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908944 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908947 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908950 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:31:30.916785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908953 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908956 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908959 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908962 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908965 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908968 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908971 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908974 2554 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908977 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908983 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908986 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908989 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908994 2554 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908997 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.908999 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909002 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909005 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909008 2554 flags.go:64] FLAG: --v="2" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909012 2554 flags.go:64] FLAG: --version="false" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909017 2554 flags.go:64] FLAG: --vmodule="" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909026 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.909030 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909150 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909153 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.917421 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909156 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909160 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909164 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909168 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909170 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909173 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909176 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909179 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909182 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909185 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909189 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909192 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909195 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909198 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909201 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909204 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909207 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909211 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909213 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909216 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.918063 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909219 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909221 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909224 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909226 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909229 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909232 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909234 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909237 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909240 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909243 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909245 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909248 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909250 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909253 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909257 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909259 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909262 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909264 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909267 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909270 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.918562 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909272 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909275 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909278 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909280 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909285 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909289 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909291 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909294 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909298 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909303 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909306 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909309 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909311 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909314 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909317 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909319 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909322 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909325 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909327 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.919081 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909330 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909332 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909335 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909338 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909341 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909343 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909346 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909350 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909352 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909356 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909360 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909363 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909366 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909369 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909372 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909374 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909377 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909380 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909382 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909385 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.919560 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909388 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909390 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909394 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909397 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909400 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909402 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909405 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909408 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909411 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909413 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909416 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909418 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909421 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909424 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909427 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909430 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909433 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.920099 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.909435 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.910083 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.918047 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.918227 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.919036 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.919044 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919120 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919126 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919130 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919133 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919136 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919139 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919142 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919145 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919149 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.920532 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919151 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919155 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919159 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919163 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919166 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919169 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919172 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919175 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919178 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919181 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919183 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919186 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919189 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919192 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919195 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919198 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919201 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919204 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919207 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919209 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.920976 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919213 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919215 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919218 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919221 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919223 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919226 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919228 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919233 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919235 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919238 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919240 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919243 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919246 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919249 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919251 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919254 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919256 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919260 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919264 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.921471 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919266 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919270 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919273 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919276 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919278 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919281 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919284 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919286 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919289 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919293 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919295 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919298 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919300 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919304 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919307 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919309 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919312 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919314 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919316 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919319 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.921965 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919322 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919324 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919327 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919329 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919332 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919334 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919337 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919340 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919344 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919347 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919349 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919352 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919355 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919357 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919360 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919362 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919365 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919367 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919370 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.922479 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919373 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919375 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919378 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919381 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919384 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919387 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919391 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919393 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919396 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919399 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919401 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919404 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.919409 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919535 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919541 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:31:30.922974 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919544 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919546 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919549 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919552 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919555 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919558 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919561 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919564 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919567 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919570 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919572 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919577 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919580 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919583 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919586 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919588 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919591 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919593 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919596 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:31:30.923347 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919598 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919601 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919604 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919607 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919611 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919614 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919617 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919620 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919622 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919625 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919627 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919630 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919634 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919638 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919641 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919644 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919646 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919649 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919652 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919655 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:31:30.923826 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919658 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919661 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919664 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919667 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919670 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919672 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919675 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919678 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919681 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919683 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919686 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919688 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919691 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919693 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919695 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919699 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919702 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919705 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919708 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919712 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:31:30.924316 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919715 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919718 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919721 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919723 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919726 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919729 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919731 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919734 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919736 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919739 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919741 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919744 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919747 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919749 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919771 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919774 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919776 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919779 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919782 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919785 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:31:30.924815 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919787 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919790 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919793 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919795 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919798 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919800 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919803 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919806 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919810 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919813 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919816 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919819 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919821 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919824 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919827 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919829 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919832 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:31:30.925309 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:30.919835 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.919841 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.919973 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.922083 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.923681 2554 server.go:1019] "Starting client certificate rotation" Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.923786 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:31:30.925749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.923825 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:31:30.926368 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.926352 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:31:30.928421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.928397 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:31:30.935969 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.935944 2554 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:31:30.938462 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.938445 2554 log.go:25] "Validated CRI v1 image API" Jun 11 16:31:30.939206 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.939186 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:31:30.942310 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.942279 2554 fs.go:135] Filesystem UUIDs: map[2eabfd16-2bdb-4a5c-b147-5fbd68f0abf7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b76a55ba-cc4f-4ed1-8345-dad37664ac8b:/dev/nvme0n1p4] Jun 11 16:31:30.942420 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.942306 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:31:30.948561 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.948425 2554 manager.go:216] Machine: {Timestamp:2026-06-11 16:31:30.946033912 +0000 UTC m=+0.354335359 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120379 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2607bcc2d9dd6000e6f93ed98d281a SystemUUID:ec2607bc-c2d9-dd60-00e6-f93ed98d281a BootID:8afefd35-00d3-440e-a0f9-f3911757099c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:b9:91:d2:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:b9:91:d2:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:7f:52:8e:ff:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:31:30.948561 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.948546 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:31:30.948713 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.948639 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:31:30.953101 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.953068 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:31:30.953245 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.953106 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:31:30.953888 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.953878 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:31:30.953921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.953890 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:31:30.953921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.953898 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:31:30.954543 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.954530 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:31:30.954616 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.954600 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:31:30.955487 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.955475 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:31:30.958268 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958252 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:31:30.958597 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958585 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:31:30.958639 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958620 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:31:30.958639 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958631 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:31:30.958735 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958644 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:31:30.958735 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958654 2554 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:31:30.958735 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.958663 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:31:30.959177 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.959160 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:31:30.959258 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.959185 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:31:30.961514 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.961492 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:31:30.962812 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.962798 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:31:30.962868 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.962829 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:31:30.963781 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963770 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963786 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963792 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963797 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963806 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963812 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963820 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:31:30.963824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963825 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:31:30.963998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963833 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:31:30.963998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963839 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:31:30.963998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963847 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:31:30.963998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.963852 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:31:30.964714 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.964694 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:31:30.964714 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.964705 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:31:30.968578 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.968556 2554 server.go:1268] "Started kubelet" Jun 11 16:31:30.968676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.968614 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:31:30.968727 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.968636 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:31:30.968812 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.968736 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:31:30.973000 ip-10-0-129-45 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:31:30.973452 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.973414 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:31:30.973516 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.973473 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:31:30.973965 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.973691 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:31:30.974404 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.974372 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:31:30.974621 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.974600 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:31:30.978151 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.978130 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9q54v" Jun 11 16:31:30.978275 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.978264 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:31:30.980210 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.978717 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-45.ec2.internal.18b813dca2b4dd9b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-45.ec2.internal,UID:ip-10-0-129-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-45.ec2.internal,},FirstTimestamp:2026-06-11 16:31:30.968526235 +0000 UTC m=+0.376827736,LastTimestamp:2026-06-11 16:31:30.968526235 +0000 UTC m=+0.376827736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-45.ec2.internal,}" Jun 11 16:31:30.981141 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.981126 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:31:30.981228 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.981207 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:31:30.981519 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.981500 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:30.981882 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.981868 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:31:30.981986 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.981965 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:31:30.982051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.981989 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:31:30.982160 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.982147 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:31:30.982160 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.982158 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:31:30.982737 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.982719 2554 factory.go:55] Registering systemd factory Jun 11 16:31:30.982737 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.982739 2554 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:31:30.983088 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983075 2554 factory.go:153] Registering CRI-O factory Jun 11 16:31:30.983186 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983167 2554 factory.go:223] Registration of the crio container factory successfully Jun 11 16:31:30.983280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983227 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:31:30.983280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983252 2554 factory.go:103] Registering Raw factory Jun 11 16:31:30.983280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983267 2554 manager.go:1196] Started watching for new ooms in manager Jun 11 16:31:30.983660 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.983643 2554 manager.go:349] Starting recovery of all containers Jun 11 16:31:30.986913 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.986885 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9q54v" Jun 11 16:31:30.987791 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.987768 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 16:31:30.987911 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:30.987890 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 16:31:30.993997 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.993976 2554 manager.go:354] Recovery completed Jun 11 16:31:30.999773 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:30.999745 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.001724 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.001700 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.001848 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.001741 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.001848 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.001768 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.002365 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.002349 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:31:31.002365 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.002361 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.002472 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.002363 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:31:31.002472 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.002423 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:31:31.003120 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003100 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.003194 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003136 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.003194 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003149 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.003450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003437 2554 policy_none.go:49] "None policy: Start" Jun 11 16:31:31.003505 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003457 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:31:31.003505 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.003483 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:31:31.004021 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.003933 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-45.ec2.internal.18b813dca4af7051 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-45.ec2.internal,UID:ip-10-0-129-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-45.ec2.internal,},FirstTimestamp:2026-06-11 16:31:31.001725009 +0000 UTC m=+0.410026462,LastTimestamp:2026-06-11 16:31:31.001725009 +0000 UTC m=+0.410026462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-45.ec2.internal,}" Jun 11 16:31:31.004468 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.004456 2554 policy_none.go:47] "Start" Jun 11 16:31:31.043551 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.043530 2554 manager.go:337] "Starting Device Plugin manager" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.043577 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.043589 2554 server.go:87] "Starting device plugin registration server" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.044024 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.044034 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.044127 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.044220 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.044230 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.044890 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.044938 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.056235 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.057698 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.057735 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.057805 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:31:31.059389 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.057846 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:31:31.060132 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.059815 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:31.144914 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.144873 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.146041 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.146021 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.146139 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.146065 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.146139 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.146077 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.146139 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.146103 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.152272 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.152195 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.152272 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.152220 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-45.ec2.internal\": node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.158533 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.158511 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal"] Jun 11 16:31:31.158644 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.158571 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.159451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.159437 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.159504 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.159464 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.159504 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.159474 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.160668 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.160657 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.160817 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.160800 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.160877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.160839 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.161317 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161298 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.161317 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161312 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.161442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161324 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.161442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161334 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.161442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161338 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.161442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.161349 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.162591 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.162577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.162651 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.162601 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:31:31.163261 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.163247 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:31:31.163315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.163278 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:31:31.163315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.163292 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:31:31.167401 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.167379 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.183344 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.183312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.194654 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.194625 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-45.ec2.internal\" not found" node="ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.199172 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.199150 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-45.ec2.internal\" not found" node="ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.267895 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.267863 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.284258 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.284235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.284340 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.284281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.284340 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.284300 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d88b1683083ed0aa298625159bd387e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"5d88b1683083ed0aa298625159bd387e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.284407 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.284361 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.368445 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.368401 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.384742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.384719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.384830 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.384746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d88b1683083ed0aa298625159bd387e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"5d88b1683083ed0aa298625159bd387e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.384870 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.384832 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16fbaddd2046a27eaad5372ba5b363c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal\" (UID: \"16fbaddd2046a27eaad5372ba5b363c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.384906 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.384879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d88b1683083ed0aa298625159bd387e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-45.ec2.internal\" (UID: \"5d88b1683083ed0aa298625159bd387e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.469200 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.469167 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.498662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.498633 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.503627 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.503607 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:31.569290 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.569246 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.669820 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.669780 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.770491 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.770403 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.871106 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.871068 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.922609 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.922574 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:31:31.923132 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.922796 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:31:31.972066 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:31.972034 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:31.989969 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.989922 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:26:30 +0000 UTC" deadline="2028-01-14 06:35:51.792834193 +0000 UTC" Jun 11 16:31:31.989969 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:31.989963 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13958h4m19.80287442s" Jun 11 16:31:32.032335 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.032258 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:32.063903 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:32.063869 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d88b1683083ed0aa298625159bd387e.slice/crio-4cf6e2d03bbbed970691eea42371a59ea54a3774d2e921c051a5f6e8cb388c13 WatchSource:0}: Error finding container 4cf6e2d03bbbed970691eea42371a59ea54a3774d2e921c051a5f6e8cb388c13: Status 404 returned error can't find the container with id 4cf6e2d03bbbed970691eea42371a59ea54a3774d2e921c051a5f6e8cb388c13 Jun 11 16:31:32.064237 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:32.064221 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fbaddd2046a27eaad5372ba5b363c9.slice/crio-a742f8b824aacaae7e4e7658ddf70f2736a1e7740f88d1ce78b5413fed043742 WatchSource:0}: Error finding container a742f8b824aacaae7e4e7658ddf70f2736a1e7740f88d1ce78b5413fed043742: Status 404 returned error can't find the container with id a742f8b824aacaae7e4e7658ddf70f2736a1e7740f88d1ce78b5413fed043742 Jun 11 16:31:32.071442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.071417 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:31:32.073153 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:32.073132 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:32.173938 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:32.173896 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-45.ec2.internal\" not found" Jun 11 16:31:32.208397 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.208358 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:32.217982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.217962 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:32.281617 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.281592 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" Jun 11 16:31:32.294139 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.294066 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:31:32.295921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.295906 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" Jun 11 16:31:32.301827 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.301806 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:31:32.960655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.960469 2554 apiserver.go:52] "Watching apiserver" Jun 11 16:31:32.967556 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.966901 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:31:32.968123 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.968093 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-v7tgx","openshift-network-diagnostics/network-check-target-pgqxw","openshift-network-operator/iptables-alerter-ghvn2","openshift-ovn-kubernetes/ovnkube-node-bjkrd","kube-system/global-pull-secret-syncer-wpgch","kube-system/konnectivity-agent-szdvd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7","openshift-cluster-node-tuning-operator/tuned-6wrxh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal","openshift-multus/multus-additional-cni-plugins-l27kb","openshift-multus/multus-szh2w","openshift-multus/network-metrics-daemon-b9lpx","kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal","openshift-dns/node-resolver-5pvjp"] Jun 11 16:31:32.969538 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.969519 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.970898 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.970870 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.971920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.971830 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:32.971920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.971883 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:31:32.971920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.971909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vs5sz\"" Jun 11 16:31:32.972116 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.972015 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.972116 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.971834 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.973125 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.972974 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.973125 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973012 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:31:32.973125 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973084 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.973324 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973239 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:31:32.973742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973574 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sbvg5\"" Jun 11 16:31:32.973742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973680 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.973905 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.973905 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973881 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.973905 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973894 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:31:32.973905 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.973902 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xt8lr\"" Jun 11 16:31:32.974519 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.974504 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:32.974587 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:32.974572 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:32.974812 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.974799 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:31:32.974921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.974905 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5btl\"" Jun 11 16:31:32.975185 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975169 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:31:32.975313 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975266 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:31:32.975313 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.975446 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975357 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:31:32.975537 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975520 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.975852 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.975835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:32.977075 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.977058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:32.978369 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.978332 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:31:32.978453 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.978425 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:31:32.978513 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.978337 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bjzh7\"" Jun 11 16:31:32.978973 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.978954 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.979106 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.979087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kzc4c\"" Jun 11 16:31:32.979168 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.979145 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.979727 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.979708 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.981424 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.981377 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.981527 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.981511 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:31:32.981619 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.981602 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:32.981694 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:32.981672 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:32.982041 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.981973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zmr2m\"" Jun 11 16:31:32.982041 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.982025 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.983013 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.982995 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.984902 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.984882 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:31:32.985285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.985264 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b252c\"" Jun 11 16:31:32.985373 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.985299 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:32.985373 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.985336 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:31:32.986381 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.986362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:32.986461 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:32.986431 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:32.987097 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.987045 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:31:32.987184 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.987126 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:31:32.987413 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.987393 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:31:32.987599 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.987574 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dndnq\"" Jun 11 16:31:32.992728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-config\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.992728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-system-cni-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.992728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.992728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:32.993048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tq4q\" (UniqueName: \"kubernetes.io/projected/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-kube-api-access-5tq4q\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:32.993048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-sys\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.993048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.992900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-systemd-units\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993446 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-cnibin\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.993643 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4fb\" (UniqueName: \"kubernetes.io/projected/2159fcce-d5b2-454b-8ebb-993814b5a6be-kube-api-access-fs4fb\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:32.993643 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-system-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.993783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysconfig\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.993783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-kubelet\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993719 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-slash\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-script-lib\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993972 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-konnectivity-ca\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:32.993972 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-tmp-dir\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:32.993972 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993972 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993908 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-log-socket\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.993972 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993931 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-os-release\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.993999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ztkd\" (UniqueName: \"kubernetes.io/projected/229825ef-039d-4765-8000-eeadd6c87288-kube-api-access-9ztkd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994060 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-tmp\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-k8s-cni-cncf-io\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-kubelet\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-etc-kubernetes\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-systemd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-ovn\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-tuned\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-var-lib-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994300 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994332 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-socket-dir-parent\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-multus\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-multus-certs\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/229825ef-039d-4765-8000-eeadd6c87288-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-modprobe-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-systemd\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994542 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.994642 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2159fcce-d5b2-454b-8ebb-993814b5a6be-iptables-alerter-script\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-host\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-multus-daemon-config\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-dbus\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-etc-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-node-log\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-var-lib-kubelet\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.994999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-device-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-958z6\" (UniqueName: \"kubernetes.io/projected/e7e82533-72c4-4923-9125-d34fce9c0688-kube-api-access-958z6\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-kubelet-config\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-run\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-netd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-conf\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-conf-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.995362 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-agent-certs\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995300 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-cni-binary-copy\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-bin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-env-overrides\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/959b3101-c568-4375-b02f-2bcecc5f46bb-kube-api-access-4np4s\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bf94\" (UniqueName: \"kubernetes.io/projected/f67998c5-cd47-4003-a434-e923f9f419a2-kube-api-access-5bf94\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-os-release\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995501 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-netns\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-hosts-file\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-kubernetes\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-netns\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-bin\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-lib-modules\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.996213 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcsfv\" (UniqueName: \"kubernetes.io/projected/ce9354de-1822-47dc-b64e-cd1cb348b284-kube-api-access-qcsfv\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:32.997084 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-cnibin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.997084 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-hostroot\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:32.997084 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.995707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2159fcce-d5b2-454b-8ebb-993814b5a6be-host-slash\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:32.997917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:32.997899 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:31:33.007724 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.007219 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:31:33.019907 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.019856 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-spfcx" Jun 11 16:31:33.027462 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.027429 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-spfcx" Jun 11 16:31:33.062711 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.062617 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"16fbaddd2046a27eaad5372ba5b363c9","Type":"ContainerStarted","Data":"a742f8b824aacaae7e4e7658ddf70f2736a1e7740f88d1ce78b5413fed043742"} Jun 11 16:31:33.064104 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.064074 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" event={"ID":"5d88b1683083ed0aa298625159bd387e","Type":"ContainerStarted","Data":"4cf6e2d03bbbed970691eea42371a59ea54a3774d2e921c051a5f6e8cb388c13"} Jun 11 16:31:33.083465 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.083429 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:31:33.096687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-config\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.096687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-system-cni-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096734 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tq4q\" (UniqueName: \"kubernetes.io/projected/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-kube-api-access-5tq4q\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-sys\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-system-cni-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-sys-fs\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096856 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-sys\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.096902 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:33.096954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-systemd-units\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.096989 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:33.596953305 +0000 UTC m=+3.005254746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.096988 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-systemd-units\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-cnibin\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fb\" (UniqueName: \"kubernetes.io/projected/2159fcce-d5b2-454b-8ebb-993814b5a6be-kube-api-access-fs4fb\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-system-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysconfig\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097125 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-cnibin\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097128 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysconfig\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097239 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-system-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-kubelet\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-slash\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-script-lib\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-konnectivity-ca\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-tmp-dir\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097319 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-kubelet\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.097354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097352 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-slash\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097335 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-config\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-log-socket\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-os-release\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097602 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097651 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-log-socket\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ztkd\" (UniqueName: \"kubernetes.io/projected/229825ef-039d-4765-8000-eeadd6c87288-kube-api-access-9ztkd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-tmp\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-k8s-cni-cncf-io\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097725 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-tmp-dir\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-kubelet\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-os-release\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097801 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-ovnkube-script-lib\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-etc-kubernetes\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097854 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm9rr\" (UniqueName: \"kubernetes.io/projected/aa0e0d96-186a-4bc1-b124-25b2c313b738-kube-api-access-sm9rr\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097844 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-k8s-cni-cncf-io\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-konnectivity-ca\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-systemd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-kubelet\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-ovn\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097922 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-etc-kubernetes\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.097979 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098001 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-systemd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-tuned\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098018 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-run-ovn\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-var-lib-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-var-lib-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.098728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-socket-dir-parent\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-multus\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-multus-certs\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/229825ef-039d-4765-8000-eeadd6c87288-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-modprobe-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098192 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-socket-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098208 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-socket-dir-parent\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098210 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-multus\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098261 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-multus-certs\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-systemd\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098295 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098303 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-systemd\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2159fcce-d5b2-454b-8ebb-993814b5a6be-iptables-alerter-script\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098382 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-host\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.099548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098407 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-multus-daemon-config\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098454 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/959b3101-c568-4375-b02f-2bcecc5f46bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-dbus\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0e0d96-186a-4bc1-b124-25b2c313b738-host\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098503 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-registration-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098561 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-cni-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098920 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2159fcce-d5b2-454b-8ebb-993814b5a6be-iptables-alerter-script\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098920 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098980 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-dbus\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.098991 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-host\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-etc-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-node-log\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099042 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-etc-openvswitch\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-var-lib-kubelet\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.100311 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099105 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-modprobe-d\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099105 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-node-log\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-device-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-958z6\" (UniqueName: \"kubernetes.io/projected/e7e82533-72c4-4923-9125-d34fce9c0688-kube-api-access-958z6\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-var-lib-kubelet\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-kubelet-config\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099184 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-multus-daemon-config\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099217 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-device-dir\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-run\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-netd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-conf\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-conf-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099368 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-kubelet-config\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099372 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-agent-certs\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099520 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f67998c5-cd47-4003-a434-e923f9f419a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.101077 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099530 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099567 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-run\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-cni-binary-copy\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-bin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099642 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-sysctl-conf\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099678 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-env-overrides\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/959b3101-c568-4375-b02f-2bcecc5f46bb-kube-api-access-4np4s\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bf94\" (UniqueName: \"kubernetes.io/projected/f67998c5-cd47-4003-a434-e923f9f419a2-kube-api-access-5bf94\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099804 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-os-release\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-netns\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-hosts-file\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-kubernetes\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099904 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/959b3101-c568-4375-b02f-2bcecc5f46bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099905 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-netns\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099944 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-run-netns\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.101873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-bin\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-lib-modules\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.099982 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-bin\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcsfv\" (UniqueName: \"kubernetes.io/projected/ce9354de-1822-47dc-b64e-cd1cb348b284-kube-api-access-qcsfv\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100016 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/229825ef-039d-4765-8000-eeadd6c87288-host-cni-netd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-cnibin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100045 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7e82533-72c4-4923-9125-d34fce9c0688-cni-binary-copy\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100053 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-multus-conf-dir\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0e0d96-186a-4bc1-b124-25b2c313b738-serviceca\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100111 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-var-lib-cni-bin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100124 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-hosts-file\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100118 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-os-release\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100162 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-host-run-netns\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100211 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-kubernetes\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100291 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9354de-1822-47dc-b64e-cd1cb348b284-lib-modules\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100390 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/229825ef-039d-4765-8000-eeadd6c87288-env-overrides\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100456 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-hostroot\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-hostroot\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.102705 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100518 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7e82533-72c4-4923-9125-d34fce9c0688-cnibin\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.103559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2159fcce-d5b2-454b-8ebb-993814b5a6be-host-slash\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.103559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrkpw\" (UniqueName: \"kubernetes.io/projected/db264153-220b-4974-8ba7-ede0b19c142b-kube-api-access-hrkpw\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.103559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.100604 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2159fcce-d5b2-454b-8ebb-993814b5a6be-host-slash\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.103559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.103355 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-tmp\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.103559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.103410 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9354de-1822-47dc-b64e-cd1cb348b284-etc-tuned\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.104523 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.103799 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/229825ef-039d-4765-8000-eeadd6c87288-ovn-node-metrics-cert\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.105823 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.105459 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:33.105823 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.105488 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:33.105823 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.105502 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:33.105823 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.105573 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:33.605556803 +0000 UTC m=+3.013858254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:33.105823 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.105664 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1b42cd09-bc70-445a-8c4a-46b7e70b96ca-agent-certs\") pod \"konnectivity-agent-szdvd\" (UID: \"1b42cd09-bc70-445a-8c4a-46b7e70b96ca\") " pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:33.110603 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.110571 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcsfv\" (UniqueName: \"kubernetes.io/projected/ce9354de-1822-47dc-b64e-cd1cb348b284-kube-api-access-qcsfv\") pod \"tuned-6wrxh\" (UID: \"ce9354de-1822-47dc-b64e-cd1cb348b284\") " pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.112001 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.111951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tq4q\" (UniqueName: \"kubernetes.io/projected/a3dfa592-f76a-4e98-b3cc-88bbfe5a6581-kube-api-access-5tq4q\") pod \"node-resolver-5pvjp\" (UID: \"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581\") " pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.112001 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.111990 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ztkd\" (UniqueName: \"kubernetes.io/projected/229825ef-039d-4765-8000-eeadd6c87288-kube-api-access-9ztkd\") pod \"ovnkube-node-bjkrd\" (UID: \"229825ef-039d-4765-8000-eeadd6c87288\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.112186 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.111995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4fb\" (UniqueName: \"kubernetes.io/projected/2159fcce-d5b2-454b-8ebb-993814b5a6be-kube-api-access-fs4fb\") pod \"iptables-alerter-ghvn2\" (UID: \"2159fcce-d5b2-454b-8ebb-993814b5a6be\") " pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.112365 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.112347 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-958z6\" (UniqueName: \"kubernetes.io/projected/e7e82533-72c4-4923-9125-d34fce9c0688-kube-api-access-958z6\") pod \"multus-szh2w\" (UID: \"e7e82533-72c4-4923-9125-d34fce9c0688\") " pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.112909 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.112890 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bf94\" (UniqueName: \"kubernetes.io/projected/f67998c5-cd47-4003-a434-e923f9f419a2-kube-api-access-5bf94\") pod \"aws-ebs-csi-driver-node-w4tm7\" (UID: \"f67998c5-cd47-4003-a434-e923f9f419a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.113790 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.113748 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/959b3101-c568-4375-b02f-2bcecc5f46bb-kube-api-access-4np4s\") pod \"multus-additional-cni-plugins-l27kb\" (UID: \"959b3101-c568-4375-b02f-2bcecc5f46bb\") " pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.201562 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm9rr\" (UniqueName: \"kubernetes.io/projected/aa0e0d96-186a-4bc1-b124-25b2c313b738-kube-api-access-sm9rr\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.201562 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0e0d96-186a-4bc1-b124-25b2c313b738-host\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.201826 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0e0d96-186a-4bc1-b124-25b2c313b738-host\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.201826 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.201826 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0e0d96-186a-4bc1-b124-25b2c313b738-serviceca\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.201826 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.201746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrkpw\" (UniqueName: \"kubernetes.io/projected/db264153-220b-4974-8ba7-ede0b19c142b-kube-api-access-hrkpw\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.202029 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.201849 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:33.202029 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.201930 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:31:33.701912099 +0000 UTC m=+3.110213542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:33.202272 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.202247 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0e0d96-186a-4bc1-b124-25b2c313b738-serviceca\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.212592 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.212513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm9rr\" (UniqueName: \"kubernetes.io/projected/aa0e0d96-186a-4bc1-b124-25b2c313b738-kube-api-access-sm9rr\") pod \"node-ca-v7tgx\" (UID: \"aa0e0d96-186a-4bc1-b124-25b2c313b738\") " pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.212744 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.212627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrkpw\" (UniqueName: \"kubernetes.io/projected/db264153-220b-4974-8ba7-ede0b19c142b-kube-api-access-hrkpw\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.281501 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.281461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" Jun 11 16:31:33.292530 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.292497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szh2w" Jun 11 16:31:33.301342 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.301298 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghvn2" Jun 11 16:31:33.308286 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.308257 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:31:33.317148 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.317119 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:33.323914 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.323886 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pvjp" Jun 11 16:31:33.332229 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.332202 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" Jun 11 16:31:33.337877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.337830 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l27kb" Jun 11 16:31:33.344949 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.344923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7tgx" Jun 11 16:31:33.604720 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.604634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:33.604883 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.604799 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:33.604883 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.604857 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:34.604842226 +0000 UTC m=+4.013143665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:33.705920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.705886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:33.705920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:33.705924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:33.706170 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706062 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:33.706170 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706136 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:31:34.706115504 +0000 UTC m=+4.114416943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:33.706170 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706069 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:33.706170 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706172 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:33.706373 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706187 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:33.706373 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:33.706239 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:34.706227738 +0000 UTC m=+4.114529171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:34.030163 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.030113 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:26:33 +0000 UTC" deadline="2027-11-14 18:07:36.09295038 +0000 UTC" Jun 11 16:31:34.030163 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.030157 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12505h36m2.062798696s" Jun 11 16:31:34.058550 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.058514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:34.058777 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.058664 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:34.119263 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.119230 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229825ef_039d_4765_8000_eeadd6c87288.slice/crio-2b1eaa6f349765886c3c402b9965a2c9d16cb8c8f5668b840f32c8014d3ac3f1 WatchSource:0}: Error finding container 2b1eaa6f349765886c3c402b9965a2c9d16cb8c8f5668b840f32c8014d3ac3f1: Status 404 returned error can't find the container with id 2b1eaa6f349765886c3c402b9965a2c9d16cb8c8f5668b840f32c8014d3ac3f1 Jun 11 16:31:34.122227 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.122163 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e82533_72c4_4923_9125_d34fce9c0688.slice/crio-fe1b96e8d707e11c829bc5eb6b93e00b85feb0d98adcf186bcb7beb277c0be43 WatchSource:0}: Error finding container fe1b96e8d707e11c829bc5eb6b93e00b85feb0d98adcf186bcb7beb277c0be43: Status 404 returned error can't find the container with id fe1b96e8d707e11c829bc5eb6b93e00b85feb0d98adcf186bcb7beb277c0be43 Jun 11 16:31:34.126362 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.126329 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9354de_1822_47dc_b64e_cd1cb348b284.slice/crio-2030a59ccc7cef50005a04816389b7f3332aee45d18232dea5a0c8700636e3f0 WatchSource:0}: Error finding container 2030a59ccc7cef50005a04816389b7f3332aee45d18232dea5a0c8700636e3f0: Status 404 returned error can't find the container with id 2030a59ccc7cef50005a04816389b7f3332aee45d18232dea5a0c8700636e3f0 Jun 11 16:31:34.127437 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.127403 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dfa592_f76a_4e98_b3cc_88bbfe5a6581.slice/crio-cab913d53b36850fb901230be9c03f857b6af8903a3c90052d124369c70c9950 WatchSource:0}: Error finding container cab913d53b36850fb901230be9c03f857b6af8903a3c90052d124369c70c9950: Status 404 returned error can't find the container with id cab913d53b36850fb901230be9c03f857b6af8903a3c90052d124369c70c9950 Jun 11 16:31:34.128584 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.128382 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b42cd09_bc70_445a_8c4a_46b7e70b96ca.slice/crio-3d2b8ef89c46364fee500a1b2bdfd1284b632c47a5c96f6f6443ac2f6ded51a6 WatchSource:0}: Error finding container 3d2b8ef89c46364fee500a1b2bdfd1284b632c47a5c96f6f6443ac2f6ded51a6: Status 404 returned error can't find the container with id 3d2b8ef89c46364fee500a1b2bdfd1284b632c47a5c96f6f6443ac2f6ded51a6 Jun 11 16:31:34.131113 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.131086 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959b3101_c568_4375_b02f_2bcecc5f46bb.slice/crio-772dc99900b9ccbb9e11ab136c99ad96156f830e3a9230a03396f282872f0948 WatchSource:0}: Error finding container 772dc99900b9ccbb9e11ab136c99ad96156f830e3a9230a03396f282872f0948: Status 404 returned error can't find the container with id 772dc99900b9ccbb9e11ab136c99ad96156f830e3a9230a03396f282872f0948 Jun 11 16:31:34.132047 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.132026 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67998c5_cd47_4003_a434_e923f9f419a2.slice/crio-fd668762c357c70e7a7db5a728295d3fc535c6f6c46efcfa9f8611bec175f1eb WatchSource:0}: Error finding container fd668762c357c70e7a7db5a728295d3fc535c6f6c46efcfa9f8611bec175f1eb: Status 404 returned error can't find the container with id fd668762c357c70e7a7db5a728295d3fc535c6f6c46efcfa9f8611bec175f1eb Jun 11 16:31:34.133313 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.133086 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2159fcce_d5b2_454b_8ebb_993814b5a6be.slice/crio-ede57b80d7820ae0226e7821aea5ea3bdd28c46236bf394303f948415054252b WatchSource:0}: Error finding container ede57b80d7820ae0226e7821aea5ea3bdd28c46236bf394303f948415054252b: Status 404 returned error can't find the container with id ede57b80d7820ae0226e7821aea5ea3bdd28c46236bf394303f948415054252b Jun 11 16:31:34.138308 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:31:34.137602 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0e0d96_186a_4bc1_b124_25b2c313b738.slice/crio-0b336b513def1c6c2a625c309f37ac3637519511d026aee46c8cabc454c546f1 WatchSource:0}: Error finding container 0b336b513def1c6c2a625c309f37ac3637519511d026aee46c8cabc454c546f1: Status 404 returned error can't find the container with id 0b336b513def1c6c2a625c309f37ac3637519511d026aee46c8cabc454c546f1 Jun 11 16:31:34.612192 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.612096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:34.612371 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.612334 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:34.612432 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.612418 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:36.612396179 +0000 UTC m=+6.020697629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:34.713079 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.713040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:34.713284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:34.713095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:34.713348 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713313 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:34.713348 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713334 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:34.713348 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713349 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:34.713494 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:36.713390906 +0000 UTC m=+6.121692344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:34.713494 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713486 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:34.713606 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:34.713521 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:31:36.713508518 +0000 UTC m=+6.121809957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:35.031060 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.030960 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:26:33 +0000 UTC" deadline="2028-02-27 15:13:13.187481472 +0000 UTC" Jun 11 16:31:35.031060 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.031027 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15022h41m38.156458013s" Jun 11 16:31:35.059486 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.058902 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:35.059486 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:35.059058 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:35.059486 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.059120 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:35.059486 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:35.059253 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:35.093560 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.093516 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"2b1eaa6f349765886c3c402b9965a2c9d16cb8c8f5668b840f32c8014d3ac3f1"} Jun 11 16:31:35.096696 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.096461 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghvn2" event={"ID":"2159fcce-d5b2-454b-8ebb-993814b5a6be","Type":"ContainerStarted","Data":"ede57b80d7820ae0226e7821aea5ea3bdd28c46236bf394303f948415054252b"} Jun 11 16:31:35.107771 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.107713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerStarted","Data":"772dc99900b9ccbb9e11ab136c99ad96156f830e3a9230a03396f282872f0948"} Jun 11 16:31:35.116107 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.116064 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szdvd" event={"ID":"1b42cd09-bc70-445a-8c4a-46b7e70b96ca","Type":"ContainerStarted","Data":"3d2b8ef89c46364fee500a1b2bdfd1284b632c47a5c96f6f6443ac2f6ded51a6"} Jun 11 16:31:35.130172 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.130049 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pvjp" event={"ID":"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581","Type":"ContainerStarted","Data":"cab913d53b36850fb901230be9c03f857b6af8903a3c90052d124369c70c9950"} Jun 11 16:31:35.137082 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.134786 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" event={"ID":"ce9354de-1822-47dc-b64e-cd1cb348b284","Type":"ContainerStarted","Data":"2030a59ccc7cef50005a04816389b7f3332aee45d18232dea5a0c8700636e3f0"} Jun 11 16:31:35.138884 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.138846 2554 generic.go:356] "Generic (PLEG): container finished" podID="16fbaddd2046a27eaad5372ba5b363c9" containerID="c4be406247be6ce8ff64a946d53ee70ad52669656749e6d985cdbefb84f42723" exitCode=0 Jun 11 16:31:35.139052 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.138962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"16fbaddd2046a27eaad5372ba5b363c9","Type":"ContainerDied","Data":"c4be406247be6ce8ff64a946d53ee70ad52669656749e6d985cdbefb84f42723"} Jun 11 16:31:35.149724 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.147686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" event={"ID":"5d88b1683083ed0aa298625159bd387e","Type":"ContainerStarted","Data":"540e752a7104beba49f185ba778211ed8c8a737311fa8e30e03423f0ccdd075b"} Jun 11 16:31:35.164258 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.164192 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7tgx" event={"ID":"aa0e0d96-186a-4bc1-b124-25b2c313b738","Type":"ContainerStarted","Data":"0b336b513def1c6c2a625c309f37ac3637519511d026aee46c8cabc454c546f1"} Jun 11 16:31:35.182363 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.182265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" event={"ID":"f67998c5-cd47-4003-a434-e923f9f419a2","Type":"ContainerStarted","Data":"fd668762c357c70e7a7db5a728295d3fc535c6f6c46efcfa9f8611bec175f1eb"} Jun 11 16:31:35.191933 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:35.191813 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szh2w" event={"ID":"e7e82533-72c4-4923-9125-d34fce9c0688","Type":"ContainerStarted","Data":"fe1b96e8d707e11c829bc5eb6b93e00b85feb0d98adcf186bcb7beb277c0be43"} Jun 11 16:31:36.060422 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.058650 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:36.060422 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.058825 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:36.222253 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.222210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" event={"ID":"16fbaddd2046a27eaad5372ba5b363c9","Type":"ContainerStarted","Data":"85bd1877c6450862905497e94e9bff3fcd3d784d3dd5eb8ccf832c71432aca43"} Jun 11 16:31:36.238611 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.238543 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-45.ec2.internal" podStartSLOduration=4.23852187 podStartE2EDuration="4.23852187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:35.171538913 +0000 UTC m=+4.579840370" watchObservedRunningTime="2026-06-11 16:31:36.23852187 +0000 UTC m=+5.646823329" Jun 11 16:31:36.632064 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.632023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:36.632256 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.632234 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:36.632319 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.632296 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:40.632277632 +0000 UTC m=+10.040579081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:36.732836 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.732801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:36.733022 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:36.732850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:36.733085 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733046 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:36.733085 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733065 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:36.733085 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733079 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:36.733219 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733135 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:40.733116311 +0000 UTC m=+10.141417761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:36.733554 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733534 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:36.733661 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:36.733587 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:31:40.733572741 +0000 UTC m=+10.141874179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:37.059956 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:37.059875 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:37.060122 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:37.060014 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:37.060612 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:37.060466 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:37.060612 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:37.060569 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:38.058565 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:38.058048 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:38.058565 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:38.058191 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:39.058310 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:39.058273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:39.058854 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:39.058424 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:39.058854 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:39.058471 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:39.058854 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:39.058575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:40.058401 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:40.058364 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:40.058888 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.058507 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:40.661667 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:40.661625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:40.661875 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.661809 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:40.661931 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.661877 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:48.661861891 +0000 UTC m=+18.070163329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:40.762813 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:40.762766 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:40.762995 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:40.762821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:40.762995 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.762906 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:40.762995 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.762984 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:31:48.762962601 +0000 UTC m=+18.171264037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:40.762995 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.762984 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:40.763207 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.763006 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:40.763207 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.763019 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:40.763207 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:40.763068 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:31:48.76305314 +0000 UTC m=+18.171354588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:41.059112 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:41.059083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:41.059615 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:41.059195 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:41.059615 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:41.059244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:41.059615 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:41.059313 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:42.058767 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:42.058706 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:42.058964 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:42.058877 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:43.058971 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:43.058918 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:43.059434 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:43.059052 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:43.059434 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:43.058931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:43.059434 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:43.059144 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:44.058750 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.058656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:44.058918 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:44.058817 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:44.241147 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.241064 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" event={"ID":"ce9354de-1822-47dc-b64e-cd1cb348b284","Type":"ContainerStarted","Data":"f3b98ee005ce8b4dbb1b020a56874af810f38ed08646eda46454da9583dfe175"} Jun 11 16:31:44.248050 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.247570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7tgx" event={"ID":"aa0e0d96-186a-4bc1-b124-25b2c313b738","Type":"ContainerStarted","Data":"efd240d3335d7c5105171ec26e115a10c064cd40d23fd58f8e2fa6436fb85cff"} Jun 11 16:31:44.249457 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.249388 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" event={"ID":"f67998c5-cd47-4003-a434-e923f9f419a2","Type":"ContainerStarted","Data":"123df67729d017cb83e2327cffc4465996ae49a108d9f7b959340921239d2886"} Jun 11 16:31:44.251450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.251305 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="d27ca6a2f559719da8f4803eda04b27592c9c94f8af18883edea3d9c07c70faf" exitCode=0 Jun 11 16:31:44.251450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.251395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"d27ca6a2f559719da8f4803eda04b27592c9c94f8af18883edea3d9c07c70faf"} Jun 11 16:31:44.254658 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.254625 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szdvd" event={"ID":"1b42cd09-bc70-445a-8c4a-46b7e70b96ca","Type":"ContainerStarted","Data":"cc164172a1ec2bb8d33255f091feb64ea0b191318ec2e1ea663d64f6e45d2b70"} Jun 11 16:31:44.256261 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.256232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pvjp" event={"ID":"a3dfa592-f76a-4e98-b3cc-88bbfe5a6581","Type":"ContainerStarted","Data":"9c072346326a08abd2c0be4724b93e080e8585cb4029e8ecd75ac9d014061039"} Jun 11 16:31:44.261553 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.261505 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6wrxh" podStartSLOduration=3.7710834760000003 podStartE2EDuration="13.261488088s" totalImagesPullingTime="9.490404612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:44.261258732 +0000 UTC m=+13.669560189" watchObservedRunningTime="2026-06-11 16:31:44.261488088 +0000 UTC m=+13.669789543" Jun 11 16:31:44.261687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.261612 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-45.ec2.internal" podStartSLOduration=12.261606928 podStartE2EDuration="12.261606928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:36.238879272 +0000 UTC m=+5.647180728" watchObservedRunningTime="2026-06-11 16:31:44.261606928 +0000 UTC m=+13.669908383" Jun 11 16:31:44.279398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.279323 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-szdvd" podStartSLOduration=3.848839147 podStartE2EDuration="13.279309147s" totalImagesPullingTime="9.43047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:44.2787893 +0000 UTC m=+13.687090756" watchObservedRunningTime="2026-06-11 16:31:44.279309147 +0000 UTC m=+13.687610605" Jun 11 16:31:44.296095 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.296023 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5pvjp" podStartSLOduration=3.856811366 podStartE2EDuration="13.296002747s" totalImagesPullingTime="9.439191381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:44.295338587 +0000 UTC m=+13.703640044" watchObservedRunningTime="2026-06-11 16:31:44.296002747 +0000 UTC m=+13.704304202" Jun 11 16:31:44.328148 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.328022 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v7tgx" podStartSLOduration=3.866837635 podStartE2EDuration="13.328001234s" totalImagesPullingTime="9.461163599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:44.327973382 +0000 UTC m=+13.736274839" watchObservedRunningTime="2026-06-11 16:31:44.328001234 +0000 UTC m=+13.736302693" Jun 11 16:31:44.750428 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:44.750396 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:31:45.050648 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.050460 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:31:44.750422478Z","UUID":"82ee4d23-923b-48e9-a955-387bb9750dc1","Handler":null,"Name":"","Endpoint":""} Jun 11 16:31:45.052564 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.052536 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:31:45.052704 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.052586 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:31:45.058597 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.058560 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:45.058776 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:45.058697 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:45.060478 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.060450 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:45.060585 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:45.060565 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:45.260775 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.260663 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" event={"ID":"f67998c5-cd47-4003-a434-e923f9f419a2","Type":"ContainerStarted","Data":"cae1079a42b8eb4144f1bf998bacb79573f624aaa21be804c370dcb86daf0d78"} Jun 11 16:31:45.262523 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.262457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghvn2" event={"ID":"2159fcce-d5b2-454b-8ebb-993814b5a6be","Type":"ContainerStarted","Data":"0b7ce754cfbba898ca2d1bc3164678a9f401f799911f8a1879a7d9050e47fe56"} Jun 11 16:31:45.277237 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:45.277182 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ghvn2" podStartSLOduration=4.818912298 podStartE2EDuration="14.277163904s" totalImagesPullingTime="9.458251606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:45.277126528 +0000 UTC m=+14.685427986" watchObservedRunningTime="2026-06-11 16:31:45.277163904 +0000 UTC m=+14.685465360" Jun 11 16:31:46.058447 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:46.058403 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:46.058613 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:46.058526 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:46.267145 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:46.267104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" event={"ID":"f67998c5-cd47-4003-a434-e923f9f419a2","Type":"ContainerStarted","Data":"49337cd2f1469a5c5636cacf4cc8a6d2f093729479e97af00209b5251cb87292"} Jun 11 16:31:46.283819 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:46.283748 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4tm7" podStartSLOduration=4.284094907 podStartE2EDuration="15.283728451s" totalImagesPullingTime="10.999633544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:46.283439342 +0000 UTC m=+15.691740805" watchObservedRunningTime="2026-06-11 16:31:46.283728451 +0000 UTC m=+15.692029909" Jun 11 16:31:47.058345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:47.058310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:47.058345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:47.058324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:47.058567 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:47.058446 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:47.058567 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:47.058524 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:48.058662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:48.058626 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:48.059127 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.058783 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:48.725120 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:48.725066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:48.725340 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.725213 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:48.725340 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.725280 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:04.725260136 +0000 UTC m=+34.133561575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:31:48.826062 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:48.826010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:48.826062 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:48.826067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826172 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826185 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826201 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826213 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826245 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:32:04.826223232 +0000 UTC m=+34.234524683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:31:48.826312 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:48.826263 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:04.826254343 +0000 UTC m=+34.234555777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:31:49.058968 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.058887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:49.058968 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.058936 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:49.059451 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:49.059078 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:49.059451 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:49.059203 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:49.211814 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.211731 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:49.212651 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.212621 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:49.811132 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.811089 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:49.811979 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:49.811953 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-szdvd" Jun 11 16:31:50.058107 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:50.058069 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:50.058286 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:50.058216 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:51.059079 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:51.059031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:51.059650 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:51.059077 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:51.059650 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:51.059155 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:51.059650 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:51.059288 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:52.059021 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:52.058984 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:52.059205 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:52.059114 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:53.058034 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:53.057997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:53.058319 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:53.058008 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:53.058319 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:53.058150 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:53.058319 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:53.058215 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:54.058081 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:54.058039 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:54.058745 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:54.058173 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:55.058830 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:55.058791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:55.059301 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:55.058802 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:55.059301 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:55.058933 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:55.059301 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:55.059019 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:56.058285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:56.058248 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:56.058483 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:56.058381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:57.058866 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:57.058828 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:57.059221 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:57.058829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:57.059221 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:57.058964 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:57.059221 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:57.059036 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:58.058493 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.058303 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:31:58.058750 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:58.058562 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:31:58.294644 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.294607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szh2w" event={"ID":"e7e82533-72c4-4923-9125-d34fce9c0688","Type":"ContainerStarted","Data":"54c5141833c657754f46c086d29ce1e5d7d117f851cec80452204b547dc7abfa"} Jun 11 16:31:58.297858 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.297827 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"e426180c7dc5bfd162502d5feff4b30f8a125b7eb49c59ea5b526925c4b191d6"} Jun 11 16:31:58.298007 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.297897 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"fb2103a2fd5d66911a4c1fda1aa7ec6dd28a78c26566d401903619556dca2570"} Jun 11 16:31:58.298007 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.297969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"81b8a3df536e24d857cd9a943313026df0aebe8f729cfd03fbefa4d0a5e65ca8"} Jun 11 16:31:58.298144 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.298008 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"67c5bbfc6f8ec9eda0c65d8d65fe90dc0f344e3c719fea59548a6b9d821bcd5c"} Jun 11 16:31:58.298144 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.298045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"f334113cda38bf548502ec8edd58fe70a66b95842952513e5a2b315773a01636"} Jun 11 16:31:58.298144 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.298082 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"d7af53e1a9a0881ccf6948b6de22ca193987bf9d65f105db77843eafb936d142"} Jun 11 16:31:58.299678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.299653 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="840ce56a8e5cd09712f768004bdf83f96cc660707c36cc85d070a3b66366bd96" exitCode=0 Jun 11 16:31:58.299809 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.299704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"840ce56a8e5cd09712f768004bdf83f96cc660707c36cc85d070a3b66366bd96"} Jun 11 16:31:58.311254 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:58.311173 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-szh2w" podStartSLOduration=4.22153173 podStartE2EDuration="27.311160624s" totalImagesPullingTime="23.089628894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:31:58.310883778 +0000 UTC m=+27.719185234" watchObservedRunningTime="2026-06-11 16:31:58.311160624 +0000 UTC m=+27.719462080" Jun 11 16:31:59.058893 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:59.058716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:31:59.059025 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:59.058722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:31:59.059025 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:59.058992 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:31:59.059125 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:31:59.059102 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:31:59.304653 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:59.304563 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="fbab10eaa172c3003c4a7709e3e334a11dd22e41049991c5823eb2158615ea39" exitCode=0 Jun 11 16:31:59.304653 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:31:59.304642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"fbab10eaa172c3003c4a7709e3e334a11dd22e41049991c5823eb2158615ea39"} Jun 11 16:32:00.058323 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:00.058292 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:00.058515 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:00.058404 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:32:00.310568 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:00.310530 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"303d6e0b1ebf3697df21a868603396c3082351cbe027f2dada18c7ebf0150499"} Jun 11 16:32:00.312817 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:00.312788 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="56915e6e610fdc85a9415a71d5797d3d2c6a86a90ca3c4385367b7f77a86d7b9" exitCode=0 Jun 11 16:32:00.312946 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:00.312834 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"56915e6e610fdc85a9415a71d5797d3d2c6a86a90ca3c4385367b7f77a86d7b9"} Jun 11 16:32:01.059599 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:01.059557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:01.059820 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:01.059676 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:32:01.059820 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:01.059724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:01.059934 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:01.059835 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:32:02.058785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.058431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:02.058785 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:02.058562 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:32:02.323096 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.323056 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" event={"ID":"229825ef-039d-4765-8000-eeadd6c87288","Type":"ContainerStarted","Data":"ef2334a28ef2402e08cf961facb58c3bd49ede5a9ef94064c03da559ffd55a4d"} Jun 11 16:32:02.323450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.323416 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:02.323582 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.323503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:02.323582 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.323554 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:02.343263 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.343236 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:02.343424 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.343385 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:02.348051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:02.347998 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" podStartSLOduration=8.226069375 podStartE2EDuration="31.347977596s" totalImagesPullingTime="23.121908221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:02.347574222 +0000 UTC m=+31.755875703" watchObservedRunningTime="2026-06-11 16:32:02.347977596 +0000 UTC m=+31.756279054" Jun 11 16:32:03.058432 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:03.058166 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:03.058598 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:03.058214 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:03.058598 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:03.058536 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:32:03.058695 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:03.058674 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:32:04.020219 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.020180 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wpgch"] Jun 11 16:32:04.020683 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.020354 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:04.020683 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.020480 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:32:04.023939 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.023624 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgqxw"] Jun 11 16:32:04.023939 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.023750 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:04.023939 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.023887 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:32:04.024424 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.024396 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9lpx"] Jun 11 16:32:04.024549 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.024499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:04.024663 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.024637 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:32:04.740977 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.740950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:04.741092 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.741078 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:32:04.741141 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.741133 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret podName:fffd3769-a5fc-41b7-8c26-f9f7779ce4f7 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:36.741119597 +0000 UTC m=+66.149421031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret") pod "global-pull-secret-syncer-wpgch" (UID: "fffd3769-a5fc-41b7-8c26-f9f7779ce4f7") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:32:04.842315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.842271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:04.842315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:04.842318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842437 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842455 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842471 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842483 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fh2m2 for pod openshift-network-diagnostics/network-check-target-pgqxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842508 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:32:36.842491753 +0000 UTC m=+66.250793187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:32:04.842572 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:04.842529 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2 podName:acbe8a78-ec96-4a38-942d-6df71b68b2e9 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:36.842515359 +0000 UTC m=+66.250816807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh2m2" (UniqueName: "kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2") pod "network-check-target-pgqxw" (UID: "acbe8a78-ec96-4a38-942d-6df71b68b2e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:32:05.333920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:05.333890 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="aeb8926215d66ca9760f6c8233a217998f505e83289411f029af1bf2a418e681" exitCode=0 Jun 11 16:32:05.334327 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:05.333943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"aeb8926215d66ca9760f6c8233a217998f505e83289411f029af1bf2a418e681"} Jun 11 16:32:06.058589 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:06.058556 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:06.058589 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:06.058577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:06.058816 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:06.058572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:06.058816 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:06.058698 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:32:06.058816 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:06.058749 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:32:06.058816 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:06.058809 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:32:06.339695 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:06.339604 2554 generic.go:356] "Generic (PLEG): container finished" podID="959b3101-c568-4375-b02f-2bcecc5f46bb" containerID="fd0910a6d941ea93db000d52029882fc2d8f5fed1a898e3743f76a69e0fac9fa" exitCode=0 Jun 11 16:32:06.339695 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:06.339661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerDied","Data":"fd0910a6d941ea93db000d52029882fc2d8f5fed1a898e3743f76a69e0fac9fa"} Jun 11 16:32:07.345825 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:07.345620 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l27kb" event={"ID":"959b3101-c568-4375-b02f-2bcecc5f46bb","Type":"ContainerStarted","Data":"9974e3107a9e26d88835e772f8bec63b44e139a2a4a8a41aebd3535d3a0fb7ca"} Jun 11 16:32:07.367826 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:07.367771 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l27kb" podStartSLOduration=8.087875309 podStartE2EDuration="36.367740518s" totalImagesPullingTime="28.279865209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:07.36745898 +0000 UTC m=+36.775760436" watchObservedRunningTime="2026-06-11 16:32:07.367740518 +0000 UTC m=+36.776041974" Jun 11 16:32:08.058808 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:08.058746 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:08.058808 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:08.058796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:08.059067 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:08.058773 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:08.059067 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:08.058886 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpgch" podUID="fffd3769-a5fc-41b7-8c26-f9f7779ce4f7" Jun 11 16:32:08.059067 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:08.058957 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgqxw" podUID="acbe8a78-ec96-4a38-942d-6df71b68b2e9" Jun 11 16:32:08.059067 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:08.059034 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:32:09.884857 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.884785 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-45.ec2.internal" event="NodeReady" Jun 11 16:32:09.885197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.884916 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:32:09.934411 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.934369 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t2hfg"] Jun 11 16:32:09.952091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.952052 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bk7cp"] Jun 11 16:32:09.952244 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.952193 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:09.955295 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.955271 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:32:09.955595 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.955576 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:32:09.955646 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.955588 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hsnw5\"" Jun 11 16:32:09.971733 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.971691 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2hfg"] Jun 11 16:32:09.971733 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.971742 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bk7cp"] Jun 11 16:32:09.971948 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.971839 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:09.974109 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.974081 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6xqml\"" Jun 11 16:32:09.974252 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.974083 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:32:09.974252 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.974083 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:32:09.974408 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:09.974392 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:32:10.058873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.058842 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:10.058873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.058881 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:10.059229 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.058881 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:10.061876 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.061844 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:32:10.061876 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.061854 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4qlb\"" Jun 11 16:32:10.062093 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.061898 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:32:10.062093 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.061993 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:32:10.062239 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.062224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:32:10.062270 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.062251 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw82\"" Jun 11 16:32:10.076418 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3d6eae-7f64-4680-a3e4-0edb9288e396-config-volume\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.076547 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.076547 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n4r5\" (UniqueName: \"kubernetes.io/projected/622f8158-f72f-4790-9e60-d94cbfb703a7-kube-api-access-5n4r5\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.076547 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6eae-7f64-4680-a3e4-0edb9288e396-tmp-dir\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.076547 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ksqb\" (UniqueName: \"kubernetes.io/projected/bf3d6eae-7f64-4680-a3e4-0edb9288e396-kube-api-access-9ksqb\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.076547 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.076532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622f8158-f72f-4790-9e60-d94cbfb703a7-cert\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.177692 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3d6eae-7f64-4680-a3e4-0edb9288e396-config-volume\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.177692 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:10.177741 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n4r5\" (UniqueName: \"kubernetes.io/projected/622f8158-f72f-4790-9e60-d94cbfb703a7-kube-api-access-5n4r5\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:10.177828 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:10.677811539 +0000 UTC m=+40.086112973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6eae-7f64-4680-a3e4-0edb9288e396-tmp-dir\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ksqb\" (UniqueName: \"kubernetes.io/projected/bf3d6eae-7f64-4680-a3e4-0edb9288e396-kube-api-access-9ksqb\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.177964 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.177916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622f8158-f72f-4790-9e60-d94cbfb703a7-cert\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.178241 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.178228 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3d6eae-7f64-4680-a3e4-0edb9288e396-tmp-dir\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.178392 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.178370 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf3d6eae-7f64-4680-a3e4-0edb9288e396-config-volume\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.182562 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.182521 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622f8158-f72f-4790-9e60-d94cbfb703a7-cert\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.186445 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.186394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ksqb\" (UniqueName: \"kubernetes.io/projected/bf3d6eae-7f64-4680-a3e4-0edb9288e396-kube-api-access-9ksqb\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.186724 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.186705 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n4r5\" (UniqueName: \"kubernetes.io/projected/622f8158-f72f-4790-9e60-d94cbfb703a7-kube-api-access-5n4r5\") pod \"ingress-canary-bk7cp\" (UID: \"622f8158-f72f-4790-9e60-d94cbfb703a7\") " pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.281399 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.281358 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bk7cp" Jun 11 16:32:10.463336 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.463307 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bk7cp"] Jun 11 16:32:10.467884 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:32:10.467846 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622f8158_f72f_4790_9e60_d94cbfb703a7.slice/crio-1a69a864a223a0583ef2abce312cafa84d8739f82eb5c22921f88418e7ad5c1f WatchSource:0}: Error finding container 1a69a864a223a0583ef2abce312cafa84d8739f82eb5c22921f88418e7ad5c1f: Status 404 returned error can't find the container with id 1a69a864a223a0583ef2abce312cafa84d8739f82eb5c22921f88418e7ad5c1f Jun 11 16:32:10.680499 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:10.680455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:10.680666 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:10.680624 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:10.680706 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:10.680691 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:11.680675287 +0000 UTC m=+41.088976721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:11.357563 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:11.357321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bk7cp" event={"ID":"622f8158-f72f-4790-9e60-d94cbfb703a7","Type":"ContainerStarted","Data":"1a69a864a223a0583ef2abce312cafa84d8739f82eb5c22921f88418e7ad5c1f"} Jun 11 16:32:11.686948 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:11.686916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:11.687112 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:11.687076 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:11.687157 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:11.687146 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:13.687129471 +0000 UTC m=+43.095430906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:12.361511 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:12.361477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bk7cp" event={"ID":"622f8158-f72f-4790-9e60-d94cbfb703a7","Type":"ContainerStarted","Data":"2202641e9c1dfe267ae0c10c8d6e24be424e9ff500762210a41d4ab079d9f6dc"} Jun 11 16:32:12.376393 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:12.376338 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bk7cp" podStartSLOduration=1.676706347 podStartE2EDuration="3.376318661s" totalImagesPullingTime="1.699612314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:12.375963045 +0000 UTC m=+41.784264523" watchObservedRunningTime="2026-06-11 16:32:12.376318661 +0000 UTC m=+41.784620120" Jun 11 16:32:13.703209 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:13.703163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:13.703591 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:13.703319 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:13.703591 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:13.703393 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:17.703379605 +0000 UTC m=+47.111681039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:17.732016 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:17.731972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:17.732485 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:17.732130 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:17.732485 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:17.732199 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:25.732184771 +0000 UTC m=+55.140486205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:25.786459 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:25.786386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:25.786997 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:25.786574 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:25.786997 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:25.786659 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:32:41.786636319 +0000 UTC m=+71.194937759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:34.344277 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:34.344241 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjkrd" Jun 11 16:32:36.765081 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.765033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:36.767615 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.767592 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:32:36.778805 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.778745 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fffd3769-a5fc-41b7-8c26-f9f7779ce4f7-original-pull-secret\") pod \"global-pull-secret-syncer-wpgch\" (UID: \"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7\") " pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:36.865609 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.865572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:32:36.865790 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.865619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:36.867840 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.867821 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:32:36.867933 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.867831 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:32:36.876495 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:36.876464 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:32:36.876584 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:36.876570 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:33:40.876550063 +0000 UTC m=+130.284851496 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : secret "metrics-daemon-secret" not found Jun 11 16:32:36.878102 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.878079 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:32:36.889177 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:36.889147 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh2m2\" (UniqueName: \"kubernetes.io/projected/acbe8a78-ec96-4a38-942d-6df71b68b2e9-kube-api-access-fh2m2\") pod \"network-check-target-pgqxw\" (UID: \"acbe8a78-ec96-4a38-942d-6df71b68b2e9\") " pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:37.068538 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.068453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpgch" Jun 11 16:32:37.081929 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.081894 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw82\"" Jun 11 16:32:37.090714 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.090684 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:37.268813 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.268779 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wpgch"] Jun 11 16:32:37.271796 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:32:37.271768 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffd3769_a5fc_41b7_8c26_f9f7779ce4f7.slice/crio-0f17d13896355f2d8c1275e05780b5da96d7da34e5121a808023f570b80b8ca1 WatchSource:0}: Error finding container 0f17d13896355f2d8c1275e05780b5da96d7da34e5121a808023f570b80b8ca1: Status 404 returned error can't find the container with id 0f17d13896355f2d8c1275e05780b5da96d7da34e5121a808023f570b80b8ca1 Jun 11 16:32:37.284834 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.284803 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgqxw"] Jun 11 16:32:37.287932 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:32:37.287888 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbe8a78_ec96_4a38_942d_6df71b68b2e9.slice/crio-fe6a43f8be8584e95cedf1ab72cf4355d1c3fadd69a8110727559e496879185c WatchSource:0}: Error finding container fe6a43f8be8584e95cedf1ab72cf4355d1c3fadd69a8110727559e496879185c: Status 404 returned error can't find the container with id fe6a43f8be8584e95cedf1ab72cf4355d1c3fadd69a8110727559e496879185c Jun 11 16:32:37.421693 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.421597 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wpgch" event={"ID":"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7","Type":"ContainerStarted","Data":"0f17d13896355f2d8c1275e05780b5da96d7da34e5121a808023f570b80b8ca1"} Jun 11 16:32:37.422712 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:37.422688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgqxw" event={"ID":"acbe8a78-ec96-4a38-942d-6df71b68b2e9","Type":"ContainerStarted","Data":"fe6a43f8be8584e95cedf1ab72cf4355d1c3fadd69a8110727559e496879185c"} Jun 11 16:32:41.803315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:41.803262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:32:41.803847 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:41.803414 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:32:41.803847 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:32:41.803480 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:33:13.803465405 +0000 UTC m=+103.211766840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:32:42.438950 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:42.438909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wpgch" event={"ID":"fffd3769-a5fc-41b7-8c26-f9f7779ce4f7","Type":"ContainerStarted","Data":"a5e1ffe7a4f4a31da2f3fe94eeea2f9e92911c8e20c6ff6cdce183f878ef0457"} Jun 11 16:32:42.440501 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:42.440457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgqxw" event={"ID":"acbe8a78-ec96-4a38-942d-6df71b68b2e9","Type":"ContainerStarted","Data":"094bec30c7920e7ade5a277dee88db34ac9568e41bc50af60933b531155a7e61"} Jun 11 16:32:42.440628 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:42.440602 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:32:42.454722 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:42.454652 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wpgch" podStartSLOduration=67.130558242 podStartE2EDuration="1m11.454626584s" totalImagesPullingTime="4.324068342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:42.454329056 +0000 UTC m=+71.862630512" watchObservedRunningTime="2026-06-11 16:32:42.454626584 +0000 UTC m=+71.862928040" Jun 11 16:32:42.469315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:32:42.469236 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pgqxw" podStartSLOduration=67.166001543 podStartE2EDuration="1m11.469220214s" totalImagesPullingTime="4.303218671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:32:42.468678579 +0000 UTC m=+71.876980036" watchObservedRunningTime="2026-06-11 16:32:42.469220214 +0000 UTC m=+71.877521647" Jun 11 16:33:13.445075 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:33:13.444963 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pgqxw" Jun 11 16:33:13.818838 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:33:13.818718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:33:13.819009 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:33:13.818878 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:33:13.819009 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:33:13.818953 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:17.818935547 +0000 UTC m=+167.227236981 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:33:40.907210 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:33:40.907154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:33:40.907681 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:33:40.907313 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:33:40.907681 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:33:40.907389 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs podName:db264153-220b-4974-8ba7-ede0b19c142b nodeName:}" failed. No retries permitted until 2026-06-11 16:35:42.907372175 +0000 UTC m=+252.315673614 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs") pod "network-metrics-daemon-b9lpx" (UID: "db264153-220b-4974-8ba7-ede0b19c142b") : secret "metrics-daemon-secret" not found Jun 11 16:34:12.961695 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:12.961575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t2hfg" podUID="bf3d6eae-7f64-4680-a3e4-0edb9288e396" Jun 11 16:34:13.074283 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:13.074240 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b9lpx" podUID="db264153-220b-4974-8ba7-ede0b19c142b" Jun 11 16:34:13.658144 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:13.658114 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:34:17.857721 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:17.857675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:34:17.858259 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:17.857891 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:34:17.858259 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:17.857997 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls podName:bf3d6eae-7f64-4680-a3e4-0edb9288e396 nodeName:}" failed. No retries permitted until 2026-06-11 16:36:19.857976125 +0000 UTC m=+289.266277559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls") pod "dns-default-t2hfg" (UID: "bf3d6eae-7f64-4680-a3e4-0edb9288e396") : secret "dns-default-metrics-tls" not found Jun 11 16:34:24.058441 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:24.058398 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:34:26.233345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.233312 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p"] Jun 11 16:34:26.235017 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.234988 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.237136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.237096 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cfm6b\"" Jun 11 16:34:26.237136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.237096 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.237973 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.237876 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 16:34:26.237973 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.237914 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.239234 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.239215 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2"] Jun 11 16:34:26.240870 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.240852 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:34:26.241004 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.240980 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" Jun 11 16:34:26.242941 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.242866 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76d659c6c5-z4kfv"] Jun 11 16:34:26.245250 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.245159 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.247417 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.247395 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.247629 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.247409 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.247713 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.247462 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-72v8l\"" Jun 11 16:34:26.248821 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.248801 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb"] Jun 11 16:34:26.248968 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.248909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.250263 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.250243 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p"] Jun 11 16:34:26.250367 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.250321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.253566 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.253547 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 16:34:26.253696 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.253569 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.253696 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.253649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:34:26.254622 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.254600 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.254783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.254627 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 16:34:26.254850 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.254660 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 16:34:26.254850 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.254667 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:34:26.255125 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255111 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vcr7m\"" Jun 11 16:34:26.255379 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255365 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 16:34:26.255451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255383 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 16:34:26.255451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255396 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:34:26.255531 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255452 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.255568 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255538 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.255932 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.255917 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5r2pf\"" Jun 11 16:34:26.256463 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.256445 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dp79p\"" Jun 11 16:34:26.256564 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.256461 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 16:34:26.259941 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.259919 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2"] Jun 11 16:34:26.260805 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.260784 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb"] Jun 11 16:34:26.262164 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.262143 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:34:26.263127 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.263107 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:34:26.266620 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.266593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76d659c6c5-z4kfv"] Jun 11 16:34:26.314933 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.314900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skk6q\" (UniqueName: \"kubernetes.io/projected/f172027f-6aff-4a90-80e3-2eff8409323e-kube-api-access-skk6q\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.315155 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.315072 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.317103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.317077 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g"] Jun 11 16:34:26.318906 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.318887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" Jun 11 16:34:26.320902 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.320885 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2mjkv\"" Jun 11 16:34:26.323031 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.323012 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h"] Jun 11 16:34:26.324878 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.324853 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc"] Jun 11 16:34:26.324975 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.324961 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.326657 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.326639 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-nmcw8"] Jun 11 16:34:26.326783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.326768 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.328508 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.328221 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 16:34:26.328508 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.328323 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.330718 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.330469 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x75pq\"" Jun 11 16:34:26.330860 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.330843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 16:34:26.331398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331081 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.331398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.331398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331139 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-m4gl2\"" Jun 11 16:34:26.331398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331310 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 16:34:26.331668 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331436 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 16:34:26.331668 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.331545 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.334590 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.334332 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g"] Jun 11 16:34:26.334590 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.334475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.337934 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.337912 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h"] Jun 11 16:34:26.339397 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.339381 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:34:26.340913 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.340895 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 16:34:26.341579 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.341559 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:34:26.342292 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.342275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 16:34:26.344492 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.344475 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rrtqf\"" Jun 11 16:34:26.347450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.347426 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nmcw8"] Jun 11 16:34:26.348432 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.348383 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc"] Jun 11 16:34:26.353455 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.353432 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 16:34:26.415670 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415634 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36bcc398-6201-4b82-9b2d-e3ed531ae435-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.415875 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6e73724-2e08-42ac-bb82-4349e290c13d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.415875 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-default-certificate\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.415875 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e745c249-c378-4460-bd47-b9ded6bc0431-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.415875 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-service-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt5cq\" (UniqueName: \"kubernetes.io/projected/1e543698-f475-4694-93c7-2b9227698c9e-kube-api-access-jt5cq\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567v4\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.415999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64sp7\" (UniqueName: \"kubernetes.io/projected/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-kube-api-access-64sp7\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416035 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-stats-auth\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.416091 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e745c249-c378-4460-bd47-b9ded6bc0431-config\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.416284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416108 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smcf6\" (UniqueName: \"kubernetes.io/projected/e6e73724-2e08-42ac-bb82-4349e290c13d-kube-api-access-smcf6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.416284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skk6q\" (UniqueName: \"kubernetes.io/projected/f172027f-6aff-4a90-80e3-2eff8409323e-kube-api-access-skk6q\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.416284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416247 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416273 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416350 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.416485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e73724-2e08-42ac-bb82-4349e290c13d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.416485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-trusted-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.416485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqhw\" (UniqueName: \"kubernetes.io/projected/36bcc398-6201-4b82-9b2d-e3ed531ae435-kube-api-access-wnqhw\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqmbh\" (UniqueName: \"kubernetes.io/projected/14321013-b1a1-428a-8719-2ad1531cb5b9-kube-api-access-fqmbh\") pod \"volume-data-source-validator-78dd696465-jwkj2\" (UID: \"14321013-b1a1-428a-8719-2ad1531cb5b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-snapshots\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416677 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.416729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-tmp\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416770 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416810 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjspt\" (UniqueName: \"kubernetes.io/projected/586e57c4-81a5-4423-b6e6-97fa656836a7-kube-api-access-cjspt\") pod \"network-check-source-dbd9cf844-nms9g\" (UID: \"586e57c4-81a5-4423-b6e6-97fa656836a7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t69n8\" (UniqueName: \"kubernetes.io/projected/e745c249-c378-4460-bd47-b9ded6bc0431-kube-api-access-t69n8\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.416862 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.416930 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls podName:f172027f-6aff-4a90-80e3-2eff8409323e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:26.916910735 +0000 UTC m=+176.325212169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-t798p" (UID: "f172027f-6aff-4a90-80e3-2eff8409323e") : secret "samples-operator-tls" not found Jun 11 16:34:26.417050 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.416865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-serving-cert\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.427519 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.427488 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skk6q\" (UniqueName: \"kubernetes.io/projected/f172027f-6aff-4a90-80e3-2eff8409323e-kube-api-access-skk6q\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.518285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.518285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.518285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e73724-2e08-42ac-bb82-4349e290c13d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.518285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-trusted-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.518285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqhw\" (UniqueName: \"kubernetes.io/projected/36bcc398-6201-4b82-9b2d-e3ed531ae435-kube-api-access-wnqhw\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqmbh\" (UniqueName: \"kubernetes.io/projected/14321013-b1a1-428a-8719-2ad1531cb5b9-kube-api-access-fqmbh\") pod \"volume-data-source-validator-78dd696465-jwkj2\" (UID: \"14321013-b1a1-428a-8719-2ad1531cb5b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.518409 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-snapshots\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.518502 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.018480433 +0000 UTC m=+176.426781887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-tmp\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.518655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjspt\" (UniqueName: \"kubernetes.io/projected/586e57c4-81a5-4423-b6e6-97fa656836a7-kube-api-access-cjspt\") pod \"network-check-source-dbd9cf844-nms9g\" (UID: \"586e57c4-81a5-4423-b6e6-97fa656836a7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t69n8\" (UniqueName: \"kubernetes.io/projected/e745c249-c378-4460-bd47-b9ded6bc0431-kube-api-access-t69n8\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-serving-cert\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36bcc398-6201-4b82-9b2d-e3ed531ae435-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6e73724-2e08-42ac-bb82-4349e290c13d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-default-certificate\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e745c249-c378-4460-bd47-b9ded6bc0431-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-service-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt5cq\" (UniqueName: \"kubernetes.io/projected/1e543698-f475-4694-93c7-2b9227698c9e-kube-api-access-jt5cq\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-567v4\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.518990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64sp7\" (UniqueName: \"kubernetes.io/projected/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-kube-api-access-64sp7\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-stats-auth\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e745c249-c378-4460-bd47-b9ded6bc0431-config\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.519170 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519077 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcf6\" (UniqueName: \"kubernetes.io/projected/e6e73724-2e08-42ac-bb82-4349e290c13d-kube-api-access-smcf6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519157 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-snapshots\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519174 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519271 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-trusted-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519615 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36bcc398-6201-4b82-9b2d-e3ed531ae435-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.519891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.519832 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e745c249-c378-4460-bd47-b9ded6bc0431-config\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.520433 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.520407 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-tmp\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.520811 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.520781 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.520917 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.520897 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:34:26.520917 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.520912 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c968ff66-qtjbf: secret "image-registry-tls" not found Jun 11 16:34:26.521035 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.520962 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls podName:38ef944c-51aa-497d-859c-4d1b4348256f nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.020945728 +0000 UTC m=+176.429247162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls") pod "image-registry-75c968ff66-qtjbf" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f") : secret "image-registry-tls" not found Jun 11 16:34:26.521472 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.521448 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6e73724-2e08-42ac-bb82-4349e290c13d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.521594 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.521467 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-service-ca-bundle\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.521689 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.521523 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6e73724-2e08-42ac-bb82-4349e290c13d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.521792 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.521613 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.521894 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.518412 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:34:26.522002 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.521676 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.522115 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.521721 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.021702181 +0000 UTC m=+176.430003615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:26.522251 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.522123 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.022104754 +0000 UTC m=+176.430406196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : secret "router-metrics-certs-default" not found Jun 11 16:34:26.522251 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.522212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.522488 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.522462 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-serving-cert\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.522599 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.522583 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-stats-auth\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.522824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.522805 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-default-certificate\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.523523 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.523504 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e745c249-c378-4460-bd47-b9ded6bc0431-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.526901 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.526860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqhw\" (UniqueName: \"kubernetes.io/projected/36bcc398-6201-4b82-9b2d-e3ed531ae435-kube-api-access-wnqhw\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:26.527005 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.526898 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqmbh\" (UniqueName: \"kubernetes.io/projected/14321013-b1a1-428a-8719-2ad1531cb5b9-kube-api-access-fqmbh\") pod \"volume-data-source-validator-78dd696465-jwkj2\" (UID: \"14321013-b1a1-428a-8719-2ad1531cb5b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" Jun 11 16:34:26.527343 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.527299 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-567v4\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.527633 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.527614 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:26.528119 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.528096 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t69n8\" (UniqueName: \"kubernetes.io/projected/e745c249-c378-4460-bd47-b9ded6bc0431-kube-api-access-t69n8\") pod \"service-ca-operator-6bc5ff68f5-v6z2h\" (UID: \"e745c249-c378-4460-bd47-b9ded6bc0431\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.528296 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.528277 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64sp7\" (UniqueName: \"kubernetes.io/projected/7b6038a9-88ef-415d-9d3d-7eb20113f3ba-kube-api-access-64sp7\") pod \"insights-operator-896549976-nmcw8\" (UID: \"7b6038a9-88ef-415d-9d3d-7eb20113f3ba\") " pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.528459 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.528441 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjspt\" (UniqueName: \"kubernetes.io/projected/586e57c4-81a5-4423-b6e6-97fa656836a7-kube-api-access-cjspt\") pod \"network-check-source-dbd9cf844-nms9g\" (UID: \"586e57c4-81a5-4423-b6e6-97fa656836a7\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" Jun 11 16:34:26.529529 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.529513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smcf6\" (UniqueName: \"kubernetes.io/projected/e6e73724-2e08-42ac-bb82-4349e290c13d-kube-api-access-smcf6\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mqzhc\" (UID: \"e6e73724-2e08-42ac-bb82-4349e290c13d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.532893 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.532870 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt5cq\" (UniqueName: \"kubernetes.io/projected/1e543698-f475-4694-93c7-2b9227698c9e-kube-api-access-jt5cq\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:26.556576 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.556524 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" Jun 11 16:34:26.629645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.629609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" Jun 11 16:34:26.639217 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.639182 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" Jun 11 16:34:26.646137 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.646073 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" Jun 11 16:34:26.653328 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.653208 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nmcw8" Jun 11 16:34:26.690646 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.690593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2"] Jun 11 16:34:26.787917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.787881 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g"] Jun 11 16:34:26.791418 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:26.791385 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586e57c4_81a5_4423_b6e6_97fa656836a7.slice/crio-72d18ae7c703aca72ca43d9fb54f6dfae503405159294db229faf0b485b07ebc WatchSource:0}: Error finding container 72d18ae7c703aca72ca43d9fb54f6dfae503405159294db229faf0b485b07ebc: Status 404 returned error can't find the container with id 72d18ae7c703aca72ca43d9fb54f6dfae503405159294db229faf0b485b07ebc Jun 11 16:34:26.806386 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.806350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h"] Jun 11 16:34:26.810622 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:26.810601 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode745c249_c378_4460_bd47_b9ded6bc0431.slice/crio-ba4dfb1c14625df8fca481e519601d8fc713e922627ae47c33a1749c66f317c8 WatchSource:0}: Error finding container ba4dfb1c14625df8fca481e519601d8fc713e922627ae47c33a1749c66f317c8: Status 404 returned error can't find the container with id ba4dfb1c14625df8fca481e519601d8fc713e922627ae47c33a1749c66f317c8 Jun 11 16:34:26.921821 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:26.921784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:26.922013 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.921947 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:34:26.922058 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:26.922020 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls podName:f172027f-6aff-4a90-80e3-2eff8409323e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:27.922003388 +0000 UTC m=+177.330304828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-t798p" (UID: "f172027f-6aff-4a90-80e3-2eff8409323e") : secret "samples-operator-tls" not found Jun 11 16:34:27.023285 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.023207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:27.023424 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.023283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:27.023424 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.023318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:27.023424 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023358 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:34:27.023424 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023383 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c968ff66-qtjbf: secret "image-registry-tls" not found Jun 11 16:34:27.023424 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023402 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.023365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023445 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls podName:38ef944c-51aa-497d-859c-4d1b4348256f nodeName:}" failed. No retries permitted until 2026-06-11 16:34:28.023425636 +0000 UTC m=+177.431727095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls") pod "image-registry-75c968ff66-qtjbf" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f") : secret "image-registry-tls" not found Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023462 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:28.02345421 +0000 UTC m=+177.431755648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023496 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:28.023471528 +0000 UTC m=+177.431772970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023509 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:34:27.023648 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.023570 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:28.02355482 +0000 UTC m=+177.431856254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : secret "router-metrics-certs-default" not found Jun 11 16:34:27.036118 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.036090 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc"] Jun 11 16:34:27.043315 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.042695 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nmcw8"] Jun 11 16:34:27.044148 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:27.044122 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6038a9_88ef_415d_9d3d_7eb20113f3ba.slice/crio-f285606fc92c7a66869061f6b253bb50e87f7351d8d17dc0fc8718064f72e345 WatchSource:0}: Error finding container f285606fc92c7a66869061f6b253bb50e87f7351d8d17dc0fc8718064f72e345: Status 404 returned error can't find the container with id f285606fc92c7a66869061f6b253bb50e87f7351d8d17dc0fc8718064f72e345 Jun 11 16:34:27.697873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.697282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" event={"ID":"586e57c4-81a5-4423-b6e6-97fa656836a7","Type":"ContainerStarted","Data":"320a742f4dbd43b679b0a2aaecd61320f45ed78cafdc1d37735639805c83d377"} Jun 11 16:34:27.697873 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.697349 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" event={"ID":"586e57c4-81a5-4423-b6e6-97fa656836a7","Type":"ContainerStarted","Data":"72d18ae7c703aca72ca43d9fb54f6dfae503405159294db229faf0b485b07ebc"} Jun 11 16:34:27.700267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.700176 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" event={"ID":"14321013-b1a1-428a-8719-2ad1531cb5b9","Type":"ContainerStarted","Data":"4a562afdfd68789251839f0678c539cfeaa2c55919df8af611447c8d875dbd50"} Jun 11 16:34:27.700267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.700231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" event={"ID":"14321013-b1a1-428a-8719-2ad1531cb5b9","Type":"ContainerStarted","Data":"dd9b65e53fb607ed1ae5d298c6b13538324dca0464cfff846ec4cde09c107731"} Jun 11 16:34:27.702150 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.702080 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nmcw8" event={"ID":"7b6038a9-88ef-415d-9d3d-7eb20113f3ba","Type":"ContainerStarted","Data":"f285606fc92c7a66869061f6b253bb50e87f7351d8d17dc0fc8718064f72e345"} Jun 11 16:34:27.703993 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.703964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" event={"ID":"e6e73724-2e08-42ac-bb82-4349e290c13d","Type":"ContainerStarted","Data":"c97f1a5efa8ebc531b2fa66aa2b94cfa4e61bfb1a224f49c2af80758d6c9a716"} Jun 11 16:34:27.705624 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.705579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" event={"ID":"e745c249-c378-4460-bd47-b9ded6bc0431","Type":"ContainerStarted","Data":"ba4dfb1c14625df8fca481e519601d8fc713e922627ae47c33a1749c66f317c8"} Jun 11 16:34:27.712207 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.712029 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-nms9g" podStartSLOduration=1.7120042629999999 podStartE2EDuration="1.712004263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:27.710341567 +0000 UTC m=+177.118643024" watchObservedRunningTime="2026-06-11 16:34:27.712004263 +0000 UTC m=+177.120305721" Jun 11 16:34:27.724828 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.724733 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jwkj2" podStartSLOduration=0.814978232 podStartE2EDuration="1.724711645s" totalImagesPullingTime="909.733413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:27.723897803 +0000 UTC m=+177.132199297" watchObservedRunningTime="2026-06-11 16:34:27.724711645 +0000 UTC m=+177.133013102" Jun 11 16:34:27.935101 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:27.935061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:27.935346 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.935328 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:34:27.935465 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:27.935444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls podName:f172027f-6aff-4a90-80e3-2eff8409323e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:29.935386292 +0000 UTC m=+179.343687748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-t798p" (UID: "f172027f-6aff-4a90-80e3-2eff8409323e") : secret "samples-operator-tls" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:28.036564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:28.036640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:28.036672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:28.036720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.036935 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:30.036915997 +0000 UTC m=+179.445217437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037352 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037371 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c968ff66-qtjbf: secret "image-registry-tls" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037420 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls podName:38ef944c-51aa-497d-859c-4d1b4348256f nodeName:}" failed. No retries permitted until 2026-06-11 16:34:30.037403251 +0000 UTC m=+179.445704686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls") pod "image-registry-75c968ff66-qtjbf" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f") : secret "image-registry-tls" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037483 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037516 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:34:28.037544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037520 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:30.03750939 +0000 UTC m=+179.445810825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:28.038265 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:28.037564 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:30.037553115 +0000 UTC m=+179.445854552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : secret "router-metrics-certs-default" not found Jun 11 16:34:29.956478 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:29.956429 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:29.956991 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:29.956606 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:34:29.956991 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:29.956686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls podName:f172027f-6aff-4a90-80e3-2eff8409323e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:33.956663934 +0000 UTC m=+183.364965370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-t798p" (UID: "f172027f-6aff-4a90-80e3-2eff8409323e") : secret "samples-operator-tls" not found Jun 11 16:34:30.057888 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.057856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:30.058026 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.057911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:30.058026 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.057941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:30.058026 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.058000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058026 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058039 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058055 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c968ff66-qtjbf: secret "image-registry-tls" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058087 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:34.058067619 +0000 UTC m=+183.466369055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058097 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058148 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:34.058132863 +0000 UTC m=+183.466434303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : secret "router-metrics-certs-default" not found Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058169 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:34.05816057 +0000 UTC m=+183.466462013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:30.058202 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:30.058184 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls podName:38ef944c-51aa-497d-859c-4d1b4348256f nodeName:}" failed. No retries permitted until 2026-06-11 16:34:34.058176133 +0000 UTC m=+183.466477589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls") pod "image-registry-75c968ff66-qtjbf" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f") : secret "image-registry-tls" not found Jun 11 16:34:30.717164 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.717121 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nmcw8" event={"ID":"7b6038a9-88ef-415d-9d3d-7eb20113f3ba","Type":"ContainerStarted","Data":"211303d305b22fab1d69eb92cdc25a9238c2fd745dff2a70c6394c7202fee5d9"} Jun 11 16:34:30.718652 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.718614 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" event={"ID":"e6e73724-2e08-42ac-bb82-4349e290c13d","Type":"ContainerStarted","Data":"5d0b56522385d47a1a0cfd11362afc2f2f034bcb33a60b9cb2104de0880e1563"} Jun 11 16:34:30.720191 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.720163 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" event={"ID":"e745c249-c378-4460-bd47-b9ded6bc0431","Type":"ContainerStarted","Data":"d1691e19c961035a0cf407ffce866b22627666076650177d9736c93b68e48cc3"} Jun 11 16:34:30.733596 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.733528 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-nmcw8" podStartSLOduration=1.727964392 podStartE2EDuration="4.733506982s" totalImagesPullingTime="3.00554259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:30.731655166 +0000 UTC m=+180.139956623" watchObservedRunningTime="2026-06-11 16:34:30.733506982 +0000 UTC m=+180.141808440" Jun 11 16:34:30.746016 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.745906 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" podStartSLOduration=1.512957486 podStartE2EDuration="4.745870555s" totalImagesPullingTime="3.232913069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:30.744919955 +0000 UTC m=+180.153221436" watchObservedRunningTime="2026-06-11 16:34:30.745870555 +0000 UTC m=+180.154172014" Jun 11 16:34:30.763210 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:30.763150 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" podStartSLOduration=1.757448411 podStartE2EDuration="4.763127578s" totalImagesPullingTime="3.005679167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:30.762059877 +0000 UTC m=+180.170361334" watchObservedRunningTime="2026-06-11 16:34:30.763127578 +0000 UTC m=+180.171429035" Jun 11 16:34:31.387297 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.387263 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk"] Jun 11 16:34:31.391148 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.391124 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" Jun 11 16:34:31.393084 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.393057 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 16:34:31.393197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.393112 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 16:34:31.393441 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.393421 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5zzdw\"" Jun 11 16:34:31.405289 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.405049 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk"] Jun 11 16:34:31.571935 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.571894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r98j\" (UniqueName: \"kubernetes.io/projected/7abe9370-3fca-45f2-82d5-b9518d16e6ab-kube-api-access-9r98j\") pod \"migrator-955ffdf5f-vnvkk\" (UID: \"7abe9370-3fca-45f2-82d5-b9518d16e6ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" Jun 11 16:34:31.672682 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.672570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r98j\" (UniqueName: \"kubernetes.io/projected/7abe9370-3fca-45f2-82d5-b9518d16e6ab-kube-api-access-9r98j\") pod \"migrator-955ffdf5f-vnvkk\" (UID: \"7abe9370-3fca-45f2-82d5-b9518d16e6ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" Jun 11 16:34:31.680159 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.680127 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r98j\" (UniqueName: \"kubernetes.io/projected/7abe9370-3fca-45f2-82d5-b9518d16e6ab-kube-api-access-9r98j\") pod \"migrator-955ffdf5f-vnvkk\" (UID: \"7abe9370-3fca-45f2-82d5-b9518d16e6ab\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" Jun 11 16:34:31.708392 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.708360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" Jun 11 16:34:31.832778 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:31.832731 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk"] Jun 11 16:34:31.835750 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:31.835725 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abe9370_3fca_45f2_82d5_b9518d16e6ab.slice/crio-a21555f4fff6fe8f7943793a158da1ce73de2b8ab173098324aa6a3b8c4d0bdd WatchSource:0}: Error finding container a21555f4fff6fe8f7943793a158da1ce73de2b8ab173098324aa6a3b8c4d0bdd: Status 404 returned error can't find the container with id a21555f4fff6fe8f7943793a158da1ce73de2b8ab173098324aa6a3b8c4d0bdd Jun 11 16:34:32.729282 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:32.729247 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" event={"ID":"7abe9370-3fca-45f2-82d5-b9518d16e6ab","Type":"ContainerStarted","Data":"a21555f4fff6fe8f7943793a158da1ce73de2b8ab173098324aa6a3b8c4d0bdd"} Jun 11 16:34:33.100151 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:33.100065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pvjp_a3dfa592-f76a-4e98-b3cc-88bbfe5a6581/dns-node-resolver/0.log" Jun 11 16:34:33.734579 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:33.734539 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" event={"ID":"7abe9370-3fca-45f2-82d5-b9518d16e6ab","Type":"ContainerStarted","Data":"6dcfefc32f629cca551611960d4dc53981710e1e2efb73af66c16626c83e6823"} Jun 11 16:34:33.735049 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:33.734607 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" event={"ID":"7abe9370-3fca-45f2-82d5-b9518d16e6ab","Type":"ContainerStarted","Data":"89abaffb415a9518b38b1ba944e2864b9760796a41f10f71e9dc07edcf7e2a4b"} Jun 11 16:34:33.758167 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:33.755483 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vnvkk" podStartSLOduration=1.7867096820000001 podStartE2EDuration="2.755461007s" totalImagesPullingTime="968.751325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:33.754619402 +0000 UTC m=+183.162920860" watchObservedRunningTime="2026-06-11 16:34:33.755461007 +0000 UTC m=+183.163762466" Jun 11 16:34:33.993734 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:33.993638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:33.993898 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:33.993798 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 16:34:33.993898 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:33.993859 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls podName:f172027f-6aff-4a90-80e3-2eff8409323e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:41.993845212 +0000 UTC m=+191.402146645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-t798p" (UID: "f172027f-6aff-4a90-80e3-2eff8409323e") : secret "samples-operator-tls" not found Jun 11 16:34:34.094284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.094236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:34.094467 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.094344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:34.094467 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.094388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:34.094467 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094425 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:42.094404125 +0000 UTC m=+191.502705569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:34.094467 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.094453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094509 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094529 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c968ff66-qtjbf: secret "image-registry-tls" not found Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094538 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094576 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:42.094562979 +0000 UTC m=+191.502864413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : secret "router-metrics-certs-default" not found Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094592 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls podName:38ef944c-51aa-497d-859c-4d1b4348256f nodeName:}" failed. No retries permitted until 2026-06-11 16:34:42.094583609 +0000 UTC m=+191.502885059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls") pod "image-registry-75c968ff66-qtjbf" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f") : secret "image-registry-tls" not found Jun 11 16:34:34.094677 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094606 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:34.094943 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:34.094686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:42.094666851 +0000 UTC m=+191.502968291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:34.500738 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.500715 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7tgx_aa0e0d96-186a-4bc1-b124-25b2c313b738/node-ca/0.log" Jun 11 16:34:34.900953 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:34.900478 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bk7cp_622f8158-f72f-4790-9e60-d94cbfb703a7/serve-healthcheck-canary/0.log" Jun 11 16:34:42.051411 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.051359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:42.053742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.053722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f172027f-6aff-4a90-80e3-2eff8409323e-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-t798p\" (UID: \"f172027f-6aff-4a90-80e3-2eff8409323e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:42.151235 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.151205 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cfm6b\"" Jun 11 16:34:42.152406 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.152389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:42.152469 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.152430 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:42.152469 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.152453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:42.152543 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:42.152525 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:42.152589 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:42.152579 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls podName:36bcc398-6201-4b82-9b2d-e3ed531ae435 nodeName:}" failed. No retries permitted until 2026-06-11 16:34:58.152565336 +0000 UTC m=+207.560866772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-62ztb" (UID: "36bcc398-6201-4b82-9b2d-e3ed531ae435") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:34:42.152589 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.152575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:42.152820 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:34:42.152791 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle podName:1e543698-f475-4694-93c7-2b9227698c9e nodeName:}" failed. No retries permitted until 2026-06-11 16:34:58.15274359 +0000 UTC m=+207.561045027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle") pod "router-default-76d659c6c5-z4kfv" (UID: "1e543698-f475-4694-93c7-2b9227698c9e") : configmap references non-existent config key: service-ca.crt Jun 11 16:34:42.154798 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.154772 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e543698-f475-4694-93c7-2b9227698c9e-metrics-certs\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:42.154853 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.154822 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"image-registry-75c968ff66-qtjbf\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:42.159738 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.159716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" Jun 11 16:34:42.167183 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.167159 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5r2pf\"" Jun 11 16:34:42.175312 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.175277 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:42.292926 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.292901 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p"] Jun 11 16:34:42.309790 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.309664 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:34:42.312179 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:42.312153 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ef944c_51aa_497d_859c_4d1b4348256f.slice/crio-779eeef48263c30a96ea1e83b97124d786246c55e49779d590a55c4a5c60eee3 WatchSource:0}: Error finding container 779eeef48263c30a96ea1e83b97124d786246c55e49779d590a55c4a5c60eee3: Status 404 returned error can't find the container with id 779eeef48263c30a96ea1e83b97124d786246c55e49779d590a55c4a5c60eee3 Jun 11 16:34:42.763118 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.763080 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" event={"ID":"f172027f-6aff-4a90-80e3-2eff8409323e","Type":"ContainerStarted","Data":"d4a01be0959d7f05fe4903c18ff9e4b67851bb09a87240d3598f35922bcfbaba"} Jun 11 16:34:42.764357 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.764327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" event={"ID":"38ef944c-51aa-497d-859c-4d1b4348256f","Type":"ContainerStarted","Data":"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2"} Jun 11 16:34:42.764481 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.764373 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" event={"ID":"38ef944c-51aa-497d-859c-4d1b4348256f","Type":"ContainerStarted","Data":"779eeef48263c30a96ea1e83b97124d786246c55e49779d590a55c4a5c60eee3"} Jun 11 16:34:42.764481 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.764466 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:34:42.782522 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:42.782467 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" podStartSLOduration=16.782450648 podStartE2EDuration="16.782450648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:42.781555911 +0000 UTC m=+192.189857369" watchObservedRunningTime="2026-06-11 16:34:42.782450648 +0000 UTC m=+192.190752081" Jun 11 16:34:44.776479 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:44.776434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" event={"ID":"f172027f-6aff-4a90-80e3-2eff8409323e","Type":"ContainerStarted","Data":"6dacb2e8e79b412d9aa4afe013dbf08c4383854dd90b0d849cc47d7013b9fe71"} Jun 11 16:34:44.776932 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:44.776494 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" event={"ID":"f172027f-6aff-4a90-80e3-2eff8409323e","Type":"ContainerStarted","Data":"e064a8dd3bb9e8796207967ec8c583106e4511b99acb67b7038319752b81cae5"} Jun 11 16:34:44.792101 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:44.792052 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-t798p" podStartSLOduration=17.042491757 podStartE2EDuration="18.792036999s" totalImagesPullingTime="1.749545242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:44.791555808 +0000 UTC m=+194.199857279" watchObservedRunningTime="2026-06-11 16:34:44.792036999 +0000 UTC m=+194.200338454" Jun 11 16:34:53.859821 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.859787 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lmpdb"] Jun 11 16:34:53.865869 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.865847 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.868900 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.868870 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:34:53.868900 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.868888 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:34:53.869051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.868926 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4c7sw\"" Jun 11 16:34:53.873591 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.873568 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:34:53.877849 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.877828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmpdb"] Jun 11 16:34:53.906281 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.906259 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c564c96c-lr8vs"] Jun 11 16:34:53.913096 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.913066 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.922497 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.922474 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c564c96c-lr8vs"] Jun 11 16:34:53.951989 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.951963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-image-registry-private-configuration\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952111 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.951997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-trusted-ca\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952111 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34938f6c-2a7e-480f-9f4b-ff4d360770b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.952111 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34938f6c-2a7e-480f-9f4b-ff4d360770b0-crio-socket\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.952111 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgcx\" (UniqueName: \"kubernetes.io/projected/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-api-access-mkgcx\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-tls\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8484718d-18cd-47e0-8230-7f38f7cc29c9-ca-trust-extracted\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-installation-pull-secrets\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952237 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-bound-sa-token\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34938f6c-2a7e-480f-9f4b-ff4d360770b0-data-volume\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.952330 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-certificates\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:53.952536 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:53.952536 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:53.952402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhmd\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-kube-api-access-zbhmd\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.053632 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.053632 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhmd\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-kube-api-access-zbhmd\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.053877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-image-registry-private-configuration\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.053877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-trusted-ca\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.053877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34938f6c-2a7e-480f-9f4b-ff4d360770b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34938f6c-2a7e-480f-9f4b-ff4d360770b0-crio-socket\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgcx\" (UniqueName: \"kubernetes.io/projected/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-api-access-mkgcx\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-tls\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8484718d-18cd-47e0-8230-7f38f7cc29c9-ca-trust-extracted\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.053996 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34938f6c-2a7e-480f-9f4b-ff4d360770b0-crio-socket\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.054103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-installation-pull-secrets\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.054404 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054357 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.054404 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-bound-sa-token\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.055105 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34938f6c-2a7e-480f-9f4b-ff4d360770b0-data-volume\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.055105 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8484718d-18cd-47e0-8230-7f38f7cc29c9-ca-trust-extracted\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.055105 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-certificates\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.055105 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054804 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-trusted-ca\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.055105 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.054901 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34938f6c-2a7e-480f-9f4b-ff4d360770b0-data-volume\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.055592 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.055570 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-certificates\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.056399 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.056376 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34938f6c-2a7e-480f-9f4b-ff4d360770b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.056511 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.056442 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-image-registry-private-configuration\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.056674 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.056655 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8484718d-18cd-47e0-8230-7f38f7cc29c9-installation-pull-secrets\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.057028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.057013 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-registry-tls\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.067074 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.067044 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-bound-sa-token\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.067181 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.067167 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhmd\" (UniqueName: \"kubernetes.io/projected/8484718d-18cd-47e0-8230-7f38f7cc29c9-kube-api-access-zbhmd\") pod \"image-registry-5c564c96c-lr8vs\" (UID: \"8484718d-18cd-47e0-8230-7f38f7cc29c9\") " pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.067909 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.067888 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgcx\" (UniqueName: \"kubernetes.io/projected/34938f6c-2a7e-480f-9f4b-ff4d360770b0-kube-api-access-mkgcx\") pod \"insights-runtime-extractor-lmpdb\" (UID: \"34938f6c-2a7e-480f-9f4b-ff4d360770b0\") " pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.174916 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.174830 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lmpdb" Jun 11 16:34:54.222554 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.222306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.306861 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.306780 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lmpdb"] Jun 11 16:34:54.311005 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:54.310970 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34938f6c_2a7e_480f_9f4b_ff4d360770b0.slice/crio-038a9c1e6d5718592884e599ae0e5f39d0e59be012a29445a517e4a2ebb53517 WatchSource:0}: Error finding container 038a9c1e6d5718592884e599ae0e5f39d0e59be012a29445a517e4a2ebb53517: Status 404 returned error can't find the container with id 038a9c1e6d5718592884e599ae0e5f39d0e59be012a29445a517e4a2ebb53517 Jun 11 16:34:54.355337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.355309 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c564c96c-lr8vs"] Jun 11 16:34:54.358765 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:54.358729 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8484718d_18cd_47e0_8230_7f38f7cc29c9.slice/crio-58b9075fbbd2fc0ece85420fedd3205f7031f76bb609ca429efeb6f1764c0b32 WatchSource:0}: Error finding container 58b9075fbbd2fc0ece85420fedd3205f7031f76bb609ca429efeb6f1764c0b32: Status 404 returned error can't find the container with id 58b9075fbbd2fc0ece85420fedd3205f7031f76bb609ca429efeb6f1764c0b32 Jun 11 16:34:54.810458 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.810422 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmpdb" event={"ID":"34938f6c-2a7e-480f-9f4b-ff4d360770b0","Type":"ContainerStarted","Data":"0c5cfa6ff9f55ad613ded32acc079648c627e0cb41a93aa44dd028707d937f87"} Jun 11 16:34:54.810630 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.810489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmpdb" event={"ID":"34938f6c-2a7e-480f-9f4b-ff4d360770b0","Type":"ContainerStarted","Data":"038a9c1e6d5718592884e599ae0e5f39d0e59be012a29445a517e4a2ebb53517"} Jun 11 16:34:54.811732 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.811704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" event={"ID":"8484718d-18cd-47e0-8230-7f38f7cc29c9","Type":"ContainerStarted","Data":"5beed75dbd0546208b1065f0c4630a2587a22abba0d0f8e0f76369bcf2b4f0bb"} Jun 11 16:34:54.811858 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.811749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" event={"ID":"8484718d-18cd-47e0-8230-7f38f7cc29c9","Type":"ContainerStarted","Data":"58b9075fbbd2fc0ece85420fedd3205f7031f76bb609ca429efeb6f1764c0b32"} Jun 11 16:34:54.811858 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.811839 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:34:54.829619 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:54.829566 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podStartSLOduration=1.829546695 podStartE2EDuration="1.829546695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:54.828422715 +0000 UTC m=+204.236724172" watchObservedRunningTime="2026-06-11 16:34:54.829546695 +0000 UTC m=+204.237848150" Jun 11 16:34:55.817218 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:55.817177 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmpdb" event={"ID":"34938f6c-2a7e-480f-9f4b-ff4d360770b0","Type":"ContainerStarted","Data":"d183b9e3b708b120b5908738499dcbd5b68fbe7f529d71bc3f576045b1d2c2b1"} Jun 11 16:34:56.822216 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:56.822181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lmpdb" event={"ID":"34938f6c-2a7e-480f-9f4b-ff4d360770b0","Type":"ContainerStarted","Data":"2878955eb2044665495761b6c7a6cccf2f33bc8b3a836097f4f50f9da0a9f562"} Jun 11 16:34:56.840652 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:56.840594 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lmpdb" podStartSLOduration=1.6824392129999999 podStartE2EDuration="3.840578417s" totalImagesPullingTime="2.158139204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:34:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:56.839582309 +0000 UTC m=+206.247883920" watchObservedRunningTime="2026-06-11 16:34:56.840578417 +0000 UTC m=+206.248879872" Jun 11 16:34:58.189062 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.189013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:58.189402 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.189131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:58.189619 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.189593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e543698-f475-4694-93c7-2b9227698c9e-service-ca-bundle\") pod \"router-default-76d659c6c5-z4kfv\" (UID: \"1e543698-f475-4694-93c7-2b9227698c9e\") " pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:58.191390 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.191366 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36bcc398-6201-4b82-9b2d-e3ed531ae435-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-62ztb\" (UID: \"36bcc398-6201-4b82-9b2d-e3ed531ae435\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:58.375536 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.375498 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dp79p\"" Jun 11 16:34:58.379002 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.378982 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vcr7m\"" Jun 11 16:34:58.383646 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.383631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:58.387869 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.387851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" Jun 11 16:34:58.565391 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.565356 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76d659c6c5-z4kfv"] Jun 11 16:34:58.567963 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:58.567933 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e543698_f475_4694_93c7_2b9227698c9e.slice/crio-cf40cbf177478490831a499d321a66948e4e900d1d55691f4e988c8192b885d8 WatchSource:0}: Error finding container cf40cbf177478490831a499d321a66948e4e900d1d55691f4e988c8192b885d8: Status 404 returned error can't find the container with id cf40cbf177478490831a499d321a66948e4e900d1d55691f4e988c8192b885d8 Jun 11 16:34:58.582300 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.582272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb"] Jun 11 16:34:58.585195 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:34:58.585168 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bcc398_6201_4b82_9b2d_e3ed531ae435.slice/crio-d2f1a8326ffd99e6cc40b4987b923a28d6a7b1b656c17a83c6582cc5002fa2fd WatchSource:0}: Error finding container d2f1a8326ffd99e6cc40b4987b923a28d6a7b1b656c17a83c6582cc5002fa2fd: Status 404 returned error can't find the container with id d2f1a8326ffd99e6cc40b4987b923a28d6a7b1b656c17a83c6582cc5002fa2fd Jun 11 16:34:58.831058 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.830966 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" event={"ID":"1e543698-f475-4694-93c7-2b9227698c9e","Type":"ContainerStarted","Data":"97d50c4b9a168acd0247d93f66b862c18b204f83f5ff3330007f96582d6e5501"} Jun 11 16:34:58.831058 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.831023 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" event={"ID":"1e543698-f475-4694-93c7-2b9227698c9e","Type":"ContainerStarted","Data":"cf40cbf177478490831a499d321a66948e4e900d1d55691f4e988c8192b885d8"} Jun 11 16:34:58.832089 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.832068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" event={"ID":"36bcc398-6201-4b82-9b2d-e3ed531ae435","Type":"ContainerStarted","Data":"d2f1a8326ffd99e6cc40b4987b923a28d6a7b1b656c17a83c6582cc5002fa2fd"} Jun 11 16:34:58.850071 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:58.850017 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" podStartSLOduration=32.849990525 podStartE2EDuration="32.849990525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:34:58.849086948 +0000 UTC m=+208.257388406" watchObservedRunningTime="2026-06-11 16:34:58.849990525 +0000 UTC m=+208.258291980" Jun 11 16:34:59.384195 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:59.384158 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:59.387597 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:59.387568 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:59.836100 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:59.836070 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:34:59.837345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:34:59.837325 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76d659c6c5-z4kfv" Jun 11 16:35:00.840804 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:00.840698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" event={"ID":"36bcc398-6201-4b82-9b2d-e3ed531ae435","Type":"ContainerStarted","Data":"023a24cc6f2329e34c288f492d97b1170f810eadc26785c9714bf55c614e1922"} Jun 11 16:35:00.856211 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:00.856167 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-62ztb" podStartSLOduration=32.989908845 podStartE2EDuration="34.85615061s" totalImagesPullingTime="1.866241765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:00.855533353 +0000 UTC m=+210.263834813" watchObservedRunningTime="2026-06-11 16:35:00.85615061 +0000 UTC m=+210.264452064" Jun 11 16:35:03.878772 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:03.878715 2554 patch_prober.go:28] interesting pod/image-registry-75c968ff66-qtjbf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:03.879137 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:03.878796 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:08.364230 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.364194 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zkrb6"] Jun 11 16:35:08.367650 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.367631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.370097 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.370070 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:35:08.370256 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.370120 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:35:08.370468 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.370454 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q2fj7\"" Jun 11 16:35:08.370713 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.370697 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:35:08.370800 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.370699 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:35:08.479713 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479672 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-textfile\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.479892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479739 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-root\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.479892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-metrics-client-ca\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.479892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.479892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26bgx\" (UniqueName: \"kubernetes.io/projected/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-kube-api-access-26bgx\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.479892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-tls\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.480048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-sys\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.480048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-wtmp\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.480048 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.479977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.580959 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.580919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-root\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.580958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-metrics-client-ca\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-root\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581083 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26bgx\" (UniqueName: \"kubernetes.io/projected/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-kube-api-access-26bgx\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-tls\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581136 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-sys\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-wtmp\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581248 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-sys\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581328 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-wtmp\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581451 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-textfile\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581792 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581727 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-textfile\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581925 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.581925 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.581830 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-metrics-client-ca\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.583580 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.583558 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-tls\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.583667 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.583589 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.592279 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.592251 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26bgx\" (UniqueName: \"kubernetes.io/projected/20ff493e-1ddd-46ce-aeb3-596be9b3fc68-kube-api-access-26bgx\") pod \"node-exporter-zkrb6\" (UID: \"20ff493e-1ddd-46ce-aeb3-596be9b3fc68\") " pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.677341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.677242 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkrb6" Jun 11 16:35:08.688448 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:35:08.688417 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ff493e_1ddd_46ce_aeb3_596be9b3fc68.slice/crio-250bb8e209bd9605096d64087bb4ddf7092a005be131bdf166f6a01e7c7c4fba WatchSource:0}: Error finding container 250bb8e209bd9605096d64087bb4ddf7092a005be131bdf166f6a01e7c7c4fba: Status 404 returned error can't find the container with id 250bb8e209bd9605096d64087bb4ddf7092a005be131bdf166f6a01e7c7c4fba Jun 11 16:35:08.867317 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:08.867281 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkrb6" event={"ID":"20ff493e-1ddd-46ce-aeb3-596be9b3fc68","Type":"ContainerStarted","Data":"250bb8e209bd9605096d64087bb4ddf7092a005be131bdf166f6a01e7c7c4fba"} Jun 11 16:35:09.872335 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:09.872240 2554 generic.go:356] "Generic (PLEG): container finished" podID="20ff493e-1ddd-46ce-aeb3-596be9b3fc68" containerID="ba19df38b556f4f70f74448f1f0b75ab25ac4b8684642cc04983a42aafac5cb4" exitCode=0 Jun 11 16:35:09.872687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:09.872331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkrb6" event={"ID":"20ff493e-1ddd-46ce-aeb3-596be9b3fc68","Type":"ContainerDied","Data":"ba19df38b556f4f70f74448f1f0b75ab25ac4b8684642cc04983a42aafac5cb4"} Jun 11 16:35:10.678098 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.678064 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:35:10.681006 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.680990 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.684172 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684092 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:35:10.684172 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684095 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:35:10.684172 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684131 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:35:10.684172 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684149 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:35:10.684444 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:35:10.684444 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684131 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:35:10.684444 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684341 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:35:10.684554 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.684519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lbfkf\"" Jun 11 16:35:10.689541 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.689518 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:35:10.690695 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.690674 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:35:10.801106 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.801425 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.801292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bctq6\" (UniqueName: \"kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.882430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.882400 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkrb6" event={"ID":"20ff493e-1ddd-46ce-aeb3-596be9b3fc68","Type":"ContainerStarted","Data":"00190588cd33f688df15602078fd43af9edbcb16f2c74afab29b23dc600350aa"} Jun 11 16:35:10.882830 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.882474 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkrb6" event={"ID":"20ff493e-1ddd-46ce-aeb3-596be9b3fc68","Type":"ContainerStarted","Data":"907a1f061ecda7e64377915171a6f1b5ed91621e5f93fd5a501f8d11c817ccc2"} Jun 11 16:35:10.900820 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.900767 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zkrb6" podStartSLOduration=1.942329994 podStartE2EDuration="2.900735689s" totalImagesPullingTime="892.211037ms" totalInitContainerRuntime="66.194658ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:10.899296707 +0000 UTC m=+220.307598163" watchObservedRunningTime="2026-06-11 16:35:10.900735689 +0000 UTC m=+220.309037146" Jun 11 16:35:10.902743 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902710 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.902891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.902891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.902891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.902891 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903126 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.902997 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903126 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.903046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bctq6\" (UniqueName: \"kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903566 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.903544 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903681 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.903569 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903717 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.903675 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.903899 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.903876 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.905450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.905429 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.905500 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.905432 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.915183 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.915158 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bctq6\" (UniqueName: \"kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6\") pod \"console-58b9b84db-cn5d6\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:10.991399 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:10.991354 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:11.130245 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:11.130207 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:35:11.133220 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:35:11.133193 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88af4bc_1663_4267_903f_91d1161bf6ab.slice/crio-a24a63ea3dd56f28f775fe39653fb84d72bcf459ddc3355ab4066f85504de449 WatchSource:0}: Error finding container a24a63ea3dd56f28f775fe39653fb84d72bcf459ddc3355ab4066f85504de449: Status 404 returned error can't find the container with id a24a63ea3dd56f28f775fe39653fb84d72bcf459ddc3355ab4066f85504de449 Jun 11 16:35:11.887711 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:11.887663 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9b84db-cn5d6" event={"ID":"f88af4bc-1663-4267-903f-91d1161bf6ab","Type":"ContainerStarted","Data":"a24a63ea3dd56f28f775fe39653fb84d72bcf459ddc3355ab4066f85504de449"} Jun 11 16:35:13.877908 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:13.877867 2554 patch_prober.go:28] interesting pod/image-registry-75c968ff66-qtjbf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:13.878294 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:13.877927 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:13.898421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:13.898389 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9b84db-cn5d6" event={"ID":"f88af4bc-1663-4267-903f-91d1161bf6ab","Type":"ContainerStarted","Data":"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e"} Jun 11 16:35:13.916009 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:13.915958 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58b9b84db-cn5d6" podStartSLOduration=1.359107627 podStartE2EDuration="3.915940349s" totalImagesPullingTime="2.556832722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:13.914721398 +0000 UTC m=+223.323022854" watchObservedRunningTime="2026-06-11 16:35:13.915940349 +0000 UTC m=+223.324241847" Jun 11 16:35:14.227095 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:14.227051 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:14.227277 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:14.227108 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:15.821656 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:15.821622 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:15.822051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:15.821672 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:18.893691 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:18.893631 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" containerID="cri-o://fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2" gracePeriod=30 Jun 11 16:35:19.136581 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.136553 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:35:19.279555 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279523 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.279729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279568 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.279729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279600 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.279729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279621 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.279729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279639 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.279729 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279663 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.280017 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279800 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-567v4\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.280017 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.279896 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets\") pod \"38ef944c-51aa-497d-859c-4d1b4348256f\" (UID: \"38ef944c-51aa-497d-859c-4d1b4348256f\") " Jun 11 16:35:19.280141 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.280114 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:35:19.280232 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.280205 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:35:19.280296 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.280244 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-registry-certificates\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.281908 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.281882 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:35:19.282656 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.282635 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:35:19.282865 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.282803 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4" (OuterVolumeSpecName: "kube-api-access-567v4") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "kube-api-access-567v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:35:19.282865 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.282823 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:35:19.282980 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.282884 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:35:19.291269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.291239 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "38ef944c-51aa-497d-859c-4d1b4348256f" (UID: "38ef944c-51aa-497d-859c-4d1b4348256f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:35:19.381530 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381491 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-installation-pull-secrets\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381530 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381522 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38ef944c-51aa-497d-859c-4d1b4348256f-image-registry-private-configuration\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381530 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381532 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-registry-tls\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381530 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381540 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-bound-sa-token\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381831 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381548 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38ef944c-51aa-497d-859c-4d1b4348256f-trusted-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381831 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381556 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38ef944c-51aa-497d-859c-4d1b4348256f-ca-trust-extracted\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.381831 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.381564 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-567v4\" (UniqueName: \"kubernetes.io/projected/38ef944c-51aa-497d-859c-4d1b4348256f-kube-api-access-567v4\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:35:19.920257 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.920219 2554 generic.go:356] "Generic (PLEG): container finished" podID="38ef944c-51aa-497d-859c-4d1b4348256f" containerID="fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2" exitCode=0 Jun 11 16:35:19.920709 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.920264 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" Jun 11 16:35:19.920709 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.920297 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" event={"ID":"38ef944c-51aa-497d-859c-4d1b4348256f","Type":"ContainerDied","Data":"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2"} Jun 11 16:35:19.920709 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.920338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c968ff66-qtjbf" event={"ID":"38ef944c-51aa-497d-859c-4d1b4348256f","Type":"ContainerDied","Data":"779eeef48263c30a96ea1e83b97124d786246c55e49779d590a55c4a5c60eee3"} Jun 11 16:35:19.920709 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.920360 2554 scope.go:117] "RemoveContainer" containerID="fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2" Jun 11 16:35:19.929274 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.929252 2554 scope.go:117] "RemoveContainer" containerID="fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2" Jun 11 16:35:19.929544 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:35:19.929524 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2\": container with ID starting with fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2 not found: ID does not exist" containerID="fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2" Jun 11 16:35:19.929594 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.929553 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2"} err="failed to get container status \"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2\": rpc error: code = NotFound desc = could not find container \"fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2\": container with ID starting with fcfbe40584db96ad0b1729a2052a14efaadceebd7b2e7f5062e09cda7bf224d2 not found: ID does not exist" Jun 11 16:35:19.939824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.939792 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:35:19.945768 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:19.945728 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c968ff66-qtjbf"] Jun 11 16:35:20.992284 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:20.992243 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:20.992811 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:20.992338 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:35:20.993932 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:20.993905 2554 patch_prober.go:28] interesting pod/console-58b9b84db-cn5d6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 11 16:35:20.994030 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:20.993951 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58b9b84db-cn5d6" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 11 16:35:21.062750 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:21.062707 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" path="/var/lib/kubelet/pods/38ef944c-51aa-497d-859c-4d1b4348256f/volumes" Jun 11 16:35:24.226516 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:24.226482 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:24.226930 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:24.226552 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:25.822208 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:25.822172 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:25.822596 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:25.822233 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:30.992014 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:30.991979 2554 patch_prober.go:28] interesting pod/console-58b9b84db-cn5d6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 11 16:35:30.992548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:30.992048 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58b9b84db-cn5d6" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 11 16:35:34.227559 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.227520 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:34.228003 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.227590 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:34.228003 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.227634 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:35:34.228100 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.228082 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"5beed75dbd0546208b1065f0c4630a2587a22abba0d0f8e0f76369bcf2b4f0bb"} pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 16:35:34.231953 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.231912 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:34.232094 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:34.231984 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:40.992250 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:40.992210 2554 patch_prober.go:28] interesting pod/console-58b9b84db-cn5d6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 11 16:35:40.992673 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:40.992275 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58b9b84db-cn5d6" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 11 16:35:42.982930 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:42.982842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:35:42.985194 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:42.985170 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db264153-220b-4974-8ba7-ede0b19c142b-metrics-certs\") pod \"network-metrics-daemon-b9lpx\" (UID: \"db264153-220b-4974-8ba7-ede0b19c142b\") " pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:35:43.260921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:43.260839 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4qlb\"" Jun 11 16:35:43.269590 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:43.269557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9lpx" Jun 11 16:35:43.406622 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:43.406517 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9lpx"] Jun 11 16:35:43.409282 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:35:43.409250 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb264153_220b_4974_8ba7_ede0b19c142b.slice/crio-f5098ddd0b156ce59e44b9c6d1d95dad8743f69cdc95cfe9f2b15e11bf0fe945 WatchSource:0}: Error finding container f5098ddd0b156ce59e44b9c6d1d95dad8743f69cdc95cfe9f2b15e11bf0fe945: Status 404 returned error can't find the container with id f5098ddd0b156ce59e44b9c6d1d95dad8743f69cdc95cfe9f2b15e11bf0fe945 Jun 11 16:35:44.003731 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:44.003691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9lpx" event={"ID":"db264153-220b-4974-8ba7-ede0b19c142b","Type":"ContainerStarted","Data":"f5098ddd0b156ce59e44b9c6d1d95dad8743f69cdc95cfe9f2b15e11bf0fe945"} Jun 11 16:35:44.233561 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:44.233528 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:44.233788 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:44.233584 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:45.008841 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:45.008805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9lpx" event={"ID":"db264153-220b-4974-8ba7-ede0b19c142b","Type":"ContainerStarted","Data":"eff7fb1c1758babbac6e51fa9a369f5e7f1b3a31db34b28e68f0489eaa14a76a"} Jun 11 16:35:45.009256 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:45.008861 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9lpx" event={"ID":"db264153-220b-4974-8ba7-ede0b19c142b","Type":"ContainerStarted","Data":"0b611f0531eb71b8f188ab1175391742427dafeba5213656ff4267f29f420650"} Jun 11 16:35:45.024620 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:45.024565 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b9lpx" podStartSLOduration=253.228303132 podStartE2EDuration="4m14.024548391s" totalImagesPullingTime="796.245259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:35:45.023864441 +0000 UTC m=+254.432165898" watchObservedRunningTime="2026-06-11 16:35:45.024548391 +0000 UTC m=+254.432849847" Jun 11 16:35:46.013966 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:46.013863 2554 generic.go:356] "Generic (PLEG): container finished" podID="e745c249-c378-4460-bd47-b9ded6bc0431" containerID="d1691e19c961035a0cf407ffce866b22627666076650177d9736c93b68e48cc3" exitCode=0 Jun 11 16:35:46.014353 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:46.013949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" event={"ID":"e745c249-c378-4460-bd47-b9ded6bc0431","Type":"ContainerDied","Data":"d1691e19c961035a0cf407ffce866b22627666076650177d9736c93b68e48cc3"} Jun 11 16:35:46.014401 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:46.014368 2554 scope.go:117] "RemoveContainer" containerID="d1691e19c961035a0cf407ffce866b22627666076650177d9736c93b68e48cc3" Jun 11 16:35:47.019031 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:47.018994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-v6z2h" event={"ID":"e745c249-c378-4460-bd47-b9ded6bc0431","Type":"ContainerStarted","Data":"5c679a4a65346ebc1fd884f13b45662b5398d4a7fb5f690de6bb93e4b960fbef"} Jun 11 16:35:50.992450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:50.992409 2554 patch_prober.go:28] interesting pod/console-58b9b84db-cn5d6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 11 16:35:50.992890 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:50.992458 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58b9b84db-cn5d6" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 11 16:35:51.035314 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:51.035279 2554 generic.go:356] "Generic (PLEG): container finished" podID="7b6038a9-88ef-415d-9d3d-7eb20113f3ba" containerID="211303d305b22fab1d69eb92cdc25a9238c2fd745dff2a70c6394c7202fee5d9" exitCode=0 Jun 11 16:35:51.035490 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:51.035325 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nmcw8" event={"ID":"7b6038a9-88ef-415d-9d3d-7eb20113f3ba","Type":"ContainerDied","Data":"211303d305b22fab1d69eb92cdc25a9238c2fd745dff2a70c6394c7202fee5d9"} Jun 11 16:35:51.035647 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:51.035634 2554 scope.go:117] "RemoveContainer" containerID="211303d305b22fab1d69eb92cdc25a9238c2fd745dff2a70c6394c7202fee5d9" Jun 11 16:35:52.041525 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:52.041489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nmcw8" event={"ID":"7b6038a9-88ef-415d-9d3d-7eb20113f3ba","Type":"ContainerStarted","Data":"0b2f24dfb2f0daf83238a1c44d5918a7b82e1321442a1f7447530ccad8fe284f"} Jun 11 16:35:54.232096 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:54.232059 2554 patch_prober.go:28] interesting pod/image-registry-5c564c96c-lr8vs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 16:35:54.232468 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:54.232110 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:35:55.479880 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:55.479846 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-62ztb_36bcc398-6201-4b82-9b2d-e3ed531ae435/cluster-monitoring-operator/0.log" Jun 11 16:35:56.057094 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:56.057062 2554 generic.go:356] "Generic (PLEG): container finished" podID="e6e73724-2e08-42ac-bb82-4349e290c13d" containerID="5d0b56522385d47a1a0cfd11362afc2f2f034bcb33a60b9cb2104de0880e1563" exitCode=0 Jun 11 16:35:56.057280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:56.057144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" event={"ID":"e6e73724-2e08-42ac-bb82-4349e290c13d","Type":"ContainerDied","Data":"5d0b56522385d47a1a0cfd11362afc2f2f034bcb33a60b9cb2104de0880e1563"} Jun 11 16:35:56.057506 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:56.057490 2554 scope.go:117] "RemoveContainer" containerID="5d0b56522385d47a1a0cfd11362afc2f2f034bcb33a60b9cb2104de0880e1563" Jun 11 16:35:57.063383 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:57.063346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mqzhc" event={"ID":"e6e73724-2e08-42ac-bb82-4349e290c13d","Type":"ContainerStarted","Data":"73338ea5e8a6c7339e1b10eb0f57a6d6b90bb61e74d946d60182ba78848dd03e"} Jun 11 16:35:57.877300 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:57.877270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/init-textfile/0.log" Jun 11 16:35:58.078950 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:58.078922 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/node-exporter/0.log" Jun 11 16:35:58.277360 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:58.277330 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/kube-rbac-proxy/0.log" Jun 11 16:35:59.247518 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:35:59.247481 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" podUID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerName="registry" containerID="cri-o://5beed75dbd0546208b1065f0c4630a2587a22abba0d0f8e0f76369bcf2b4f0bb" gracePeriod=30 Jun 11 16:36:00.995919 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:00.995888 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:36:00.999707 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:00.999683 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:36:01.080423 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:01.080392 2554 generic.go:356] "Generic (PLEG): container finished" podID="8484718d-18cd-47e0-8230-7f38f7cc29c9" containerID="5beed75dbd0546208b1065f0c4630a2587a22abba0d0f8e0f76369bcf2b4f0bb" exitCode=0 Jun 11 16:36:01.080613 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:01.080460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" event={"ID":"8484718d-18cd-47e0-8230-7f38f7cc29c9","Type":"ContainerDied","Data":"5beed75dbd0546208b1065f0c4630a2587a22abba0d0f8e0f76369bcf2b4f0bb"} Jun 11 16:36:01.080613 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:01.080505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" event={"ID":"8484718d-18cd-47e0-8230-7f38f7cc29c9","Type":"ContainerStarted","Data":"6ee32a3a040460ef5229aa18ac8478c88266e00d5405d64dc913112663293dd6"} Jun 11 16:36:01.080838 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:01.080821 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:36:02.878522 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:02.878492 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58b9b84db-cn5d6_f88af4bc-1663-4267-903f-91d1161bf6ab/console/0.log" Jun 11 16:36:04.877799 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:04.877750 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pvjp_a3dfa592-f76a-4e98-b3cc-88bbfe5a6581/dns-node-resolver/0.log" Jun 11 16:36:05.193860 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:05.193821 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:36:05.478350 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:05.478258 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c564c96c-lr8vs_8484718d-18cd-47e0-8230-7f38f7cc29c9/registry/1.log" Jun 11 16:36:06.278414 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:06.278377 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7tgx_aa0e0d96-186a-4bc1-b124-25b2c313b738/node-ca/0.log" Jun 11 16:36:06.478671 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:06.478639 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:36:06.678193 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:06.678101 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bk7cp_622f8158-f72f-4790-9e60-d94cbfb703a7/serve-healthcheck-canary/0.log" Jun 11 16:36:16.659026 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:36:16.658980 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t2hfg" podUID="bf3d6eae-7f64-4680-a3e4-0edb9288e396" Jun 11 16:36:17.138794 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:17.138748 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:19.893160 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:19.893116 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:19.895411 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:19.895391 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf3d6eae-7f64-4680-a3e4-0edb9288e396-metrics-tls\") pod \"dns-default-t2hfg\" (UID: \"bf3d6eae-7f64-4680-a3e4-0edb9288e396\") " pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:20.141922 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:20.141887 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hsnw5\"" Jun 11 16:36:20.149915 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:20.149850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:20.288470 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:20.288430 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t2hfg"] Jun 11 16:36:20.291492 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:36:20.291463 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3d6eae_7f64_4680_a3e4_0edb9288e396.slice/crio-bcbbf3c592a776d8b162a6d41d5da644bcf26168b8cf5b3416374dfa27c9f1da WatchSource:0}: Error finding container bcbbf3c592a776d8b162a6d41d5da644bcf26168b8cf5b3416374dfa27c9f1da: Status 404 returned error can't find the container with id bcbbf3c592a776d8b162a6d41d5da644bcf26168b8cf5b3416374dfa27c9f1da Jun 11 16:36:21.156097 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:21.156059 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2hfg" event={"ID":"bf3d6eae-7f64-4680-a3e4-0edb9288e396","Type":"ContainerStarted","Data":"bcbbf3c592a776d8b162a6d41d5da644bcf26168b8cf5b3416374dfa27c9f1da"} Jun 11 16:36:22.088053 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:22.087970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c564c96c-lr8vs" Jun 11 16:36:22.161897 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:22.161848 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2hfg" event={"ID":"bf3d6eae-7f64-4680-a3e4-0edb9288e396","Type":"ContainerStarted","Data":"c8da734e554ee24b26ddfac51abd53a1f9e468f163b0d6f8c0242cc4d54fbe60"} Jun 11 16:36:22.162333 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:22.162050 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:22.162333 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:22.162082 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t2hfg" event={"ID":"bf3d6eae-7f64-4680-a3e4-0edb9288e396","Type":"ContainerStarted","Data":"a915d876c5076d72b6e075f2ebf20a9ab4475c144a6f4b8341eb0cafbb44e947"} Jun 11 16:36:22.178817 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:22.178749 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t2hfg" podStartSLOduration=251.737617441 podStartE2EDuration="4m13.178732453s" totalImagesPullingTime="1.441115012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:22.177667112 +0000 UTC m=+291.585968598" watchObservedRunningTime="2026-06-11 16:36:22.178732453 +0000 UTC m=+291.587033909" Jun 11 16:36:30.213842 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.213791 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58b9b84db-cn5d6" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" containerID="cri-o://e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e" gracePeriod=15 Jun 11 16:36:30.462599 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.462568 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:36:30.578678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578573 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.578678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578637 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.578678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578680 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.579005 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.579005 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578854 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.579005 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578882 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bctq6\" (UniqueName: \"kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.579005 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.578930 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle\") pod \"f88af4bc-1663-4267-903f-91d1161bf6ab\" (UID: \"f88af4bc-1663-4267-903f-91d1161bf6ab\") " Jun 11 16:36:30.579297 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.579157 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:30.579297 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.579166 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config" (OuterVolumeSpecName: "console-config") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:30.579474 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.579455 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:30.579474 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.579450 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:36:30.581267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.581237 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:30.581378 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.581299 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:36:30.581418 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.581401 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6" (OuterVolumeSpecName: "kube-api-access-bctq6") pod "f88af4bc-1663-4267-903f-91d1161bf6ab" (UID: "f88af4bc-1663-4267-903f-91d1161bf6ab"). InnerVolumeSpecName "kube-api-access-bctq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:36:30.680112 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680076 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-trusted-ca-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680112 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680109 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680112 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680118 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680112 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680127 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f88af4bc-1663-4267-903f-91d1161bf6ab-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680460 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680136 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680460 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680144 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f88af4bc-1663-4267-903f-91d1161bf6ab-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:30.680460 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:30.680154 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bctq6\" (UniqueName: \"kubernetes.io/projected/f88af4bc-1663-4267-903f-91d1161bf6ab-kube-api-access-bctq6\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:36:31.006719 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.006688 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:36:31.197719 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.197677 2554 generic.go:356] "Generic (PLEG): container finished" podID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerID="e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e" exitCode=0 Jun 11 16:36:31.197719 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.197721 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58b9b84db-cn5d6" Jun 11 16:36:31.198046 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.197792 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9b84db-cn5d6" event={"ID":"f88af4bc-1663-4267-903f-91d1161bf6ab","Type":"ContainerDied","Data":"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e"} Jun 11 16:36:31.198046 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.197838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58b9b84db-cn5d6" event={"ID":"f88af4bc-1663-4267-903f-91d1161bf6ab","Type":"ContainerDied","Data":"a24a63ea3dd56f28f775fe39653fb84d72bcf459ddc3355ab4066f85504de449"} Jun 11 16:36:31.198046 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.197859 2554 scope.go:117] "RemoveContainer" containerID="e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e" Jun 11 16:36:31.206013 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.205992 2554 scope.go:117] "RemoveContainer" containerID="e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e" Jun 11 16:36:31.206321 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:36:31.206299 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e\": container with ID starting with e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e not found: ID does not exist" containerID="e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e" Jun 11 16:36:31.206366 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.206331 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e"} err="failed to get container status \"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e\": rpc error: code = NotFound desc = could not find container \"e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e\": container with ID starting with e344becd1bfa1e77b5e493364988b9f18302fafc3a925ee524f02ca7c508b42e not found: ID does not exist" Jun 11 16:36:31.212602 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.212574 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:36:31.216880 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:31.216846 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58b9b84db-cn5d6"] Jun 11 16:36:32.168780 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.168726 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t2hfg" Jun 11 16:36:32.681718 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.681680 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-656c4fc79-mntwm"] Jun 11 16:36:32.682188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682101 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" Jun 11 16:36:32.682188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682120 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" Jun 11 16:36:32.682188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682159 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" Jun 11 16:36:32.682188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682167 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" Jun 11 16:36:32.682345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682230 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ef944c-51aa-497d-859c-4d1b4348256f" containerName="registry" Jun 11 16:36:32.682345 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.682240 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" containerName="console" Jun 11 16:36:32.686726 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.686708 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.689153 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689124 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5p5m8\"" Jun 11 16:36:32.689153 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689142 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 16:36:32.689383 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689166 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 16:36:32.689383 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689252 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 16:36:32.689498 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689419 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 16:36:32.689498 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.689473 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 16:36:32.694042 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.694020 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 16:36:32.695742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.695881 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-serving-certs-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.695881 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-federate-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.695982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.695982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.695982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695976 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v48r\" (UniqueName: \"kubernetes.io/projected/98efbfdd-3432-43a9-ae3a-a808532052a0-kube-api-access-8v48r\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.696103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.695997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-metrics-client-ca\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.696103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.696022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.697681 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.697660 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-656c4fc79-mntwm"] Jun 11 16:36:32.796462 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-serving-certs-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796462 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-federate-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v48r\" (UniqueName: \"kubernetes.io/projected/98efbfdd-3432-43a9-ae3a-a808532052a0-kube-api-access-8v48r\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-metrics-client-ca\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.796730 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.796618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.797354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.797266 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-serving-certs-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.797556 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.797537 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-metrics-client-ca\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.797989 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.797965 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.799256 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.799225 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-federate-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.799369 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.799349 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.799610 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.799588 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.799650 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.799598 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/98efbfdd-3432-43a9-ae3a-a808532052a0-telemeter-client-tls\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.804564 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.804543 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v48r\" (UniqueName: \"kubernetes.io/projected/98efbfdd-3432-43a9-ae3a-a808532052a0-kube-api-access-8v48r\") pod \"telemeter-client-656c4fc79-mntwm\" (UID: \"98efbfdd-3432-43a9-ae3a-a808532052a0\") " pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:32.997068 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:32.997027 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" Jun 11 16:36:33.066190 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:33.066152 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88af4bc-1663-4267-903f-91d1161bf6ab" path="/var/lib/kubelet/pods/f88af4bc-1663-4267-903f-91d1161bf6ab/volumes" Jun 11 16:36:33.135226 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:33.135187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-656c4fc79-mntwm"] Jun 11 16:36:33.138683 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:36:33.138644 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98efbfdd_3432_43a9_ae3a_a808532052a0.slice/crio-074aa765618acdba820c7fac69311cf4b112b6315dd3724f70a4c744ca84dcc6 WatchSource:0}: Error finding container 074aa765618acdba820c7fac69311cf4b112b6315dd3724f70a4c744ca84dcc6: Status 404 returned error can't find the container with id 074aa765618acdba820c7fac69311cf4b112b6315dd3724f70a4c744ca84dcc6 Jun 11 16:36:33.141036 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:33.141018 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:36:33.206877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:33.206838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" event={"ID":"98efbfdd-3432-43a9-ae3a-a808532052a0","Type":"ContainerStarted","Data":"074aa765618acdba820c7fac69311cf4b112b6315dd3724f70a4c744ca84dcc6"} Jun 11 16:36:36.220151 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:36.220115 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" event={"ID":"98efbfdd-3432-43a9-ae3a-a808532052a0","Type":"ContainerStarted","Data":"5ddd51b491afe3ad1f0821cb4a70a496c715dba5b6f04ac97c6228df87a96092"} Jun 11 16:36:37.226162 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:37.226125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" event={"ID":"98efbfdd-3432-43a9-ae3a-a808532052a0","Type":"ContainerStarted","Data":"dcee6a1ccf9970645f6a2d6ffd52729c7f6efc12b6305aa5512a78b3d9b7df66"} Jun 11 16:36:37.226563 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:37.226188 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" event={"ID":"98efbfdd-3432-43a9-ae3a-a808532052a0","Type":"ContainerStarted","Data":"189cface640b79f55841cd9cb58f454ce891f462780f0fc54e558d2d735f99f8"} Jun 11 16:36:37.247561 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:37.247509 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-656c4fc79-mntwm" podStartSLOduration=2.055078181 podStartE2EDuration="5.247491239s" totalImagesPullingTime="3.192413058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:37.247350229 +0000 UTC m=+306.655651685" watchObservedRunningTime="2026-06-11 16:36:37.247491239 +0000 UTC m=+306.655792692" Jun 11 16:36:38.110502 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.110466 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:36:38.113612 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.113593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.115836 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.115793 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:36:38.115836 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.115794 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:36:38.116072 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.115859 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:36:38.116072 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.115867 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:36:38.116072 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.115968 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:36:38.116645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.116628 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:36:38.116726 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.116665 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lbfkf\"" Jun 11 16:36:38.116802 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.116750 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:36:38.121277 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.121255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:36:38.130366 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.130333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:36:38.139023 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.138995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139072 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139108 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.139171 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.139160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpc6w\" (UniqueName: \"kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.239843 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.239812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.239856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpc6w\" (UniqueName: \"kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240289 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240341 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240320 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.240633 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.240586 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.241120 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.241096 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.241219 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.241148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.241421 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.241395 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.242797 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.242778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.242917 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.242898 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.249572 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.249541 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpc6w\" (UniqueName: \"kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w\") pod \"console-7c655d8558-dh4d4\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.425828 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.425711 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:38.562506 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:38.562460 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:36:38.565378 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:36:38.565347 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473ad8ad_c308_438b_9a96_d1e4d2af3469.slice/crio-758d753fe4ad9d1be5d17e2234aed7371aafc9863f471729d4e7cfa7030bc90a WatchSource:0}: Error finding container 758d753fe4ad9d1be5d17e2234aed7371aafc9863f471729d4e7cfa7030bc90a: Status 404 returned error can't find the container with id 758d753fe4ad9d1be5d17e2234aed7371aafc9863f471729d4e7cfa7030bc90a Jun 11 16:36:39.235912 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:39.235877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c655d8558-dh4d4" event={"ID":"473ad8ad-c308-438b-9a96-d1e4d2af3469","Type":"ContainerStarted","Data":"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda"} Jun 11 16:36:39.236092 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:39.235927 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c655d8558-dh4d4" event={"ID":"473ad8ad-c308-438b-9a96-d1e4d2af3469","Type":"ContainerStarted","Data":"758d753fe4ad9d1be5d17e2234aed7371aafc9863f471729d4e7cfa7030bc90a"} Jun 11 16:36:39.254104 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:39.254041 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c655d8558-dh4d4" podStartSLOduration=1.254024526 podStartE2EDuration="1.254024526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:36:39.252552914 +0000 UTC m=+308.660854371" watchObservedRunningTime="2026-06-11 16:36:39.254024526 +0000 UTC m=+308.662326060" Jun 11 16:36:48.426062 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:48.425998 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:48.426062 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:48.426080 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:48.431090 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:48.431065 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:36:49.277020 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:36:49.276992 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:38:00.134578 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:00.134539 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:38:25.162240 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.162183 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c655d8558-dh4d4" podUID="473ad8ad-c308-438b-9a96-d1e4d2af3469" containerName="console" containerID="cri-o://01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda" gracePeriod=15 Jun 11 16:38:25.417057 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.417001 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:38:25.426651 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426630 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426747 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426671 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426747 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426695 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426747 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426718 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426896 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426744 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426896 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426822 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpc6w\" (UniqueName: \"kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.426896 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.426852 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca\") pod \"473ad8ad-c308-438b-9a96-d1e4d2af3469\" (UID: \"473ad8ad-c308-438b-9a96-d1e4d2af3469\") " Jun 11 16:38:25.427111 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.427063 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:25.427197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.427148 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-trusted-ca-bundle\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.427197 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.427177 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config" (OuterVolumeSpecName: "console-config") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:25.427350 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.427320 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:25.427411 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.427351 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca" (OuterVolumeSpecName: "service-ca") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:38:25.428749 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.428725 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:38:25.428945 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.428920 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w" (OuterVolumeSpecName: "kube-api-access-hpc6w") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "kube-api-access-hpc6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:38:25.429008 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.428971 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "473ad8ad-c308-438b-9a96-d1e4d2af3469" (UID: "473ad8ad-c308-438b-9a96-d1e4d2af3469"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:38:25.527998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.527956 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.527998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.527990 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-oauth-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.527998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.528000 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-serving-cert\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.527998 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.528009 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpc6w\" (UniqueName: \"kubernetes.io/projected/473ad8ad-c308-438b-9a96-d1e4d2af3469-kube-api-access-hpc6w\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.528280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.528019 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/473ad8ad-c308-438b-9a96-d1e4d2af3469-service-ca\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.528280 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.528027 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/473ad8ad-c308-438b-9a96-d1e4d2af3469-console-oauth-config\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:38:25.636496 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.636456 2554 generic.go:356] "Generic (PLEG): container finished" podID="473ad8ad-c308-438b-9a96-d1e4d2af3469" containerID="01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda" exitCode=0 Jun 11 16:38:25.636664 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.636504 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c655d8558-dh4d4" event={"ID":"473ad8ad-c308-438b-9a96-d1e4d2af3469","Type":"ContainerDied","Data":"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda"} Jun 11 16:38:25.636664 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.636508 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c655d8558-dh4d4" Jun 11 16:38:25.636664 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.636542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c655d8558-dh4d4" event={"ID":"473ad8ad-c308-438b-9a96-d1e4d2af3469","Type":"ContainerDied","Data":"758d753fe4ad9d1be5d17e2234aed7371aafc9863f471729d4e7cfa7030bc90a"} Jun 11 16:38:25.636664 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.636563 2554 scope.go:117] "RemoveContainer" containerID="01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda" Jun 11 16:38:25.645249 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.645222 2554 scope.go:117] "RemoveContainer" containerID="01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda" Jun 11 16:38:25.645523 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:38:25.645503 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda\": container with ID starting with 01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda not found: ID does not exist" containerID="01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda" Jun 11 16:38:25.645586 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.645532 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda"} err="failed to get container status \"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda\": rpc error: code = NotFound desc = could not find container \"01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda\": container with ID starting with 01420ffab9cac4f3c975433c9e84b1087a363f8422f75418baaf8ea201719bda not found: ID does not exist" Jun 11 16:38:25.657333 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.657300 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:38:25.658842 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:25.658819 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c655d8558-dh4d4"] Jun 11 16:38:27.062975 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:38:27.062941 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="473ad8ad-c308-438b-9a96-d1e4d2af3469" path="/var/lib/kubelet/pods/473ad8ad-c308-438b-9a96-d1e4d2af3469/volumes" Jun 11 16:39:35.032731 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.032689 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2"] Jun 11 16:39:35.033217 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.032983 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473ad8ad-c308-438b-9a96-d1e4d2af3469" containerName="console" Jun 11 16:39:35.033217 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.032994 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="473ad8ad-c308-438b-9a96-d1e4d2af3469" containerName="console" Jun 11 16:39:35.033217 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.033054 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="473ad8ad-c308-438b-9a96-d1e4d2af3469" containerName="console" Jun 11 16:39:35.035858 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.035841 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.037914 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.037894 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fqllq\"" Jun 11 16:39:35.037914 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.037901 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:39:35.038548 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.038532 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:39:35.045529 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.045501 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2"] Jun 11 16:39:35.178069 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.178032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswtj\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-kube-api-access-qswtj\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.178244 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.178078 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.279051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.279019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qswtj\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-kube-api-access-qswtj\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.279178 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.279063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.286611 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.286535 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.286732 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.286626 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswtj\" (UniqueName: \"kubernetes.io/projected/2ef785de-39a8-4e8a-9a45-e2bcdfec26b3-kube-api-access-qswtj\") pod \"cert-manager-webhook-7dc76cbb94-hh9d2\" (UID: \"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.360438 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.360402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:35.492407 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.492371 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2"] Jun 11 16:39:35.495769 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:39:35.495736 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ef785de_39a8_4e8a_9a45_e2bcdfec26b3.slice/crio-8d9b75e085ba7313171070b525ec253d370ab00a1ca2f3de01a0c6c38669e6eb WatchSource:0}: Error finding container 8d9b75e085ba7313171070b525ec253d370ab00a1ca2f3de01a0c6c38669e6eb: Status 404 returned error can't find the container with id 8d9b75e085ba7313171070b525ec253d370ab00a1ca2f3de01a0c6c38669e6eb Jun 11 16:39:35.901287 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:35.901249 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" event={"ID":"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3","Type":"ContainerStarted","Data":"8d9b75e085ba7313171070b525ec253d370ab00a1ca2f3de01a0c6c38669e6eb"} Jun 11 16:39:38.915877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:38.915783 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" event={"ID":"2ef785de-39a8-4e8a-9a45-e2bcdfec26b3","Type":"ContainerStarted","Data":"eb079e473d128097adc7f154e8d7d10265fe4ff5ca674c40f32cfe2461ba6eb9"} Jun 11 16:39:38.915877 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:38.915842 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:38.933071 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:38.933014 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" podStartSLOduration=0.902848179 podStartE2EDuration="3.932997599s" totalImagesPullingTime="3.03014942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:38.932381492 +0000 UTC m=+488.340682975" watchObservedRunningTime="2026-06-11 16:39:38.932997599 +0000 UTC m=+488.341299054" Jun 11 16:39:44.922271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:44.922239 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hh9d2" Jun 11 16:39:47.500071 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.500025 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2b4w6"] Jun 11 16:39:47.503159 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.503140 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.505267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.505249 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pz284\"" Jun 11 16:39:47.514662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.514635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2b4w6"] Jun 11 16:39:47.564518 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.564481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n4l6\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-kube-api-access-9n4l6\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.564693 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.564538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-bound-sa-token\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.665302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.665264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n4l6\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-kube-api-access-9n4l6\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.665509 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.665323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-bound-sa-token\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.675361 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.675335 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-bound-sa-token\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.675574 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.675555 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n4l6\" (UniqueName: \"kubernetes.io/projected/89b82caf-ac1b-4fe1-b8c1-054ea07eec32-kube-api-access-9n4l6\") pod \"cert-manager-59c77684cc-2b4w6\" (UID: \"89b82caf-ac1b-4fe1-b8c1-054ea07eec32\") " pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.811726 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.811635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2b4w6" Jun 11 16:39:47.942344 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.942322 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2b4w6"] Jun 11 16:39:47.944798 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:39:47.944771 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89b82caf_ac1b_4fe1_b8c1_054ea07eec32.slice/crio-6258f57494309bd8950940e6c8b9f591d976d66136435cfc5fb65e18c3ed5bb1 WatchSource:0}: Error finding container 6258f57494309bd8950940e6c8b9f591d976d66136435cfc5fb65e18c3ed5bb1: Status 404 returned error can't find the container with id 6258f57494309bd8950940e6c8b9f591d976d66136435cfc5fb65e18c3ed5bb1 Jun 11 16:39:47.952442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:47.952413 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2b4w6" event={"ID":"89b82caf-ac1b-4fe1-b8c1-054ea07eec32","Type":"ContainerStarted","Data":"6258f57494309bd8950940e6c8b9f591d976d66136435cfc5fb65e18c3ed5bb1"} Jun 11 16:39:48.957582 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:48.957543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2b4w6" event={"ID":"89b82caf-ac1b-4fe1-b8c1-054ea07eec32","Type":"ContainerStarted","Data":"381a0298168bce1f498a50d0ddfbe2dad9dd5adfbb5c7c9002aa15fe6a5455e8"} Jun 11 16:39:48.972945 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:39:48.972895 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2b4w6" podStartSLOduration=1.9728791270000001 podStartE2EDuration="1.972879127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:39:48.971658618 +0000 UTC m=+498.379960075" watchObservedRunningTime="2026-06-11 16:39:48.972879127 +0000 UTC m=+498.381180582" Jun 11 16:40:10.165456 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.165420 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg"] Jun 11 16:40:10.169095 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.169074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.173007 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.172982 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:40:10.173190 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.173172 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:40:10.173416 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.173399 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:40:10.173728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.173712 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrc8l\"" Jun 11 16:40:10.173728 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.173721 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:40:10.190372 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.190334 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg"] Jun 11 16:40:10.233157 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.233120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.233337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.233191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.233337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.233223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.233337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.233240 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.233337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.233256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24zn\" (UniqueName: \"kubernetes.io/projected/c24b77dc-0e42-4641-902f-998a70dde150-kube-api-access-w24zn\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.334665 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.334621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.334878 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.334696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.334878 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.334733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.334878 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.334769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.334878 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.334796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w24zn\" (UniqueName: \"kubernetes.io/projected/c24b77dc-0e42-4641-902f-998a70dde150-kube-api-access-w24zn\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.335130 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.335095 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-manifests\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.337279 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.337244 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c24b77dc-0e42-4641-902f-998a70dde150-tmp\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.337279 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.337278 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.337537 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.337369 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c24b77dc-0e42-4641-902f-998a70dde150-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.346295 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.346259 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24zn\" (UniqueName: \"kubernetes.io/projected/c24b77dc-0e42-4641-902f-998a70dde150-kube-api-access-w24zn\") pod \"opendatahub-operator-controller-manager-74d99d69cd-sh6fg\" (UID: \"c24b77dc-0e42-4641-902f-998a70dde150\") " pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.479907 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.479874 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:10.630215 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:10.630180 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg"] Jun 11 16:40:10.633466 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:10.633441 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24b77dc_0e42_4641_902f_998a70dde150.slice/crio-176ae1431b388a47e9331645743af89708c527443dd2ded957f7e58b3d69ecdf WatchSource:0}: Error finding container 176ae1431b388a47e9331645743af89708c527443dd2ded957f7e58b3d69ecdf: Status 404 returned error can't find the container with id 176ae1431b388a47e9331645743af89708c527443dd2ded957f7e58b3d69ecdf Jun 11 16:40:11.043366 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:11.043330 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" event={"ID":"c24b77dc-0e42-4641-902f-998a70dde150","Type":"ContainerStarted","Data":"176ae1431b388a47e9331645743af89708c527443dd2ded957f7e58b3d69ecdf"} Jun 11 16:40:14.058037 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:14.058000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" event={"ID":"c24b77dc-0e42-4641-902f-998a70dde150","Type":"ContainerStarted","Data":"2fde71bce0c8bb677efbd8f3027a38b1c8820302776b3c15bfdf68f658e2a629"} Jun 11 16:40:15.063783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:15.063677 2554 generic.go:356] "Generic (PLEG): container finished" podID="c24b77dc-0e42-4641-902f-998a70dde150" containerID="2fde71bce0c8bb677efbd8f3027a38b1c8820302776b3c15bfdf68f658e2a629" exitCode=0 Jun 11 16:40:15.063783 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:15.063744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" event={"ID":"c24b77dc-0e42-4641-902f-998a70dde150","Type":"ContainerDied","Data":"2fde71bce0c8bb677efbd8f3027a38b1c8820302776b3c15bfdf68f658e2a629"} Jun 11 16:40:16.071168 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:16.071134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" event={"ID":"c24b77dc-0e42-4641-902f-998a70dde150","Type":"ContainerStarted","Data":"0b8893e02b352aec78858c6983ac3032681235f55859668a03ed2ab7c45f211d"} Jun 11 16:40:16.071741 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:16.071210 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:16.094595 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:16.094531 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" podStartSLOduration=1.7032894299999999 podStartE2EDuration="6.094507575s" totalImagesPullingTime="3.349330253s" totalInitContainerRuntime="1.041887892s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:16.093118258 +0000 UTC m=+525.501419715" watchObservedRunningTime="2026-06-11 16:40:16.094507575 +0000 UTC m=+525.502809034" Jun 11 16:40:27.077896 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:27.077868 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74d99d69cd-sh6fg" Jun 11 16:40:29.683664 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.683628 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc"] Jun 11 16:40:29.688325 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.688299 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.691645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.691593 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 16:40:29.691645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.691593 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:40:29.692384 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.692359 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qtr68\"" Jun 11 16:40:29.701035 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.701006 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc"] Jun 11 16:40:29.803807 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.803771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9tc\" (UniqueName: \"kubernetes.io/projected/b4b89d40-965c-4270-88a6-f6939bd8060e-kube-api-access-gf9tc\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.803982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.803847 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b89d40-965c-4270-88a6-f6939bd8060e-tmp\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.803982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.803938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.881920 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.881885 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xbh5l"] Jun 11 16:40:29.884013 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.883996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:29.886398 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.886367 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l588j\"" Jun 11 16:40:29.886513 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.886405 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 16:40:29.893889 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.893860 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xbh5l"] Jun 11 16:40:29.904379 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.904343 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9tc\" (UniqueName: \"kubernetes.io/projected/b4b89d40-965c-4270-88a6-f6939bd8060e-kube-api-access-gf9tc\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.904552 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.904388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b89d40-965c-4270-88a6-f6939bd8060e-tmp\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.904552 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.904426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.904552 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:29.904529 2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 16:40:29.904713 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:29.904626 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs podName:b4b89d40-965c-4270-88a6-f6939bd8060e nodeName:}" failed. No retries permitted until 2026-06-11 16:40:30.404603362 +0000 UTC m=+539.812904799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs") pod "kube-auth-proxy-75ffc6ddf8-z8jdc" (UID: "b4b89d40-965c-4270-88a6-f6939bd8060e") : secret "kube-auth-proxy-tls" not found Jun 11 16:40:29.906830 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.906803 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4b89d40-965c-4270-88a6-f6939bd8060e-tmp\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:29.916286 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:29.916253 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9tc\" (UniqueName: \"kubernetes.io/projected/b4b89d40-965c-4270-88a6-f6939bd8060e-kube-api-access-gf9tc\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:30.005151 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.005106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.005368 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.005161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlk9f\" (UniqueName: \"kubernetes.io/projected/795ea9e1-df0d-42eb-9a62-1f780287e052-kube-api-access-nlk9f\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.106619 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.106570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.106835 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:30.106700 2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 16:40:30.106835 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.106697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlk9f\" (UniqueName: \"kubernetes.io/projected/795ea9e1-df0d-42eb-9a62-1f780287e052-kube-api-access-nlk9f\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.106835 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:30.106792 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert podName:795ea9e1-df0d-42eb-9a62-1f780287e052 nodeName:}" failed. No retries permitted until 2026-06-11 16:40:30.606747198 +0000 UTC m=+540.015048635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert") pod "odh-model-controller-6dc94f689f-xbh5l" (UID: "795ea9e1-df0d-42eb-9a62-1f780287e052") : secret "odh-model-controller-webhook-cert" not found Jun 11 16:40:30.115570 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.115536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlk9f\" (UniqueName: \"kubernetes.io/projected/795ea9e1-df0d-42eb-9a62-1f780287e052-kube-api-access-nlk9f\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.410443 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.410336 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:30.412838 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.412811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b89d40-965c-4270-88a6-f6939bd8060e-tls-certs\") pod \"kube-auth-proxy-75ffc6ddf8-z8jdc\" (UID: \"b4b89d40-965c-4270-88a6-f6939bd8060e\") " pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:30.475019 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.474981 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2gwrh"] Jun 11 16:40:30.477824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.477807 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.480251 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.480231 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 16:40:30.493610 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.493580 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2gwrh"] Jun 11 16:40:30.601177 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.601115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" Jun 11 16:40:30.612678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.612644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.612839 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.612813 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbr4\" (UniqueName: \"kubernetes.io/projected/8d21e02c-6d60-43ff-bbdb-857362dda0cd-kube-api-access-pnbr4\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.612903 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.612857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.615434 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.615406 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/795ea9e1-df0d-42eb-9a62-1f780287e052-cert\") pod \"odh-model-controller-6dc94f689f-xbh5l\" (UID: \"795ea9e1-df0d-42eb-9a62-1f780287e052\") " pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.714396 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.714356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbr4\" (UniqueName: \"kubernetes.io/projected/8d21e02c-6d60-43ff-bbdb-857362dda0cd-kube-api-access-pnbr4\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.714862 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.714422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.714862 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:30.714600 2554 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 16:40:30.714862 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:30.714673 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs podName:8d21e02c-6d60-43ff-bbdb-857362dda0cd nodeName:}" failed. No retries permitted until 2026-06-11 16:40:31.214653332 +0000 UTC m=+540.622954768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs") pod "model-serving-api-5dd488fc48-2gwrh" (UID: "8d21e02c-6d60-43ff-bbdb-857362dda0cd") : secret "model-serving-api-tls" not found Jun 11 16:40:30.743927 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.743891 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbr4\" (UniqueName: \"kubernetes.io/projected/8d21e02c-6d60-43ff-bbdb-857362dda0cd-kube-api-access-pnbr4\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:30.752501 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.752474 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc"] Jun 11 16:40:30.755305 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:30.755275 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b89d40_965c_4270_88a6_f6939bd8060e.slice/crio-258b13c3f4ed62deb0d353f4f1381e63bc06add9fc2999c58c939a8fb344b1c0 WatchSource:0}: Error finding container 258b13c3f4ed62deb0d353f4f1381e63bc06add9fc2999c58c939a8fb344b1c0: Status 404 returned error can't find the container with id 258b13c3f4ed62deb0d353f4f1381e63bc06add9fc2999c58c939a8fb344b1c0 Jun 11 16:40:30.794916 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.794880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:30.936151 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:30.936118 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-xbh5l"] Jun 11 16:40:30.939688 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:30.939650 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795ea9e1_df0d_42eb_9a62_1f780287e052.slice/crio-8682f2c1ac396ad380883965b8e7370c6028d698462a8a36e2289e98e3222c68 WatchSource:0}: Error finding container 8682f2c1ac396ad380883965b8e7370c6028d698462a8a36e2289e98e3222c68: Status 404 returned error can't find the container with id 8682f2c1ac396ad380883965b8e7370c6028d698462a8a36e2289e98e3222c68 Jun 11 16:40:31.137206 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.137160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" event={"ID":"b4b89d40-965c-4270-88a6-f6939bd8060e","Type":"ContainerStarted","Data":"258b13c3f4ed62deb0d353f4f1381e63bc06add9fc2999c58c939a8fb344b1c0"} Jun 11 16:40:31.138491 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.138465 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" event={"ID":"795ea9e1-df0d-42eb-9a62-1f780287e052","Type":"ContainerStarted","Data":"8682f2c1ac396ad380883965b8e7370c6028d698462a8a36e2289e98e3222c68"} Jun 11 16:40:31.219633 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.219532 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:31.222053 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.222027 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d21e02c-6d60-43ff-bbdb-857362dda0cd-tls-certs\") pod \"model-serving-api-5dd488fc48-2gwrh\" (UID: \"8d21e02c-6d60-43ff-bbdb-857362dda0cd\") " pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:31.388770 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.388709 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:31.568297 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:31.568271 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2gwrh"] Jun 11 16:40:31.570810 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:31.570775 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d21e02c_6d60_43ff_bbdb_857362dda0cd.slice/crio-cfeb3726109dc880d0195fb533fb021bc4e6f05dcf81a0212651705cca80e6d9 WatchSource:0}: Error finding container cfeb3726109dc880d0195fb533fb021bc4e6f05dcf81a0212651705cca80e6d9: Status 404 returned error can't find the container with id cfeb3726109dc880d0195fb533fb021bc4e6f05dcf81a0212651705cca80e6d9 Jun 11 16:40:32.153999 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:32.153962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" event={"ID":"8d21e02c-6d60-43ff-bbdb-857362dda0cd","Type":"ContainerStarted","Data":"cfeb3726109dc880d0195fb533fb021bc4e6f05dcf81a0212651705cca80e6d9"} Jun 11 16:40:36.327247 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:36.327225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:40:37.189034 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.188990 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" event={"ID":"795ea9e1-df0d-42eb-9a62-1f780287e052","Type":"ContainerStarted","Data":"d3d3eab8298a18a20de7433fe9390f148748e697e5a20477cdb34815e578f7ba"} Jun 11 16:40:37.189209 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.189072 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:37.190592 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.190560 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" event={"ID":"8d21e02c-6d60-43ff-bbdb-857362dda0cd","Type":"ContainerStarted","Data":"8f02ba08f11c76100fe22553945d1e8f0729a7f3821720309e85d069b9865c3d"} Jun 11 16:40:37.190724 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.190696 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:37.191954 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.191929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" event={"ID":"b4b89d40-965c-4270-88a6-f6939bd8060e","Type":"ContainerStarted","Data":"b2b31f9b6464ea702279ce2cb74137e7e57b3512ae42543034da49fb4fb59f5e"} Jun 11 16:40:37.205575 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.205518 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" podStartSLOduration=2.785441426 podStartE2EDuration="8.205498064s" totalImagesPullingTime="5.420056638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:37.204230786 +0000 UTC m=+546.612532243" watchObservedRunningTime="2026-06-11 16:40:37.205498064 +0000 UTC m=+546.613799520" Jun 11 16:40:37.220982 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.220921 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75ffc6ddf8-z8jdc" podStartSLOduration=2.653006207 podStartE2EDuration="8.220901487s" totalImagesPullingTime="5.56789528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:37.219726498 +0000 UTC m=+546.628027956" watchObservedRunningTime="2026-06-11 16:40:37.220901487 +0000 UTC m=+546.629202943" Jun 11 16:40:37.236641 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:37.236577 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" podStartSLOduration=2.490151746 podStartE2EDuration="7.236556243s" totalImagesPullingTime="4.746404497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:37.235386002 +0000 UTC m=+546.643687472" watchObservedRunningTime="2026-06-11 16:40:37.236556243 +0000 UTC m=+546.644857701" Jun 11 16:40:41.582269 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.582220 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z65ht"] Jun 11 16:40:41.585320 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.585296 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.587860 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.587836 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 16:40:41.588020 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.587946 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6wg9f\"" Jun 11 16:40:41.608176 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.608134 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj"] Jun 11 16:40:41.611687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.611658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z65ht"] Jun 11 16:40:41.611853 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.611774 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.615052 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.615022 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 16:40:41.615192 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.615140 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pkmbm\"" Jun 11 16:40:41.624613 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.624584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj"] Jun 11 16:40:41.720042 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.720005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.720271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.720074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7lcd\" (UniqueName: \"kubernetes.io/projected/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-kube-api-access-q7lcd\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.720271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.720181 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/b353e9e5-ac8e-4d88-9131-043a7ed6f834-kube-api-access-8tl9c\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.720271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.720225 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.821397 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.821360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/b353e9e5-ac8e-4d88-9131-043a7ed6f834-kube-api-access-8tl9c\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.821397 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.821404 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.821661 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.821428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.821661 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.821479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7lcd\" (UniqueName: \"kubernetes.io/projected/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-kube-api-access-q7lcd\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.821661 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:41.821579 2554 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 11 16:40:41.821661 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:40:41.821645 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert podName:b353e9e5-ac8e-4d88-9131-043a7ed6f834 nodeName:}" failed. No retries permitted until 2026-06-11 16:40:42.321628615 +0000 UTC m=+551.729930053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert") pod "kserve-controller-manager-69fc866d76-z65ht" (UID: "b353e9e5-ac8e-4d88-9131-043a7ed6f834") : secret "kserve-webhook-server-cert" not found Jun 11 16:40:41.824145 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.824119 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.834224 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.834160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tl9c\" (UniqueName: \"kubernetes.io/projected/b353e9e5-ac8e-4d88-9131-043a7ed6f834-kube-api-access-8tl9c\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:41.837113 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.837084 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7lcd\" (UniqueName: \"kubernetes.io/projected/21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d-kube-api-access-q7lcd\") pod \"llmisvc-controller-manager-864bfd7bc9-5s5qj\" (UID: \"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:41.922242 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:41.922197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:42.096046 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.096021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj"] Jun 11 16:40:42.098037 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:42.098008 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod21bda0e3_c8f5_4505_a2d0_e9c6d11d5f8d.slice/crio-b7d8c824a69b33210c3cdd58cf6e2d704b5acab57a0a04c5f1d118cfa7384553 WatchSource:0}: Error finding container b7d8c824a69b33210c3cdd58cf6e2d704b5acab57a0a04c5f1d118cfa7384553: Status 404 returned error can't find the container with id b7d8c824a69b33210c3cdd58cf6e2d704b5acab57a0a04c5f1d118cfa7384553 Jun 11 16:40:42.216902 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.216868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" event={"ID":"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d","Type":"ContainerStarted","Data":"b7d8c824a69b33210c3cdd58cf6e2d704b5acab57a0a04c5f1d118cfa7384553"} Jun 11 16:40:42.326601 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.326573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:42.328970 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.328946 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b353e9e5-ac8e-4d88-9131-043a7ed6f834-cert\") pod \"kserve-controller-manager-69fc866d76-z65ht\" (UID: \"b353e9e5-ac8e-4d88-9131-043a7ed6f834\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:42.496208 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.496174 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:42.654617 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:42.654591 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z65ht"] Jun 11 16:40:42.688266 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:42.688225 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb353e9e5_ac8e_4d88_9131_043a7ed6f834.slice/crio-20774d930c1030e525579b20e52c3a48387c9f50be5865a5151ba09e92275302 WatchSource:0}: Error finding container 20774d930c1030e525579b20e52c3a48387c9f50be5865a5151ba09e92275302: Status 404 returned error can't find the container with id 20774d930c1030e525579b20e52c3a48387c9f50be5865a5151ba09e92275302 Jun 11 16:40:43.224057 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:43.224019 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" event={"ID":"b353e9e5-ac8e-4d88-9131-043a7ed6f834","Type":"ContainerStarted","Data":"20774d930c1030e525579b20e52c3a48387c9f50be5865a5151ba09e92275302"} Jun 11 16:40:46.248385 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.248344 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" event={"ID":"b353e9e5-ac8e-4d88-9131-043a7ed6f834","Type":"ContainerStarted","Data":"95db725525b4371a1a57a1e91e563e248546a0be2628f55951311181a2b1d981"} Jun 11 16:40:46.248861 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.248548 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:40:46.250302 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.250276 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" event={"ID":"21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d","Type":"ContainerStarted","Data":"4c264af4b0376f6426d4eed5abab4e70f793dba3554ae131c0363614fbf1b5f8"} Jun 11 16:40:46.250419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.250331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:40:46.276980 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.276924 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" podStartSLOduration=2.044210669 podStartE2EDuration="5.276906312s" totalImagesPullingTime="3.232695643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:46.276127268 +0000 UTC m=+555.684428725" watchObservedRunningTime="2026-06-11 16:40:46.276906312 +0000 UTC m=+555.685207768" Jun 11 16:40:46.312290 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.312232 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" podStartSLOduration=1.484286522 podStartE2EDuration="5.312211025s" totalImagesPullingTime="3.827924503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:46.309486799 +0000 UTC m=+555.717788255" watchObservedRunningTime="2026-06-11 16:40:46.312211025 +0000 UTC m=+555.720512480" Jun 11 16:40:46.709573 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.709539 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr"] Jun 11 16:40:46.713118 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.713093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.715294 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.715273 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 16:40:46.715857 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.715833 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-66n54\"" Jun 11 16:40:46.715967 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.715884 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 16:40:46.728517 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.728484 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr"] Jun 11 16:40:46.769565 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.769530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmhqf\" (UniqueName: \"kubernetes.io/projected/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-kube-api-access-bmhqf\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.769565 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.769575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.870630 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.870590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.870827 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.870676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmhqf\" (UniqueName: \"kubernetes.io/projected/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-kube-api-access-bmhqf\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.873295 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.873276 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:46.878901 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:46.878872 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmhqf\" (UniqueName: \"kubernetes.io/projected/5572c349-fc1e-4b6e-8ff2-e80e8142e6f3-kube-api-access-bmhqf\") pod \"servicemesh-operator3-57f65f65fb-kgnmr\" (UID: \"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:47.022097 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:47.021999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:47.183999 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:47.183975 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr"] Jun 11 16:40:47.186916 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:40:47.186873 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5572c349_fc1e_4b6e_8ff2_e80e8142e6f3.slice/crio-db2ce1ae0c59654173b72da68bc3375917162b606d015627f4d624e398c17fa0 WatchSource:0}: Error finding container db2ce1ae0c59654173b72da68bc3375917162b606d015627f4d624e398c17fa0: Status 404 returned error can't find the container with id db2ce1ae0c59654173b72da68bc3375917162b606d015627f4d624e398c17fa0 Jun 11 16:40:47.257006 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:47.256972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" event={"ID":"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3","Type":"ContainerStarted","Data":"db2ce1ae0c59654173b72da68bc3375917162b606d015627f4d624e398c17fa0"} Jun 11 16:40:48.199215 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:48.199184 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-xbh5l" Jun 11 16:40:48.202821 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:48.202728 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-2gwrh" Jun 11 16:40:50.275788 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:50.275733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" event={"ID":"5572c349-fc1e-4b6e-8ff2-e80e8142e6f3","Type":"ContainerStarted","Data":"346476e6604b536ae56c9da4581394a14538184ee2bfcaa1a16df1af5fe1a439"} Jun 11 16:40:50.276183 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:50.275824 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:40:50.298592 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:50.298535 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" podStartSLOduration=1.8051142150000001 podStartE2EDuration="4.298516326s" totalImagesPullingTime="2.493402111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:40:50.297616865 +0000 UTC m=+559.705918349" watchObservedRunningTime="2026-06-11 16:40:50.298516326 +0000 UTC m=+559.706817783" Jun 11 16:40:59.962116 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:59.962076 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-vmxmn"] Jun 11 16:40:59.965722 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:59.965698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:40:59.968346 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:59.968321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fq5pd\"" Jun 11 16:40:59.968492 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:59.968322 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:40:59.973585 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:40:59.973077 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-vmxmn"] Jun 11 16:41:00.087672 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.087626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj86m\" (UniqueName: \"kubernetes.io/projected/b6de4406-482e-4ef1-964f-2ebbf0f02f12-kube-api-access-dj86m\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.087901 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.087725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b6de4406-482e-4ef1-964f-2ebbf0f02f12-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.188343 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.188292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj86m\" (UniqueName: \"kubernetes.io/projected/b6de4406-482e-4ef1-964f-2ebbf0f02f12-kube-api-access-dj86m\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.188549 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.188488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b6de4406-482e-4ef1-964f-2ebbf0f02f12-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.189238 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.189212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b6de4406-482e-4ef1-964f-2ebbf0f02f12-redirect-config\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.197182 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.197140 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj86m\" (UniqueName: \"kubernetes.io/projected/b6de4406-482e-4ef1-964f-2ebbf0f02f12-kube-api-access-dj86m\") pod \"dashboard-redirect-79b7c87c7f-vmxmn\" (UID: \"b6de4406-482e-4ef1-964f-2ebbf0f02f12\") " pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.277784 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.277666 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" Jun 11 16:41:00.414641 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:00.414615 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-79b7c87c7f-vmxmn"] Jun 11 16:41:00.417873 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:41:00.417840 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6de4406_482e_4ef1_964f_2ebbf0f02f12.slice/crio-29b4fd24d90f67bdb286dcbf26e2ccac32b192bf2a27f2af8400f69b514459c9 WatchSource:0}: Error finding container 29b4fd24d90f67bdb286dcbf26e2ccac32b192bf2a27f2af8400f69b514459c9: Status 404 returned error can't find the container with id 29b4fd24d90f67bdb286dcbf26e2ccac32b192bf2a27f2af8400f69b514459c9 Jun 11 16:41:01.282306 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:01.282277 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kgnmr" Jun 11 16:41:01.330066 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:01.330028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" event={"ID":"b6de4406-482e-4ef1-964f-2ebbf0f02f12","Type":"ContainerStarted","Data":"29b4fd24d90f67bdb286dcbf26e2ccac32b192bf2a27f2af8400f69b514459c9"} Jun 11 16:41:06.363820 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:06.363777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" event={"ID":"b6de4406-482e-4ef1-964f-2ebbf0f02f12","Type":"ContainerStarted","Data":"a96993fda1b15c8b601cc16d4d7105ec0b66dc59df982bcc7df0e2b095cacf78"} Jun 11 16:41:06.378693 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:06.378641 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-79b7c87c7f-vmxmn" podStartSLOduration=2.39964382 podStartE2EDuration="7.378622281s" totalImagesPullingTime="4.978978461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:06.377608605 +0000 UTC m=+575.785910063" watchObservedRunningTime="2026-06-11 16:41:06.378622281 +0000 UTC m=+575.786923738" Jun 11 16:41:14.674517 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.674480 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5"] Jun 11 16:41:14.677700 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.677678 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.679894 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.679851 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 16:41:14.680028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.679894 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 16:41:14.680028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.679865 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-25fws\"" Jun 11 16:41:14.680028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.679851 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 16:41:14.680028 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.680004 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:41:14.689346 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.689320 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5"] Jun 11 16:41:14.830224 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ca3635-3893-45ce-a2de-c493c8039e3f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830319 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nsx\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-kube-api-access-b9nsx\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.830430 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.830372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931375 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931375 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ca3635-3893-45ce-a2de-c493c8039e3f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931375 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nsx\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-kube-api-access-b9nsx\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.931662 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.931464 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.932190 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.932160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.933964 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.933937 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.934148 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.934127 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ca3635-3893-45ce-a2de-c493c8039e3f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.934231 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.934195 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.934286 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.934273 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.939271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.939245 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nsx\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-kube-api-access-b9nsx\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.939393 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.939280 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ca3635-3893-45ce-a2de-c493c8039e3f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65br5\" (UID: \"29ca3635-3893-45ce-a2de-c493c8039e3f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:14.988353 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:14.988310 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:15.131695 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:15.131657 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5"] Jun 11 16:41:15.135639 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:41:15.135604 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ca3635_3893_45ce_a2de_c493c8039e3f.slice/crio-e0627c82874216c6cfae5e5498138c53365c9ac544fe7f507bca1f0035c0d520 WatchSource:0}: Error finding container e0627c82874216c6cfae5e5498138c53365c9ac544fe7f507bca1f0035c0d520: Status 404 returned error can't find the container with id e0627c82874216c6cfae5e5498138c53365c9ac544fe7f507bca1f0035c0d520 Jun 11 16:41:15.408721 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:15.408684 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" event={"ID":"29ca3635-3893-45ce-a2de-c493c8039e3f","Type":"ContainerStarted","Data":"e0627c82874216c6cfae5e5498138c53365c9ac544fe7f507bca1f0035c0d520"} Jun 11 16:41:17.259744 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:17.259702 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5s5qj" Jun 11 16:41:17.262921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:17.262893 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z65ht" Jun 11 16:41:17.443748 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:17.443708 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 16:41:17.443862 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:17.443804 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 16:41:18.426095 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:18.426058 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" event={"ID":"29ca3635-3893-45ce-a2de-c493c8039e3f","Type":"ContainerStarted","Data":"20fc47135d2fb047458b93066ba5da6e924390c716d72dca52b1b55bf9e95181"} Jun 11 16:41:18.426579 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:18.426273 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:41:18.428214 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:18.428179 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-65br5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 16:41:18.428355 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:18.428236 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" podUID="29ca3635-3893-45ce-a2de-c493c8039e3f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:41:18.446088 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:18.446021 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" podStartSLOduration=2.140790722 podStartE2EDuration="4.445997483s" totalImagesPullingTime="2.305206761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:41:18.445089553 +0000 UTC m=+587.853391010" watchObservedRunningTime="2026-06-11 16:41:18.445997483 +0000 UTC m=+587.854298939" Jun 11 16:41:19.432289 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:41:19.432258 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65br5" Jun 11 16:42:31.444645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.444610 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x"] Jun 11 16:42:31.447941 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.447925 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.451337 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.451314 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:42:31.451450 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.451317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6ftgv\"" Jun 11 16:42:31.451674 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.451660 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:42:31.468017 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.467991 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x"] Jun 11 16:42:31.520093 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.520047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtpd\" (UniqueName: \"kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.520093 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.520096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.621364 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.621317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtpd\" (UniqueName: \"kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.621364 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.621367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.621735 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.621719 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.629181 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.629152 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtpd\" (UniqueName: \"kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd\") pod \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.758354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.758256 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:31.844944 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.844915 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x"] Jun 11 16:42:31.852712 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.852686 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x"] Jun 11 16:42:31.868246 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.868211 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:42:31.871852 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.871822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:31.890419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.890333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:42:31.925118 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.925082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:31.925306 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:31.925269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ntd\" (UniqueName: \"kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.025322 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:42:32.025280 2554 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 11 16:42:32.025322 ip-10-0-129-45 kubenswrapper[2554]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-kc76x_kuadrant-system_8b942270-4e14-4590-b096-89a1b1bbe82b_0(11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-kc76x to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec" Netns:"/var/run/netns/98f72a18-3da4-44e7-b559-a8641cdd839f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-kc76x;K8S_POD_INFRA_CONTAINER_ID=11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec;K8S_POD_UID=8b942270-4e14-4590-b096-89a1b1bbe82b" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x/8b942270-4e14-4590-b096-89a1b1bbe82b:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x 11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x 11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:22 [10.134.0.34/23] Jun 11 16:42:32.025322 ip-10-0-129-45 kubenswrapper[2554]: ' Jun 11 16:42:32.025322 ip-10-0-129-45 kubenswrapper[2554]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 11 16:42:32.025322 ip-10-0-129-45 kubenswrapper[2554]: > Jun 11 16:42:32.025545 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:42:32.025359 2554 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 11 16:42:32.025545 ip-10-0-129-45 kubenswrapper[2554]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-kc76x_kuadrant-system_8b942270-4e14-4590-b096-89a1b1bbe82b_0(11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-kc76x to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec" Netns:"/var/run/netns/98f72a18-3da4-44e7-b559-a8641cdd839f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-kc76x;K8S_POD_INFRA_CONTAINER_ID=11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec;K8S_POD_UID=8b942270-4e14-4590-b096-89a1b1bbe82b" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x/8b942270-4e14-4590-b096-89a1b1bbe82b:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x 11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x 11ed83a0494fb0d721de4f4eb4b6b1d2069215ed48637ba0292b82052177a2ec network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:22 [10.134.0.34/23] Jun 11 16:42:32.025545 ip-10-0-129-45 kubenswrapper[2554]: ' Jun 11 16:42:32.025545 ip-10-0-129-45 kubenswrapper[2554]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 11 16:42:32.025545 ip-10-0-129-45 kubenswrapper[2554]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:32.025801 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.025750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ntd\" (UniqueName: \"kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.025870 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.025840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.026193 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.026170 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.040071 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.040041 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ntd\" (UniqueName: \"kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd\") pod \"kuadrant-operator-controller-manager-55467d9f7-z9hn4\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.184303 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.184260 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:32.326004 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.325978 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:42:32.329271 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:42:32.329242 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9eb8ab_4eda_4b5c_9aee_f16d9e6280cc.slice/crio-67653796bfb2c0f8eb8b7bbf081c3a882bb20b0746bf62ff4957a4cbb575f682 WatchSource:0}: Error finding container 67653796bfb2c0f8eb8b7bbf081c3a882bb20b0746bf62ff4957a4cbb575f682: Status 404 returned error can't find the container with id 67653796bfb2c0f8eb8b7bbf081c3a882bb20b0746bf62ff4957a4cbb575f682 Jun 11 16:42:32.332453 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.332434 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:42:32.771844 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.771809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" event={"ID":"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc","Type":"ContainerStarted","Data":"67653796bfb2c0f8eb8b7bbf081c3a882bb20b0746bf62ff4957a4cbb575f682"} Jun 11 16:42:32.771844 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.771838 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:32.773819 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:42:32.773785 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="8b942270-4e14-4590-b096-89a1b1bbe82b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:32.780090 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.780069 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:32.781869 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:42:32.781843 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="8b942270-4e14-4590-b096-89a1b1bbe82b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:32.833313 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.833275 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjtpd\" (UniqueName: \"kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd\") pod \"8b942270-4e14-4590-b096-89a1b1bbe82b\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " Jun 11 16:42:32.833486 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.833334 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume\") pod \"8b942270-4e14-4590-b096-89a1b1bbe82b\" (UID: \"8b942270-4e14-4590-b096-89a1b1bbe82b\") " Jun 11 16:42:32.833615 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.833588 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8b942270-4e14-4590-b096-89a1b1bbe82b" (UID: "8b942270-4e14-4590-b096-89a1b1bbe82b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:42:32.835517 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.835483 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd" (OuterVolumeSpecName: "kube-api-access-rjtpd") pod "8b942270-4e14-4590-b096-89a1b1bbe82b" (UID: "8b942270-4e14-4590-b096-89a1b1bbe82b"). InnerVolumeSpecName "kube-api-access-rjtpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:42:32.934392 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.934363 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjtpd\" (UniqueName: \"kubernetes.io/projected/8b942270-4e14-4590-b096-89a1b1bbe82b-kube-api-access-rjtpd\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:42:32.934392 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:32.934388 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b942270-4e14-4590-b096-89a1b1bbe82b-extensions-socket-volume\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:42:33.065923 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:33.065849 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b942270-4e14-4590-b096-89a1b1bbe82b" path="/var/lib/kubelet/pods/8b942270-4e14-4590-b096-89a1b1bbe82b/volumes" Jun 11 16:42:33.778542 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:33.778506 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:33.783248 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:42:33.783197 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kc76x\" is forbidden: User \"system:node:ip-10-0-129-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-45.ec2.internal' and this object" podUID="8b942270-4e14-4590-b096-89a1b1bbe82b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kc76x" Jun 11 16:42:36.796373 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:36.796340 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" event={"ID":"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc","Type":"ContainerStarted","Data":"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f"} Jun 11 16:42:36.796782 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:36.796478 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:42:36.831427 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:36.831362 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" podStartSLOduration=2.351474206 podStartE2EDuration="5.831339639s" totalImagesPullingTime="3.479865433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:42:36.829601261 +0000 UTC m=+666.237902718" watchObservedRunningTime="2026-06-11 16:42:36.831339639 +0000 UTC m=+666.239641094" Jun 11 16:42:47.804198 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:42:47.804162 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:43:00.347144 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.347101 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:43:00.347592 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.347352 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" podUID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" containerName="manager" containerID="cri-o://a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f" gracePeriod=10 Jun 11 16:43:00.598890 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.598827 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:43:00.685679 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.685640 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9ntd\" (UniqueName: \"kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd\") pod \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " Jun 11 16:43:00.685901 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.685720 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume\") pod \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\" (UID: \"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc\") " Jun 11 16:43:00.686268 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.686245 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" (UID: "9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:43:00.687906 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.687875 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd" (OuterVolumeSpecName: "kube-api-access-z9ntd") pod "9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" (UID: "9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc"). InnerVolumeSpecName "kube-api-access-z9ntd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:43:00.786722 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.786683 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-extensions-socket-volume\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:43:00.786722 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.786715 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9ntd\" (UniqueName: \"kubernetes.io/projected/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc-kube-api-access-z9ntd\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:43:00.907551 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.907457 2554 generic.go:356] "Generic (PLEG): container finished" podID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" containerID="a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f" exitCode=0 Jun 11 16:43:00.907551 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.907507 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" Jun 11 16:43:00.907551 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.907538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" event={"ID":"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc","Type":"ContainerDied","Data":"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f"} Jun 11 16:43:00.907822 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.907592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4" event={"ID":"9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc","Type":"ContainerDied","Data":"67653796bfb2c0f8eb8b7bbf081c3a882bb20b0746bf62ff4957a4cbb575f682"} Jun 11 16:43:00.907822 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.907616 2554 scope.go:117] "RemoveContainer" containerID="a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f" Jun 11 16:43:00.917016 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.916998 2554 scope.go:117] "RemoveContainer" containerID="a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f" Jun 11 16:43:00.917284 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:43:00.917265 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f\": container with ID starting with a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f not found: ID does not exist" containerID="a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f" Jun 11 16:43:00.917328 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.917295 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f"} err="failed to get container status \"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f\": rpc error: code = NotFound desc = could not find container \"a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f\": container with ID starting with a1756c6a82a81eee0923f7618edb62c960185bee906721f1bc070098cc10be4f not found: ID does not exist" Jun 11 16:43:00.927273 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.927244 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:43:00.930927 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:00.930900 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-z9hn4"] Jun 11 16:43:01.064809 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:01.064775 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" path="/var/lib/kubelet/pods/9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc/volumes" Jun 11 16:43:18.746310 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.746224 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:18.746782 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.746601 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" containerName="manager" Jun 11 16:43:18.746782 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.746613 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" containerName="manager" Jun 11 16:43:18.746782 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.746679 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9eb8ab-4eda-4b5c-9aee-f16d9e6280cc" containerName="manager" Jun 11 16:43:18.749676 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.749658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.751888 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.751865 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9mjsd\"" Jun 11 16:43:18.752042 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.751867 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:43:18.752663 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.752644 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:43:18.752743 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.752651 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:43:18.757365 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.757089 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:18.841712 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.841678 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:18.849538 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.849503 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.849696 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.849585 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxcpl\" (UniqueName: \"kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.950900 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.950859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.951103 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.950949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxcpl\" (UniqueName: \"kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.951586 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.951558 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:18.958879 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:18.958849 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxcpl\" (UniqueName: \"kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl\") pod \"limitador-limitador-64c94fd64f-xzfnx\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:19.061354 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.061258 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:19.069637 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.069607 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:43:19.073439 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.073412 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.081743 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.081717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:43:19.148419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.148385 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:43:19.152689 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.152660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2938795c-b86b-4dbe-92ce-5021b60947ca-config-file\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.152863 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.152844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvqq\" (UniqueName: \"kubernetes.io/projected/2938795c-b86b-4dbe-92ce-5021b60947ca-kube-api-access-szvqq\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.218214 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.218186 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:19.221111 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:43:19.221083 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baa4858_c252_417d_a61f_854979b14958.slice/crio-41e96c135806ba2ad4ea90ad26d8ce9ee02fb07a2ed0e6679c11eaf07ffa416f WatchSource:0}: Error finding container 41e96c135806ba2ad4ea90ad26d8ce9ee02fb07a2ed0e6679c11eaf07ffa416f: Status 404 returned error can't find the container with id 41e96c135806ba2ad4ea90ad26d8ce9ee02fb07a2ed0e6679c11eaf07ffa416f Jun 11 16:43:19.254251 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.254213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2938795c-b86b-4dbe-92ce-5021b60947ca-config-file\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.254422 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.254306 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvqq\" (UniqueName: \"kubernetes.io/projected/2938795c-b86b-4dbe-92ce-5021b60947ca-kube-api-access-szvqq\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.254995 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.254975 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2938795c-b86b-4dbe-92ce-5021b60947ca-config-file\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.264252 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.264218 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvqq\" (UniqueName: \"kubernetes.io/projected/2938795c-b86b-4dbe-92ce-5021b60947ca-kube-api-access-szvqq\") pod \"limitador-limitador-54d6d988d5-wzghh\" (UID: \"2938795c-b86b-4dbe-92ce-5021b60947ca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.398968 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.398885 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:19.533985 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:19.533955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:43:19.535894 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:43:19.535871 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2938795c_b86b_4dbe_92ce_5021b60947ca.slice/crio-cd3fddfcc4de3a37a04abcbd7fac8d62712a0e9b3d7dd9b65bf7b484cc1b597a WatchSource:0}: Error finding container cd3fddfcc4de3a37a04abcbd7fac8d62712a0e9b3d7dd9b65bf7b484cc1b597a: Status 404 returned error can't find the container with id cd3fddfcc4de3a37a04abcbd7fac8d62712a0e9b3d7dd9b65bf7b484cc1b597a Jun 11 16:43:20.009106 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:20.009068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" event={"ID":"2938795c-b86b-4dbe-92ce-5021b60947ca","Type":"ContainerStarted","Data":"cd3fddfcc4de3a37a04abcbd7fac8d62712a0e9b3d7dd9b65bf7b484cc1b597a"} Jun 11 16:43:20.010555 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:20.010520 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" event={"ID":"6baa4858-c252-417d-a61f-854979b14958","Type":"ContainerStarted","Data":"41e96c135806ba2ad4ea90ad26d8ce9ee02fb07a2ed0e6679c11eaf07ffa416f"} Jun 11 16:43:23.029161 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.029118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" event={"ID":"6baa4858-c252-417d-a61f-854979b14958","Type":"ContainerStarted","Data":"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657"} Jun 11 16:43:23.029635 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.029222 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:23.030718 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.030690 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" event={"ID":"2938795c-b86b-4dbe-92ce-5021b60947ca","Type":"ContainerStarted","Data":"c3d6fc86c57cb67d8ce09c70b9dbe0b92ea3c9db6b1a0b739d01102031de4ae9"} Jun 11 16:43:23.030820 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.030795 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:23.055996 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.055942 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" podStartSLOduration=1.900471424 podStartE2EDuration="5.055924821s" totalImagesPullingTime="3.155453397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:23.054492242 +0000 UTC m=+712.462793701" watchObservedRunningTime="2026-06-11 16:43:23.055924821 +0000 UTC m=+712.464226277" Jun 11 16:43:23.079235 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:23.079175 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" podStartSLOduration=1.245651051 podStartE2EDuration="4.079152923s" totalImagesPullingTime="2.833501872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:23.077050316 +0000 UTC m=+712.485351795" watchObservedRunningTime="2026-06-11 16:43:23.079152923 +0000 UTC m=+712.487454422" Jun 11 16:43:34.036908 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.036876 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:34.037323 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.036961 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wzghh" Jun 11 16:43:34.095572 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.095530 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:34.095831 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.095805 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" podUID="6baa4858-c252-417d-a61f-854979b14958" containerName="limitador" containerID="cri-o://c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657" gracePeriod=30 Jun 11 16:43:34.655466 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.655401 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:34.801524 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.801479 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file\") pod \"6baa4858-c252-417d-a61f-854979b14958\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " Jun 11 16:43:34.801678 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.801535 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxcpl\" (UniqueName: \"kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl\") pod \"6baa4858-c252-417d-a61f-854979b14958\" (UID: \"6baa4858-c252-417d-a61f-854979b14958\") " Jun 11 16:43:34.801932 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.801907 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file" (OuterVolumeSpecName: "config-file") pod "6baa4858-c252-417d-a61f-854979b14958" (UID: "6baa4858-c252-417d-a61f-854979b14958"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:43:34.803689 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.803664 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl" (OuterVolumeSpecName: "kube-api-access-vxcpl") pod "6baa4858-c252-417d-a61f-854979b14958" (UID: "6baa4858-c252-417d-a61f-854979b14958"). InnerVolumeSpecName "kube-api-access-vxcpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:43:34.903109 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.903066 2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6baa4858-c252-417d-a61f-854979b14958-config-file\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:43:34.903109 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:34.903102 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxcpl\" (UniqueName: \"kubernetes.io/projected/6baa4858-c252-417d-a61f-854979b14958-kube-api-access-vxcpl\") on node \"ip-10-0-129-45.ec2.internal\" DevicePath \"\"" Jun 11 16:43:35.091703 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.091665 2554 generic.go:356] "Generic (PLEG): container finished" podID="6baa4858-c252-417d-a61f-854979b14958" containerID="c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657" exitCode=0 Jun 11 16:43:35.092188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.091716 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" Jun 11 16:43:35.092188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.091746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" event={"ID":"6baa4858-c252-417d-a61f-854979b14958","Type":"ContainerDied","Data":"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657"} Jun 11 16:43:35.092188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.091818 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xzfnx" event={"ID":"6baa4858-c252-417d-a61f-854979b14958","Type":"ContainerDied","Data":"41e96c135806ba2ad4ea90ad26d8ce9ee02fb07a2ed0e6679c11eaf07ffa416f"} Jun 11 16:43:35.092188 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.091841 2554 scope.go:117] "RemoveContainer" containerID="c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657" Jun 11 16:43:35.100375 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.100212 2554 scope.go:117] "RemoveContainer" containerID="c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657" Jun 11 16:43:35.100568 ip-10-0-129-45 kubenswrapper[2554]: E0611 16:43:35.100545 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657\": container with ID starting with c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657 not found: ID does not exist" containerID="c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657" Jun 11 16:43:35.100614 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.100578 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657"} err="failed to get container status \"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657\": rpc error: code = NotFound desc = could not find container \"c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657\": container with ID starting with c525b799d2cb29e474e3db499cdaacd014e86e25fe7d0bd88ba59756d02e6657 not found: ID does not exist" Jun 11 16:43:35.106971 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.106936 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:35.110952 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:35.110923 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xzfnx"] Jun 11 16:43:37.064855 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.064824 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6baa4858-c252-417d-a61f-854979b14958" path="/var/lib/kubelet/pods/6baa4858-c252-417d-a61f-854979b14958/volumes" Jun 11 16:43:37.760858 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.760811 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-tm7bf"] Jun 11 16:43:37.761442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.761415 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baa4858-c252-417d-a61f-854979b14958" containerName="limitador" Jun 11 16:43:37.761442 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.761440 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baa4858-c252-417d-a61f-854979b14958" containerName="limitador" Jun 11 16:43:37.761614 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.761538 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baa4858-c252-417d-a61f-854979b14958" containerName="limitador" Jun 11 16:43:37.766179 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.766161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:37.768689 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.768660 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 16:43:37.771102 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.771031 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tm7bf"] Jun 11 16:43:37.930716 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.930678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkntl\" (UniqueName: \"kubernetes.io/projected/5ce3013c-3527-4f02-95ac-8843c80a7c7d-kube-api-access-pkntl\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:37.930921 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:37.930796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5ce3013c-3527-4f02-95ac-8843c80a7c7d-data\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.032267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.032180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5ce3013c-3527-4f02-95ac-8843c80a7c7d-data\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.032267 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.032244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkntl\" (UniqueName: \"kubernetes.io/projected/5ce3013c-3527-4f02-95ac-8843c80a7c7d-kube-api-access-pkntl\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.032555 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.032532 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5ce3013c-3527-4f02-95ac-8843c80a7c7d-data\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.039824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.039796 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkntl\" (UniqueName: \"kubernetes.io/projected/5ce3013c-3527-4f02-95ac-8843c80a7c7d-kube-api-access-pkntl\") pod \"postgres-69fb4594cf-tm7bf\" (UID: \"5ce3013c-3527-4f02-95ac-8843c80a7c7d\") " pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.078405 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.078353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:38.211655 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:38.211630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tm7bf"] Jun 11 16:43:38.214527 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:43:38.214503 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce3013c_3527_4f02_95ac_8843c80a7c7d.slice/crio-10f991e8ed4bbaba9b03d002b99110455707ba7ccfce35d0db89c6eb48c59104 WatchSource:0}: Error finding container 10f991e8ed4bbaba9b03d002b99110455707ba7ccfce35d0db89c6eb48c59104: Status 404 returned error can't find the container with id 10f991e8ed4bbaba9b03d002b99110455707ba7ccfce35d0db89c6eb48c59104 Jun 11 16:43:39.114221 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:39.114181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tm7bf" event={"ID":"5ce3013c-3527-4f02-95ac-8843c80a7c7d","Type":"ContainerStarted","Data":"10f991e8ed4bbaba9b03d002b99110455707ba7ccfce35d0db89c6eb48c59104"} Jun 11 16:43:41.125884 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:41.125801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tm7bf" event={"ID":"5ce3013c-3527-4f02-95ac-8843c80a7c7d","Type":"ContainerStarted","Data":"42edca59965ad236d2afd29dd1554e7aedd23562a8984e63e3d7ecaab3f39d71"} Jun 11 16:43:41.125884 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:41.125887 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:41.141461 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:41.141409 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-tm7bf" podStartSLOduration=1.318698124 podStartE2EDuration="4.141392765s" totalImagesPullingTime="2.822694641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:43:41.140241464 +0000 UTC m=+730.548542942" watchObservedRunningTime="2026-06-11 16:43:41.141392765 +0000 UTC m=+730.549694273" Jun 11 16:43:47.160622 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:47.160591 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-tm7bf" Jun 11 16:43:55.931131 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.931087 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-89l9z"] Jun 11 16:43:55.938694 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.938665 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" Jun 11 16:43:55.941566 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.941542 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-qtl8c\"" Jun 11 16:43:55.942299 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.942281 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:43:55.945155 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.945135 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:43:55.945842 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.945819 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-89l9z"] Jun 11 16:43:55.990824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:55.990779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bbgm\" (UniqueName: \"kubernetes.io/projected/b10018d8-96c3-44c1-92ea-eb7a36e6ed3f-kube-api-access-8bbgm\") pod \"keycloak-operator-d67dbbb48-89l9z\" (UID: \"b10018d8-96c3-44c1-92ea-eb7a36e6ed3f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" Jun 11 16:43:56.091437 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:56.091396 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bbgm\" (UniqueName: \"kubernetes.io/projected/b10018d8-96c3-44c1-92ea-eb7a36e6ed3f-kube-api-access-8bbgm\") pod \"keycloak-operator-d67dbbb48-89l9z\" (UID: \"b10018d8-96c3-44c1-92ea-eb7a36e6ed3f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" Jun 11 16:43:56.099275 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:56.099248 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bbgm\" (UniqueName: \"kubernetes.io/projected/b10018d8-96c3-44c1-92ea-eb7a36e6ed3f-kube-api-access-8bbgm\") pod \"keycloak-operator-d67dbbb48-89l9z\" (UID: \"b10018d8-96c3-44c1-92ea-eb7a36e6ed3f\") " pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" Jun 11 16:43:56.250452 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:56.250417 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" Jun 11 16:43:56.394131 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:56.394105 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-89l9z"] Jun 11 16:43:56.396477 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:43:56.396448 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10018d8_96c3_44c1_92ea_eb7a36e6ed3f.slice/crio-3309254bbc95396f02ec7a134e10d06f21a94c91eeb58c55dfcc18ba17e3dcc9 WatchSource:0}: Error finding container 3309254bbc95396f02ec7a134e10d06f21a94c91eeb58c55dfcc18ba17e3dcc9: Status 404 returned error can't find the container with id 3309254bbc95396f02ec7a134e10d06f21a94c91eeb58c55dfcc18ba17e3dcc9 Jun 11 16:43:57.207503 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:43:57.207459 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" event={"ID":"b10018d8-96c3-44c1-92ea-eb7a36e6ed3f","Type":"ContainerStarted","Data":"3309254bbc95396f02ec7a134e10d06f21a94c91eeb58c55dfcc18ba17e3dcc9"} Jun 11 16:44:02.238434 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:44:02.238332 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" event={"ID":"b10018d8-96c3-44c1-92ea-eb7a36e6ed3f","Type":"ContainerStarted","Data":"775514945b6bcd4a0b65379b3a2bab33c6e7c7822fda5dcc73cadfb3bc435b02"} Jun 11 16:44:02.253303 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:44:02.253231 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-89l9z" podStartSLOduration=1.673924067 podStartE2EDuration="7.25320858s" totalImagesPullingTime="5.579284513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:02.251999862 +0000 UTC m=+751.660301319" watchObservedRunningTime="2026-06-11 16:44:02.25320858 +0000 UTC m=+751.661510038" Jun 11 16:45:21.154578 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:45:21.154478 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:48:22.636506 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:48:22.636463 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:48:28.336875 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:48:28.336832 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:48:42.542950 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:48:42.542910 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:48:49.040249 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:48:49.040210 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:49:01.235504 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:49:01.235465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:49:14.337318 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:49:14.337225 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wzghh"] Jun 11 16:53:25.153189 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:25.153153 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79b7c87c7f-vmxmn_b6de4406-482e-4ef1-964f-2ebbf0f02f12/nginx/0.log" Jun 11 16:53:25.260301 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:25.260267 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z65ht_b353e9e5-ac8e-4d88-9131-043a7ed6f834/manager/0.log" Jun 11 16:53:25.381596 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:25.381555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5s5qj_21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d/manager/0.log" Jun 11 16:53:25.708534 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:25.708495 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2gwrh_8d21e02c-6d60-43ff-bbdb-857362dda0cd/server/0.log" Jun 11 16:53:25.826192 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:25.826152 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-xbh5l_795ea9e1-df0d-42eb-9a62-1f780287e052/manager/0.log" Jun 11 16:53:26.162821 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:26.162717 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-sh6fg_c24b77dc-0e42-4641-902f-998a70dde150/copy-manifests/0.log" Jun 11 16:53:26.181301 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:26.181270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-sh6fg_c24b77dc-0e42-4641-902f-998a70dde150/manager/0.log" Jun 11 16:53:26.286643 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:26.286610 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tm7bf_5ce3013c-3527-4f02-95ac-8843c80a7c7d/postgres/0.log" Jun 11 16:53:28.177687 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:28.177657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wzghh_2938795c-b86b-4dbe-92ce-5021b60947ca/limitador/0.log" Jun 11 16:53:28.740271 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:28.740233 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65br5_29ca3635-3893-45ce-a2de-c493c8039e3f/discovery/0.log" Jun 11 16:53:28.951288 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:28.951255 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75ffc6ddf8-z8jdc_b4b89d40-965c-4270-88a6-f6939bd8060e/kube-auth-proxy/0.log" Jun 11 16:53:29.400825 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:29.400792 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:53:37.459731 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:37.459693 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wpgch_fffd3769-a5fc-41b7-8c26-f9f7779ce4f7/global-pull-secret-syncer/0.log" Jun 11 16:53:37.553711 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:37.553671 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-szdvd_1b42cd09-bc70-445a-8c4a-46b7e70b96ca/konnectivity-agent/0.log" Jun 11 16:53:37.572934 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:37.572904 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-45.ec2.internal_5d88b1683083ed0aa298625159bd387e/haproxy/0.log" Jun 11 16:53:41.369874 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:41.369839 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-kgnmr_5572c349-fc1e-4b6e-8ff2-e80e8142e6f3/sail-operator/0.log" Jun 11 16:53:42.273731 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:42.273698 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wzghh_2938795c-b86b-4dbe-92ce-5021b60947ca/limitador/0.log" Jun 11 16:53:44.324558 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:44.324469 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-62ztb_36bcc398-6201-4b82-9b2d-e3ed531ae435/cluster-monitoring-operator/0.log" Jun 11 16:53:44.648264 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:44.648164 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/node-exporter/0.log" Jun 11 16:53:44.667535 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:44.667499 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/kube-rbac-proxy/0.log" Jun 11 16:53:44.689955 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:44.689929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkrb6_20ff493e-1ddd-46ce-aeb3-596be9b3fc68/init-textfile/0.log" Jun 11 16:53:45.132645 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:45.132612 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656c4fc79-mntwm_98efbfdd-3432-43a9-ae3a-a808532052a0/telemeter-client/0.log" Jun 11 16:53:45.160338 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:45.160304 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656c4fc79-mntwm_98efbfdd-3432-43a9-ae3a-a808532052a0/reload/0.log" Jun 11 16:53:45.186748 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:45.186718 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-656c4fc79-mntwm_98efbfdd-3432-43a9-ae3a-a808532052a0/kube-rbac-proxy/0.log" Jun 11 16:53:49.054914 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.054890 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-jwkj2_14321013-b1a1-428a-8719-2ad1531cb5b9/volume-data-source-validator/0.log" Jun 11 16:53:49.214750 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.214715 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28"] Jun 11 16:53:49.218344 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.218323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.220260 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.220233 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9sdk2\"/\"openshift-service-ca.crt\"" Jun 11 16:53:49.220980 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.220959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9sdk2\"/\"default-dockercfg-5grv2\"" Jun 11 16:53:49.221085 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.220963 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9sdk2\"/\"kube-root-ca.crt\"" Jun 11 16:53:49.227650 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.227625 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28"] Jun 11 16:53:49.321203 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.321094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-podres\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.321203 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.321147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-lib-modules\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.321419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.321213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-proc\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.321419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.321271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9cjk\" (UniqueName: \"kubernetes.io/projected/e39cd88d-d6dd-4728-ba29-019ed94e632e-kube-api-access-q9cjk\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.321419 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.321322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-sys\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422578 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-lib-modules\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422578 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-proc\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cjk\" (UniqueName: \"kubernetes.io/projected/e39cd88d-d6dd-4728-ba29-019ed94e632e-kube-api-access-q9cjk\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-sys\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422695 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-proc\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422710 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-podres\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422737 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-lib-modules\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.422824 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422789 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-sys\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.423024 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.422835 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e39cd88d-d6dd-4728-ba29-019ed94e632e-podres\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.431113 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.431082 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cjk\" (UniqueName: \"kubernetes.io/projected/e39cd88d-d6dd-4728-ba29-019ed94e632e-kube-api-access-q9cjk\") pod \"perf-node-gather-daemonset-d9t28\" (UID: \"e39cd88d-d6dd-4728-ba29-019ed94e632e\") " pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.530569 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.530532 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:49.666122 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:49.665932 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28"] Jun 11 16:53:49.669247 ip-10-0-129-45 kubenswrapper[2554]: W0611 16:53:49.669218 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode39cd88d_d6dd_4728_ba29_019ed94e632e.slice/crio-63a406752e291b7722945bea59e39b855c7f2b8d4739e7de039789952c5cacc3 WatchSource:0}: Error finding container 63a406752e291b7722945bea59e39b855c7f2b8d4739e7de039789952c5cacc3: Status 404 returned error can't find the container with id 63a406752e291b7722945bea59e39b855c7f2b8d4739e7de039789952c5cacc3 Jun 11 16:53:50.088613 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.088577 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" event={"ID":"e39cd88d-d6dd-4728-ba29-019ed94e632e","Type":"ContainerStarted","Data":"607665c03864b3b67fa5043cfa3837ce070943e019222e435f4fbea155bcef09"} Jun 11 16:53:50.089049 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.088627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" event={"ID":"e39cd88d-d6dd-4728-ba29-019ed94e632e","Type":"ContainerStarted","Data":"63a406752e291b7722945bea59e39b855c7f2b8d4739e7de039789952c5cacc3"} Jun 11 16:53:50.089049 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.088657 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:50.105738 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.105676 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" podStartSLOduration=1.10565829 podStartE2EDuration="1.10565829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:50.10388728 +0000 UTC m=+1339.512188739" watchObservedRunningTime="2026-06-11 16:53:50.10565829 +0000 UTC m=+1339.513959745" Jun 11 16:53:50.375788 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.375685 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2hfg_bf3d6eae-7f64-4680-a3e4-0edb9288e396/dns/0.log" Jun 11 16:53:50.396626 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.396599 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t2hfg_bf3d6eae-7f64-4680-a3e4-0edb9288e396/kube-rbac-proxy/0.log" Jun 11 16:53:50.420746 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.420709 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pvjp_a3dfa592-f76a-4e98-b3cc-88bbfe5a6581/dns-node-resolver/0.log" Jun 11 16:53:50.995051 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:50.995012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c564c96c-lr8vs_8484718d-18cd-47e0-8230-7f38f7cc29c9/registry/0.log" Jun 11 16:53:51.002774 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:51.002723 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c564c96c-lr8vs_8484718d-18cd-47e0-8230-7f38f7cc29c9/registry/1.log" Jun 11 16:53:51.069114 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:51.069084 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7tgx_aa0e0d96-186a-4bc1-b124-25b2c313b738/node-ca/0.log" Jun 11 16:53:52.090101 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:52.090067 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65br5_29ca3635-3893-45ce-a2de-c493c8039e3f/discovery/0.log" Jun 11 16:53:52.134487 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:52.134459 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75ffc6ddf8-z8jdc_b4b89d40-965c-4270-88a6-f6939bd8060e/kube-auth-proxy/0.log" Jun 11 16:53:52.235131 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:52.235097 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:53:52.873659 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:52.873628 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bk7cp_622f8158-f72f-4790-9e60-d94cbfb703a7/serve-healthcheck-canary/0.log" Jun 11 16:53:53.417742 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:53.417675 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nmcw8_7b6038a9-88ef-415d-9d3d-7eb20113f3ba/insights-operator/0.log" Jun 11 16:53:53.421392 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:53.421360 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nmcw8_7b6038a9-88ef-415d-9d3d-7eb20113f3ba/insights-operator/1.log" Jun 11 16:53:53.580449 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:53.580416 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmpdb_34938f6c-2a7e-480f-9f4b-ff4d360770b0/kube-rbac-proxy/0.log" Jun 11 16:53:53.599485 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:53.599451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmpdb_34938f6c-2a7e-480f-9f4b-ff4d360770b0/exporter/0.log" Jun 11 16:53:53.620839 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:53.620797 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lmpdb_34938f6c-2a7e-480f-9f4b-ff4d360770b0/extractor/0.log" Jun 11 16:53:55.817432 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:55.817399 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-79b7c87c7f-vmxmn_b6de4406-482e-4ef1-964f-2ebbf0f02f12/nginx/0.log" Jun 11 16:53:55.841155 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:55.841111 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z65ht_b353e9e5-ac8e-4d88-9131-043a7ed6f834/manager/0.log" Jun 11 16:53:55.883313 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:55.883280 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5s5qj_21bda0e3-c8f5-4505-a2d0-e9c6d11d5f8d/manager/0.log" Jun 11 16:53:55.950192 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:55.950152 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2gwrh_8d21e02c-6d60-43ff-bbdb-857362dda0cd/server/0.log" Jun 11 16:53:56.016892 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:56.016837 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-xbh5l_795ea9e1-df0d-42eb-9a62-1f780287e052/manager/0.log" Jun 11 16:53:56.104652 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:56.104576 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9sdk2/perf-node-gather-daemonset-d9t28" Jun 11 16:53:56.194154 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:56.194120 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-sh6fg_c24b77dc-0e42-4641-902f-998a70dde150/manager/0.log" Jun 11 16:53:56.210498 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:56.210470 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d99d69cd-sh6fg_c24b77dc-0e42-4641-902f-998a70dde150/copy-manifests/0.log" Jun 11 16:53:56.235502 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:53:56.235474 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tm7bf_5ce3013c-3527-4f02-95ac-8843c80a7c7d/postgres/0.log" Jun 11 16:54:03.251621 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.251590 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vnvkk_7abe9370-3fca-45f2-82d5-b9518d16e6ab/migrator/0.log" Jun 11 16:54:03.273189 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.273154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vnvkk_7abe9370-3fca-45f2-82d5-b9518d16e6ab/graceful-termination/0.log" Jun 11 16:54:03.291795 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.291745 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65br5_29ca3635-3893-45ce-a2de-c493c8039e3f/discovery/0.log" Jun 11 16:54:03.318640 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.318606 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75ffc6ddf8-z8jdc_b4b89d40-965c-4270-88a6-f6939bd8060e/kube-auth-proxy/0.log" Jun 11 16:54:03.386324 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.386278 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:54:03.681233 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.681144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mqzhc_e6e73724-2e08-42ac-bb82-4349e290c13d/kube-storage-version-migrator-operator/1.log" Jun 11 16:54:03.682576 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:03.682540 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mqzhc_e6e73724-2e08-42ac-bb82-4349e290c13d/kube-storage-version-migrator-operator/0.log" Jun 11 16:54:04.542785 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:04.542736 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65br5_29ca3635-3893-45ce-a2de-c493c8039e3f/discovery/0.log" Jun 11 16:54:04.570983 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:04.570952 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75ffc6ddf8-z8jdc_b4b89d40-965c-4270-88a6-f6939bd8060e/kube-auth-proxy/0.log" Jun 11 16:54:04.647625 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:04.647586 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:54:05.337040 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.337010 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/kube-multus-additional-cni-plugins/0.log" Jun 11 16:54:05.357838 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.357812 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/egress-router-binary-copy/0.log" Jun 11 16:54:05.377969 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.377944 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/cni-plugins/0.log" Jun 11 16:54:05.397497 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.397467 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/bond-cni-plugin/0.log" Jun 11 16:54:05.420835 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.420806 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/routeoverride-cni/0.log" Jun 11 16:54:05.440370 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.440338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/whereabouts-cni-bincopy/0.log" Jun 11 16:54:05.459990 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.459958 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l27kb_959b3101-c568-4375-b02f-2bcecc5f46bb/whereabouts-cni/0.log" Jun 11 16:54:05.494187 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.494154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-szh2w_e7e82533-72c4-4923-9125-d34fce9c0688/kube-multus/0.log" Jun 11 16:54:05.601054 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.600963 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9lpx_db264153-220b-4974-8ba7-ede0b19c142b/network-metrics-daemon/0.log" Jun 11 16:54:05.618857 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:05.618827 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9lpx_db264153-220b-4974-8ba7-ede0b19c142b/kube-rbac-proxy/0.log" Jun 11 16:54:06.287980 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.287949 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65br5_29ca3635-3893-45ce-a2de-c493c8039e3f/discovery/0.log" Jun 11 16:54:06.319944 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.319913 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75ffc6ddf8-z8jdc_b4b89d40-965c-4270-88a6-f6939bd8060e/kube-auth-proxy/0.log" Jun 11 16:54:06.386957 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.386924 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76d659c6c5-z4kfv_1e543698-f475-4694-93c7-2b9227698c9e/router/0.log" Jun 11 16:54:06.687059 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.687031 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/ovn-controller/0.log" Jun 11 16:54:06.702907 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.702881 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/ovn-acl-logging/0.log" Jun 11 16:54:06.728325 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.728298 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/kube-rbac-proxy-node/0.log" Jun 11 16:54:06.751230 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.751198 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 16:54:06.768331 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.768301 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/northd/0.log" Jun 11 16:54:06.787241 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.787212 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/nbdb/0.log" Jun 11 16:54:06.806511 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.806468 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/sbdb/0.log" Jun 11 16:54:06.864275 ip-10-0-129-45 kubenswrapper[2554]: I0611 16:54:06.864239 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjkrd_229825ef-039d-4765-8000-eeadd6c87288/ovnkube-controller/0.log"