Jun 10 00:35:25.685684 ip-10-0-141-5 systemd[1]: Starting Kubernetes Kubelet... Jun 10 00:35:26.059455 ip-10-0-141-5 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:26.059455 ip-10-0-141-5 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 00:35:26.059455 ip-10-0-141-5 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:26.059455 ip-10-0-141-5 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 00:35:26.059455 ip-10-0-141-5 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:26.060225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.060136 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 00:35:26.065413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065381 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.065413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065410 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.065413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065414 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065419 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065423 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065427 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065430 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065433 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065436 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065439 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065442 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065445 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065452 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065455 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065458 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065460 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065463 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065465 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065468 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065472 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065477 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.065506 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065479 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065482 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065485 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065488 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065491 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065493 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065496 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065499 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065501 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065504 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065507 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065509 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065512 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065515 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065518 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065521 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065523 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065526 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065529 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.065954 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065531 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065534 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065537 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065539 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065542 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065544 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065547 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065549 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065552 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065554 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065557 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065559 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065561 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065564 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065566 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065572 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065575 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065577 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065580 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065583 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.066442 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065585 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065588 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065591 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065593 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065596 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065599 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065601 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065604 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065606 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065609 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065611 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065614 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065617 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065619 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065622 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065625 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065628 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065631 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065633 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065636 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.066939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065638 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065640 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065643 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065645 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065648 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065650 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065652 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065656 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065659 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065661 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065664 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065666 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065669 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065671 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065674 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065676 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065679 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065681 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.065685 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066404 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.067450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066411 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066414 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066416 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066419 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066422 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066424 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066427 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066430 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066433 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066436 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066439 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066441 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066444 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066447 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066450 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066452 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066455 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066458 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066460 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066464 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.067930 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066467 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066470 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066473 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066476 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066478 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066481 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066483 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066486 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066488 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066491 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066493 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066496 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066498 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066501 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066503 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066506 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066508 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066510 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066513 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066515 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.068450 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066518 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066521 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066524 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066526 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066529 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066533 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066537 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066540 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066543 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066545 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066548 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066552 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066555 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066557 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066560 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066562 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066565 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066567 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066570 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.068939 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066572 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066575 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066577 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066580 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066582 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066584 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066587 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066589 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066592 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066594 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066597 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066599 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066602 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066605 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066608 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066612 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066614 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066617 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066621 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.069438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066625 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066628 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066631 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066633 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066636 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066639 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066642 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066644 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066647 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066649 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066652 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066654 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066657 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066659 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066663 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066665 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066668 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066670 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066673 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.066675 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.069899 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067041 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067045 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067048 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067051 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067053 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067056 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067059 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067061 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067064 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067067 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067070 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067072 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067075 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067077 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067079 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067082 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067084 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067088 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067091 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.070501 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067093 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067096 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067098 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067101 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067104 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067106 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067109 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067112 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067114 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067117 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067119 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067122 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067126 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067129 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067132 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067135 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067137 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067140 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067142 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067145 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.070970 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067147 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067151 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067154 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067157 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067160 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067163 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067166 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067169 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067172 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067175 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067178 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067181 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067184 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067187 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067189 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067192 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067194 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067197 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067199 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067202 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.071498 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067204 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067207 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067209 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067212 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067214 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067217 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067220 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067222 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067225 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067227 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067230 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067232 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067235 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067238 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067240 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067243 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067246 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067248 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067251 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067253 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.072020 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067255 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067258 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067264 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067266 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067269 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067271 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067274 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067276 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067279 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067281 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067284 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067287 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067290 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067293 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067295 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067299 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067301 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067306 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067308 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.067311 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.072530 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067404 2583 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067412 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067419 2583 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067424 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067428 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067431 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067435 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067440 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067443 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067446 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067450 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067453 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067456 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067460 2583 flags.go:64] FLAG: --cgroup-root="" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067465 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067468 2583 flags.go:64] FLAG: --client-ca-file="" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067470 2583 flags.go:64] FLAG: --cloud-provider="external" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067473 2583 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067477 2583 flags.go:64] FLAG: --cluster-domain="" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067480 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067483 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067487 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067490 2583 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067494 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 00:35:26.073030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067497 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067500 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067503 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067507 2583 flags.go:64] FLAG: --contention-profiling="false" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067509 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067514 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067517 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067520 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067524 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067528 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067530 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067533 2583 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067536 2583 flags.go:64] FLAG: --enable-server="true" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067539 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067543 2583 flags.go:64] FLAG: --event-burst="100" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067547 2583 flags.go:64] FLAG: --event-qps="50" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067549 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067553 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067556 2583 flags.go:64] FLAG: --eviction-hard="" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067560 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067563 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067566 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067570 2583 flags.go:64] FLAG: --eviction-soft="" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067573 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067576 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 00:35:26.073651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067579 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067582 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067584 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067587 2583 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067590 2583 flags.go:64] FLAG: --feature-gates="" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067594 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067597 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067600 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067603 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067606 2583 flags.go:64] FLAG: --healthz-port="10248" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067609 2583 flags.go:64] FLAG: --help="false" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067611 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067616 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067619 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067622 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067625 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067633 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067636 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067638 2583 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067641 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067644 2583 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067647 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067649 2583 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067652 2583 flags.go:64] FLAG: --kube-reserved="" Jun 10 00:35:26.074301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067655 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067659 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067662 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067664 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067667 2583 flags.go:64] FLAG: --lock-file="" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067671 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067674 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067677 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067682 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067685 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067688 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067690 2583 flags.go:64] FLAG: --logging-format="text" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067693 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067696 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067699 2583 flags.go:64] FLAG: --manifest-url="" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067702 2583 flags.go:64] FLAG: --manifest-url-header="" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067706 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067709 2583 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067713 2583 flags.go:64] FLAG: --max-pods="110" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067716 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067720 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067723 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067726 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067729 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067732 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 00:35:26.074928 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067735 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067742 2583 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067745 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067748 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067751 2583 flags.go:64] FLAG: --pod-cidr="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067754 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067760 2583 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067763 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067766 2583 flags.go:64] FLAG: --pods-per-core="0" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067769 2583 flags.go:64] FLAG: --port="10250" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067772 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067775 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051283a9138442c6b" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067778 2583 flags.go:64] FLAG: --qos-reserved="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067782 2583 flags.go:64] FLAG: --read-only-port="10255" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067786 2583 flags.go:64] FLAG: --register-node="true" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067789 2583 flags.go:64] FLAG: --register-with-taints="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067792 2583 flags.go:64] FLAG: --registry-burst="10" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067795 2583 flags.go:64] FLAG: --registry-qps="5" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067798 2583 flags.go:64] FLAG: --reserved-cpus="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067800 2583 flags.go:64] FLAG: --reserved-memory="" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067804 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067807 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067810 2583 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067813 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067816 2583 flags.go:64] FLAG: --runonce="false" Jun 10 00:35:26.075573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067819 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067822 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067826 2583 flags.go:64] FLAG: --seccomp-default="false" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067829 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067831 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067834 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067837 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067840 2583 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067843 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067846 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067848 2583 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067851 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067854 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067857 2583 flags.go:64] FLAG: --system-cgroups="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067860 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067865 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067868 2583 flags.go:64] FLAG: --tls-cert-file="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067871 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067875 2583 flags.go:64] FLAG: --tls-min-version="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067877 2583 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067881 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067884 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067887 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067890 2583 flags.go:64] FLAG: --v="2" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067894 2583 flags.go:64] FLAG: --version="false" Jun 10 00:35:26.076225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067898 2583 flags.go:64] FLAG: --vmodule="" Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067901 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.067904 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068019 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068023 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068026 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068028 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068031 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068034 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068039 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068042 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068044 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068047 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068050 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068053 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068055 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068058 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068061 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068063 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068066 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.076853 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068068 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068071 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068073 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068076 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068078 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068081 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068084 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068087 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068090 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068092 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068095 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068097 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068100 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068102 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068106 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068109 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068112 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068114 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068117 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068119 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.077413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068122 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068125 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068128 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068131 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068134 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068136 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068138 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068141 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068144 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068146 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068149 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068151 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068154 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068156 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068159 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068162 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068164 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068166 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068169 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068173 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.077912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068176 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068179 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068182 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068186 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068189 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068192 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068195 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068198 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068201 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068203 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068206 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068209 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068211 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068215 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068218 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068220 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068223 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068225 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068228 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.078426 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068230 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068233 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068235 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068238 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068240 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068243 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068245 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068248 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068250 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068253 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068255 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068258 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068262 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068266 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068270 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068272 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068275 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068278 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068281 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.078879 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068284 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068286 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068289 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.068291 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.068923 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.076188 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.076206 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.076946 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.076954 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077025 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077031 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077036 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077040 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077043 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.079361 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077047 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077050 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077052 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077055 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077058 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077060 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077063 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077065 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077068 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077071 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077073 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077077 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077079 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077082 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077084 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077087 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077090 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077092 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077095 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077097 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.079731 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077100 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077102 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077105 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077108 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077111 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077113 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077116 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077119 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077121 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077124 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077126 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077129 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077131 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077134 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077136 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077139 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077141 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077144 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077146 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077149 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.080216 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077151 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077154 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077156 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077162 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077170 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077174 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077178 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077180 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077183 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077185 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077188 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077190 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077192 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077195 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077197 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077200 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077203 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077206 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077208 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077211 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.080712 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077213 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077215 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077218 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077222 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077225 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077228 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077231 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077234 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077236 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077239 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077242 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077245 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077248 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077250 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077253 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077256 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077258 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077267 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.081195 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077269 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077272 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077274 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077284 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077287 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077290 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077292 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077295 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077297 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077300 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077303 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077306 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077308 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077311 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077313 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.081681 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077316 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.077321 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077474 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077479 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077482 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077485 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077488 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077490 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077493 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077495 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077498 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077501 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077504 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077506 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077508 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:26.082051 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077511 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077513 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077524 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077527 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077529 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077532 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077535 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077537 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077540 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077542 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077545 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077547 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077550 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077552 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077555 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077557 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077560 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077562 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077565 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077567 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:26.082635 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077569 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077572 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077574 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077576 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077579 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077581 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077584 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077588 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077590 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077594 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077597 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077600 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077603 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077605 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077608 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077616 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077619 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077622 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077624 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:26.083153 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077627 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077629 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077631 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077634 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077636 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077639 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077642 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077644 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077647 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077649 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077652 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077654 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077656 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077659 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077661 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077664 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077666 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077669 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077671 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077674 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:26.083631 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077676 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077678 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077680 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077683 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077685 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077688 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077690 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077693 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077695 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077704 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077707 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077709 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077712 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077714 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077716 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077719 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077721 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077724 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077727 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:26.084124 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077730 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077732 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077735 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077739 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077742 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077744 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077747 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:26.077750 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.077755 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.077866 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.080036 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.081484 2583 server.go:1019] "Starting client certificate rotation" Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.081588 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:26.084584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.081623 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:26.084915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.083977 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:26.085683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.085618 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:26.094509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.094492 2583 log.go:25] "Validated CRI v1 runtime API" Jun 10 00:35:26.096850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.096834 2583 log.go:25] "Validated CRI v1 image API" Jun 10 00:35:26.097715 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.097702 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 00:35:26.101749 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.101729 2583 fs.go:135] Filesystem UUIDs: map[2324324c-66c5-482d-a062-4b2214bd98f7:/dev/nvme0n1p3 7551ad04-4007-4281-b576-0fe28d7f457f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 00:35:26.101804 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.101749 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 00:35:26.106065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.105956 2583 manager.go:216] Machine: {Timestamp:2026-06-10 00:35:26.10546427 +0000 UTC m=+0.312436150 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3177686 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2746bd500d04b0afa6a12632fdc681 SystemUUID:ec2746bd-500d-04b0-afa6-a12632fdc681 BootID:5208aa17-c49a-4ae0-9fba-80da6c0a405a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:76:a1:bb:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:76:a1:bb:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:85:a6:5e:ef:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 00:35:26.106065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.106064 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 00:35:26.106170 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.106163 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 00:35:26.108759 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.108732 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 00:35:26.108904 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.108762 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 00:35:26.109467 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.109457 2583 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 00:35:26.109500 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.109471 2583 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 00:35:26.109500 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.109478 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:26.110144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.110135 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:26.110889 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.110873 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:26.110920 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.110889 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 00:35:26.113476 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113463 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:26.113600 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113591 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 00:35:26.113635 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113625 2583 kubelet.go:486] "Attempting to sync node with API server" Jun 10 00:35:26.113663 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113638 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 00:35:26.113663 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113653 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 00:35:26.113663 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113663 2583 kubelet.go:398] "Adding apiserver pod source" Jun 10 00:35:26.113757 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.113672 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 00:35:26.114064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.114052 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:26.114104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.114073 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:26.116309 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.116293 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 00:35:26.117589 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.117576 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 00:35:26.117628 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.117606 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 00:35:26.118845 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118834 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 00:35:26.118877 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118855 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 00:35:26.118877 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118862 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 00:35:26.118877 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118867 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 00:35:26.118877 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118876 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118882 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118890 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118895 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118902 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118907 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118915 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118920 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118946 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 00:35:26.118991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.118951 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 00:35:26.122057 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.122045 2583 server.go:1268] "Started kubelet" Jun 10 00:35:26.125428 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.125057 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 00:35:26.125899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.122142 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 00:35:26.125969 ip-10-0-141-5 systemd[1]: Started Kubernetes Kubelet. Jun 10 00:35:26.126538 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.126084 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 00:35:26.128977 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.127765 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 00:35:26.128977 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.128160 2583 server.go:310] "Adding debug handlers to kubelet server" Jun 10 00:35:26.130241 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.130220 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm2mz" Jun 10 00:35:26.130517 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.130481 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 00:35:26.130608 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.130576 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 00:35:26.130656 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.130612 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 00:35:26.131344 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.130456 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-5.ec2.internal.18b7911bc6196c55 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-5.ec2.internal,UID:ip-10-0-141-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-5.ec2.internal,},FirstTimestamp:2026-06-10 00:35:26.122019925 +0000 UTC m=+0.328991858,LastTimestamp:2026-06-10 00:35:26.122019925 +0000 UTC m=+0.328991858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-5.ec2.internal,}" Jun 10 00:35:26.133762 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.133743 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 00:35:26.133854 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.133811 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 00:35:26.133915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.133890 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:26.134190 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.134100 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.134668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.134487 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 00:35:26.134668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.134489 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 00:35:26.134668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.134512 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 00:35:26.135577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.135426 2583 reconstruct.go:97] "Volume reconstruction finished" Jun 10 00:35:26.135577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.135575 2583 reconciler.go:29] "Reconciler: start to sync state" Jun 10 00:35:26.136693 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136588 2583 factory.go:153] Registering CRI-O factory Jun 10 00:35:26.136693 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136604 2583 factory.go:223] Registration of the crio container factory successfully Jun 10 00:35:26.137017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136702 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 00:35:26.137017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136712 2583 factory.go:55] Registering systemd factory Jun 10 00:35:26.137017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136720 2583 factory.go:223] Registration of the systemd container factory successfully Jun 10 00:35:26.137017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136752 2583 factory.go:103] Registering Raw factory Jun 10 00:35:26.137017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.136767 2583 manager.go:1196] Started watching for new ooms in manager Jun 10 00:35:26.137296 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.137198 2583 manager.go:349] Starting recovery of all containers Jun 10 00:35:26.137999 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.137973 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 00:35:26.138107 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.138084 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 00:35:26.138308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.138291 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm2mz" Jun 10 00:35:26.142091 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.142048 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 00:35:26.146917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.146901 2583 manager.go:354] Recovery completed Jun 10 00:35:26.148629 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.148529 2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 00:35:26.151497 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.151484 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.153899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.153885 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.153951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.153915 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.153951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.153928 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.154443 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.154427 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 00:35:26.154443 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.154440 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 00:35:26.154575 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.154457 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:26.154575 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.154429 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.155172 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155157 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.155235 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155187 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.155235 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155202 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.155497 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155482 2583 policy_none.go:49] "None policy: Start" Jun 10 00:35:26.155555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155500 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 00:35:26.155555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.155510 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 00:35:26.156312 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.156236 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-5.ec2.internal.18b7911bc7ffde7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-5.ec2.internal,UID:ip-10-0-141-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-5.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-5.ec2.internal,},FirstTimestamp:2026-06-10 00:35:26.153899645 +0000 UTC m=+0.360871524,LastTimestamp:2026-06-10 00:35:26.153899645 +0000 UTC m=+0.360871524,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-5.ec2.internal,}" Jun 10 00:35:26.156437 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.156424 2583 policy_none.go:47] "Start" Jun 10 00:35:26.195065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195048 2583 manager.go:337] "Starting Device Plugin manager" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.195084 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195094 2583 server.go:87] "Starting device plugin registration server" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195324 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195337 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195442 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195527 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.195538 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.196089 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.196141 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.204774 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.204807 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.204826 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 00:35:26.205009 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.204861 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 00:35:26.206483 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.206468 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:26.296202 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.296169 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.297143 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.297122 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.297213 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.297165 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.297213 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.297176 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.297213 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.297200 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.304437 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.304422 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.304480 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.304445 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-5.ec2.internal\": node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.305783 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.305767 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal"] Jun 10 00:35:26.305841 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.305831 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.307182 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.307168 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.307237 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.307194 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.307237 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.307205 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.308376 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.308363 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.308514 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.308485 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.308553 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.308535 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.309053 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309038 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.309121 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309063 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.309121 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309074 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.309515 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309475 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.309515 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309503 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.309515 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.309515 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.310535 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.310521 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.310578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.310548 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:26.311221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.311207 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:26.311265 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.311235 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:26.311265 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.311245 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:26.317885 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.317870 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.329007 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.328986 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-5.ec2.internal\" not found" node="ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.335057 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.335041 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-5.ec2.internal\" not found" node="ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.336064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.336048 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.336111 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.336072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.336111 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.336092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d33387642d531998c39a007c9f865a02-config\") pod \"kube-apiserver-proxy-ip-10-0-141-5.ec2.internal\" (UID: \"d33387642d531998c39a007c9f865a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.418704 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.418677 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.436326 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.436418 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436331 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.436418 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d33387642d531998c39a007c9f865a02-config\") pod \"kube-apiserver-proxy-ip-10-0-141-5.ec2.internal\" (UID: \"d33387642d531998c39a007c9f865a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.436418 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436385 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d33387642d531998c39a007c9f865a02-config\") pod \"kube-apiserver-proxy-ip-10-0-141-5.ec2.internal\" (UID: \"d33387642d531998c39a007c9f865a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.436526 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436437 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.436526 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.436437 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/161cad3abe823b42b81e68d59dd81010-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal\" (UID: \"161cad3abe823b42b81e68d59dd81010\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.519379 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.519346 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.620155 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.620084 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.632268 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.632240 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.639183 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.639163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:26.720915 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.720873 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.821384 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.821347 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.921973 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:26.921895 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:26.990639 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:26.990612 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:27.022028 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:27.022002 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:27.080572 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.080525 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 00:35:27.081209 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.080673 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:27.081209 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.080705 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:27.122981 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:27.122945 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-5.ec2.internal\" not found" Jun 10 00:35:27.141465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.141434 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:30:26 +0000 UTC" deadline="2028-02-02 18:19:57.799041904 +0000 UTC" Jun 10 00:35:27.141465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.141462 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14465h44m30.657583275s" Jun 10 00:35:27.178660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.178601 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:27.234070 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.234039 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" Jun 10 00:35:27.245545 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.245523 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:27.246370 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.246355 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" Jun 10 00:35:27.252423 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:27.252375 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161cad3abe823b42b81e68d59dd81010.slice/crio-951ae0dcd307476a2afa015910a932532db7557fb63014796fefc97b60cc10a5 WatchSource:0}: Error finding container 951ae0dcd307476a2afa015910a932532db7557fb63014796fefc97b60cc10a5: Status 404 returned error can't find the container with id 951ae0dcd307476a2afa015910a932532db7557fb63014796fefc97b60cc10a5 Jun 10 00:35:27.252801 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:27.252778 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33387642d531998c39a007c9f865a02.slice/crio-d36c2eeb41b9b34a3668e821ef93d8d6aa57708bd3db2e4c7e8af3bd0d815b59 WatchSource:0}: Error finding container d36c2eeb41b9b34a3668e821ef93d8d6aa57708bd3db2e4c7e8af3bd0d815b59: Status 404 returned error can't find the container with id d36c2eeb41b9b34a3668e821ef93d8d6aa57708bd3db2e4c7e8af3bd0d815b59 Jun 10 00:35:27.256089 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.256072 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:27.258981 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.258963 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:35:27.445344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:27.445265 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:28.115753 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.115707 2583 apiserver.go:52] "Watching apiserver" Jun 10 00:35:28.124726 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.124692 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 00:35:28.125434 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.125031 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-8wnlj","openshift-network-operator/iptables-alerter-8clrl","openshift-ovn-kubernetes/ovnkube-node-8ps7l","kube-system/global-pull-secret-syncer-8w9cf","kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s","openshift-dns/node-resolver-h75v9","openshift-image-registry/node-ca-bk27l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal","kube-system/konnectivity-agent-mt8fh","openshift-cluster-node-tuning-operator/tuned-dcc7s","openshift-multus/multus-additional-cni-plugins-fs4k5","openshift-multus/multus-qsl68","openshift-multus/network-metrics-daemon-mkrmd"] Jun 10 00:35:28.127821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.127319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.129069 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.128804 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.130186 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.130159 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.130317 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.130303 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.130514 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.130500 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2jz9r\"" Jun 10 00:35:28.132434 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.132409 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.132513 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.132472 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.132513 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.132496 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qmb8\"" Jun 10 00:35:28.132893 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.132878 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.134842 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.134729 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.134842 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.134767 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:28.134842 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.134803 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:28.135469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.135445 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 00:35:28.135565 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.135472 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 00:35:28.135565 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.135495 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g8468\"" Jun 10 00:35:28.135565 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.135522 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 00:35:28.137344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.136887 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.137344 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.136948 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:28.137344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.137283 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 00:35:28.137517 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.137491 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.137517 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.137504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.138955 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.138934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.140642 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.140621 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.141520 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.141499 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.142064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.142043 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 00:35:28.142064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.142050 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-drtgv\"" Jun 10 00:35:28.142237 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.142216 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.144488 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.144706 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bfh8p\"" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.144864 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145059 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-script-lib\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145547 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphjw\" (UniqueName: \"kubernetes.io/projected/f94943c1-6986-406d-a1dc-cdb4fe06f609-kube-api-access-wphjw\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-systemd\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-run\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-sys\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145632 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-etc-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145658 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-log-socket\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145682 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-bin\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145708 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94943c1-6986-406d-a1dc-cdb4fe06f609-tmp-dir\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgfsn\" (UniqueName: \"kubernetes.io/projected/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-kube-api-access-rgfsn\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145758 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-systemd-units\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145817 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-netd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145844 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145873 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbd8m\" (UniqueName: \"kubernetes.io/projected/3d3a990c-5e07-4449-97ac-3e231d963168-kube-api-access-zbd8m\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.145903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145924 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.145967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94943c1-6986-406d-a1dc-cdb4fe06f609-hosts-file\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146350 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146381 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-var-lib-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-env-overrides\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-kubernetes\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146884 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-lib-modules\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146898 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-host\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-ovn\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146929 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-var-lib-kubelet\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-tuned\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146960 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-kubelet-config\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.146999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-modprobe-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-conf\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147042 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-systemd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-dbus\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.147192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-kubelet\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-netns\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-config\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d3a990c-5e07-4449-97ac-3e231d963168-ovn-node-metrics-cert\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysconfig\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147286 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-tmp\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147313 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-slash\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.147914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.147334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-node-log\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.150852 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.150830 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:28.151192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.151174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.153772 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.153749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.154144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.154090 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 00:35:28.154144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.154107 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z7khh\"" Jun 10 00:35:28.154271 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.154230 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.154318 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.154270 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 00:35:28.154998 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.154560 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.155761 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.155744 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.156404 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.156341 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:28.156798 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.156776 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:28.156905 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.156883 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b64m5\"" Jun 10 00:35:28.157630 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.157615 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 00:35:28.157987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.157973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:28.158164 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.158135 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:28.158571 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.158555 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4wzk\"" Jun 10 00:35:28.158660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.158559 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 00:35:28.158660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.158642 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 00:35:28.160328 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.160309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.162777 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.162758 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 00:35:28.163143 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.163121 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 00:35:28.163468 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.163441 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cgwlj\"" Jun 10 00:35:28.169951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.169933 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpp8l" Jun 10 00:35:28.177604 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.177582 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rpp8l" Jun 10 00:35:28.210204 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.210157 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" event={"ID":"d33387642d531998c39a007c9f865a02","Type":"ContainerStarted","Data":"d36c2eeb41b9b34a3668e821ef93d8d6aa57708bd3db2e4c7e8af3bd0d815b59"} Jun 10 00:35:28.211195 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.211173 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" event={"ID":"161cad3abe823b42b81e68d59dd81010","Type":"ContainerStarted","Data":"951ae0dcd307476a2afa015910a932532db7557fb63014796fefc97b60cc10a5"} Jun 10 00:35:28.236431 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.236410 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 00:35:28.247970 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.247938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.247986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-conf-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-registration-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.248118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248038 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-sys-fs\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.248118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248034 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248087 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-hostroot\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248139 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-conf\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-systemd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-dbus\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248220 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-cnibin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248235 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-systemd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-k8s-cni-cncf-io\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-conf\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248381 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-dbus\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248423 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5846d3bd-03bf-4ccb-ac74-e08368e6f811-host-slash\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.248448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-netns\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248479 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d3a990c-5e07-4449-97ac-3e231d963168-ovn-node-metrics-cert\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-netns\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248509 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-run-netns\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248524 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-multus\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248536 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-binary-copy\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248648 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxwh\" (UniqueName: \"kubernetes.io/projected/c6479644-4443-4a98-95f8-fea58335c6e4-kube-api-access-frxwh\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysconfig\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248678 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-slash\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-script-lib\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248708 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-etc-kubernetes\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248742 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-slash\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248775 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysconfig\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-systemd\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.248898 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248827 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-sys\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-etc-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248895 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-etc-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248895 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-systemd\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248911 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-sys\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248892 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-bin\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-netd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248968 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-bin\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.248981 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249004 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-cni-netd\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249008 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgfsn\" (UniqueName: \"kubernetes.io/projected/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-kube-api-access-rgfsn\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-os-release\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pfm8\" (UniqueName: \"kubernetes.io/projected/cc9615dd-b766-4a43-bf62-99473e41d097-kube-api-access-2pfm8\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6479644-4443-4a98-95f8-fea58335c6e4-serviceca\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.249743 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249145 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxgs\" (UniqueName: \"kubernetes.io/projected/3f6b6758-ed28-484a-99d9-5c35937a3647-kube-api-access-zjxgs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-os-release\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249200 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5846d3bd-03bf-4ccb-ac74-e08368e6f811-iptables-alerter-script\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249228 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/607ea609-dc38-43cc-ba39-cb301b759443-konnectivity-ca\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249278 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-kubernetes\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-host\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249305 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-script-lib\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-var-lib-kubelet\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-kubernetes\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-kubelet-config\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249356 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-sysctl-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-cni-binary-copy\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249407 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/76c7076b-a42c-407a-ae30-f057b438529e-kubelet-config\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249412 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-var-lib-kubelet\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7xr6\" (UniqueName: \"kubernetes.io/projected/4e7560d9-7bd3-46ec-a064-823123b6e105-kube-api-access-k7xr6\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249381 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-host\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.250555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249453 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-modprobe-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249478 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-kubelet\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249498 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/607ea609-dc38-43cc-ba39-cb301b759443-agent-certs\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-kubelet\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249541 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-modprobe-d\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249548 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-config\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-cnibin\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249574 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-kubelet\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249588 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdt8\" (UniqueName: \"kubernetes.io/projected/149a7194-c82c-4d12-a165-c8dcb4bd8561-kube-api-access-mbdt8\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249607 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-device-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249704 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2tk\" (UniqueName: \"kubernetes.io/projected/5846d3bd-03bf-4ccb-ac74-e08368e6f811-kube-api-access-jp2tk\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-tmp\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249757 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-node-log\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-multus-certs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249800 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-node-log\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249821 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphjw\" (UniqueName: \"kubernetes.io/projected/f94943c1-6986-406d-a1dc-cdb4fe06f609-kube-api-access-wphjw\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.251324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.249875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-run\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250055 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-ovnkube-config\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-log-socket\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250119 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250140 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250145 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-run\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-system-cni-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250190 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94943c1-6986-406d-a1dc-cdb4fe06f609-tmp-dir\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250235 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-log-socket\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-systemd-units\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbd8m\" (UniqueName: \"kubernetes.io/projected/3d3a990c-5e07-4449-97ac-3e231d963168-kube-api-access-zbd8m\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-system-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250311 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-socket-dir-parent\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.252062 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.250340 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-bin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6479644-4443-4a98-95f8-fea58335c6e4-host\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.250428 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:28.750408858 +0000 UTC m=+2.957380737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250525 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-systemd-units\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94943c1-6986-406d-a1dc-cdb4fe06f609-hosts-file\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-var-lib-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-env-overrides\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250634 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f94943c1-6986-406d-a1dc-cdb4fe06f609-hosts-file\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250654 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-daemon-config\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250676 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-socket-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-lib-modules\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-ovn\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-tuned\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250769 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94943c1-6986-406d-a1dc-cdb4fe06f609-tmp-dir\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.250956 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.251026 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d3a990c-5e07-4449-97ac-3e231d963168-env-overrides\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.252850 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.251072 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-var-lib-openvswitch\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.253809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.251162 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-lib-modules\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.253809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.251184 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d3a990c-5e07-4449-97ac-3e231d963168-run-ovn\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.253809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.252629 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d3a990c-5e07-4449-97ac-3e231d963168-ovn-node-metrics-cert\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.253809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.253244 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-etc-tuned\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.255514 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.255495 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-tmp\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.258228 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.258181 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgfsn\" (UniqueName: \"kubernetes.io/projected/daf25c9c-2a0d-469a-9b28-633d6a2eee6d-kube-api-access-rgfsn\") pod \"tuned-dcc7s\" (UID: \"daf25c9c-2a0d-469a-9b28-633d6a2eee6d\") " pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.261221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.261199 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphjw\" (UniqueName: \"kubernetes.io/projected/f94943c1-6986-406d-a1dc-cdb4fe06f609-kube-api-access-wphjw\") pod \"node-resolver-h75v9\" (UID: \"f94943c1-6986-406d-a1dc-cdb4fe06f609\") " pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.261737 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.261714 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbd8m\" (UniqueName: \"kubernetes.io/projected/3d3a990c-5e07-4449-97ac-3e231d963168-kube-api-access-zbd8m\") pod \"ovnkube-node-8ps7l\" (UID: \"3d3a990c-5e07-4449-97ac-3e231d963168\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.351733 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351702 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxgs\" (UniqueName: \"kubernetes.io/projected/3f6b6758-ed28-484a-99d9-5c35937a3647-kube-api-access-zjxgs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.351733 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-os-release\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351756 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5846d3bd-03bf-4ccb-ac74-e08368e6f811-iptables-alerter-script\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/607ea609-dc38-43cc-ba39-cb301b759443-konnectivity-ca\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-cni-binary-copy\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7xr6\" (UniqueName: \"kubernetes.io/projected/4e7560d9-7bd3-46ec-a064-823123b6e105-kube-api-access-k7xr6\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-kubelet\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351861 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-os-release\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351874 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/607ea609-dc38-43cc-ba39-cb301b759443-agent-certs\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-cnibin\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351934 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdt8\" (UniqueName: \"kubernetes.io/projected/149a7194-c82c-4d12-a165-c8dcb4bd8561-kube-api-access-mbdt8\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351956 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-device-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.351972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.351977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2tk\" (UniqueName: \"kubernetes.io/projected/5846d3bd-03bf-4ccb-ac74-e08368e6f811-kube-api-access-jp2tk\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352048 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-kubelet\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-multus-certs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352448 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-system-cni-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-system-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352541 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5846d3bd-03bf-4ccb-ac74-e08368e6f811-iptables-alerter-script\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352584 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-multus-certs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352385 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-cni-binary-copy\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352773 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-system-cni-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352815 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352817 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-cnibin\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.352934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352875 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-system-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352544 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-cni-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.352992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-socket-dir-parent\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353019 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-bin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6479644-4443-4a98-95f8-fea58335c6e4-host\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-daemon-config\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353092 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/607ea609-dc38-43cc-ba39-cb301b759443-konnectivity-ca\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-socket-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353132 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-conf-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-registration-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6479644-4443-4a98-95f8-fea58335c6e4-host\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-sys-fs\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-hostroot\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353218 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e7560d9-7bd3-46ec-a064-823123b6e105-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353234 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-cnibin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353231 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-socket-dir-parent\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353276 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-conf-dir\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353077 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-device-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353283 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-bin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353311 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-hostroot\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-k8s-cni-cncf-io\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353359 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-cnibin\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353346 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-sys-fs\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353373 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5846d3bd-03bf-4ccb-ac74-e08368e6f811-host-slash\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353370 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-socket-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-k8s-cni-cncf-io\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353430 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-netns\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353437 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-registration-dir\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353444 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5846d3bd-03bf-4ccb-ac74-e08368e6f811-host-slash\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353479 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-run-netns\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-multus\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353527 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-host-var-lib-cni-multus\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-binary-copy\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.353963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxwh\" (UniqueName: \"kubernetes.io/projected/c6479644-4443-4a98-95f8-fea58335c6e4-kube-api-access-frxwh\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-etc-kubernetes\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353605 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-os-release\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353679 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353671 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-etc-kubernetes\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pfm8\" (UniqueName: \"kubernetes.io/projected/cc9615dd-b766-4a43-bf62-99473e41d097-kube-api-access-2pfm8\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6479644-4443-4a98-95f8-fea58335c6e4-serviceca\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353910 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f6b6758-ed28-484a-99d9-5c35937a3647-multus-daemon-config\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.353919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc9615dd-b766-4a43-bf62-99473e41d097-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.354006 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f6b6758-ed28-484a-99d9-5c35937a3647-os-release\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.354044 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-binary-copy\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.354099 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.354128 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6479644-4443-4a98-95f8-fea58335c6e4-serviceca\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.354155 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:28.854136957 +0000 UTC m=+3.061108838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:28.354840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.354337 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.355651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.354497 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e7560d9-7bd3-46ec-a064-823123b6e105-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.355651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.355055 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/607ea609-dc38-43cc-ba39-cb301b759443-agent-certs\") pod \"konnectivity-agent-mt8fh\" (UID: \"607ea609-dc38-43cc-ba39-cb301b759443\") " pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.364633 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.364612 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxgs\" (UniqueName: \"kubernetes.io/projected/3f6b6758-ed28-484a-99d9-5c35937a3647-kube-api-access-zjxgs\") pod \"multus-qsl68\" (UID: \"3f6b6758-ed28-484a-99d9-5c35937a3647\") " pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.364984 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.364885 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:28.364984 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.364909 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:28.364984 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.364922 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:28.364984 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.364979 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:28.864960472 +0000 UTC m=+3.071932354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:28.365643 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.365608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2tk\" (UniqueName: \"kubernetes.io/projected/5846d3bd-03bf-4ccb-ac74-e08368e6f811-kube-api-access-jp2tk\") pod \"iptables-alerter-8clrl\" (UID: \"5846d3bd-03bf-4ccb-ac74-e08368e6f811\") " pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.366075 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.366026 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7xr6\" (UniqueName: \"kubernetes.io/projected/4e7560d9-7bd3-46ec-a064-823123b6e105-kube-api-access-k7xr6\") pod \"multus-additional-cni-plugins-fs4k5\" (UID: \"4e7560d9-7bd3-46ec-a064-823123b6e105\") " pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.367562 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.367542 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxwh\" (UniqueName: \"kubernetes.io/projected/c6479644-4443-4a98-95f8-fea58335c6e4-kube-api-access-frxwh\") pod \"node-ca-bk27l\" (UID: \"c6479644-4443-4a98-95f8-fea58335c6e4\") " pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.367833 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.367815 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pfm8\" (UniqueName: \"kubernetes.io/projected/cc9615dd-b766-4a43-bf62-99473e41d097-kube-api-access-2pfm8\") pod \"aws-ebs-csi-driver-node-6x57s\" (UID: \"cc9615dd-b766-4a43-bf62-99473e41d097\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.368307 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.368290 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdt8\" (UniqueName: \"kubernetes.io/projected/149a7194-c82c-4d12-a165-c8dcb4bd8561-kube-api-access-mbdt8\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.442088 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.442050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h75v9" Jun 10 00:35:28.450491 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.450469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" Jun 10 00:35:28.460162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.460142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:28.466822 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.466800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" Jun 10 00:35:28.474365 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.474343 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk27l" Jun 10 00:35:28.482862 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.482840 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsl68" Jun 10 00:35:28.490464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.490443 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8clrl" Jun 10 00:35:28.498079 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.498060 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:28.504562 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.504543 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" Jun 10 00:35:28.755722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.755643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:28.755882 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.755750 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:28.755882 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.755807 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:29.755792851 +0000 UTC m=+3.962764718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:28.856768 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.856738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:28.857631 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.857264 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:28.857631 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.857371 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:29.857330673 +0000 UTC m=+4.064302553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:28.957704 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:28.957662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:28.957880 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.957845 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:28.957880 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.957871 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:28.957988 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.957884 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:28.957988 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:28.957947 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:29.957927738 +0000 UTC m=+4.164899623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:29.180845 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.180752 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:28 +0000 UTC" deadline="2028-02-11 07:48:21.780920368 +0000 UTC" Jun 10 00:35:29.180845 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.180798 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14671h12m52.60012517s" Jun 10 00:35:29.205270 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.205230 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:29.205433 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.205345 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:29.339511 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.339273 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3a990c_5e07_4449_97ac_3e231d963168.slice/crio-e1afb9f145e12ef3672f79867836727b3c9ee61fdeddf3329b0bce06d32b65c5 WatchSource:0}: Error finding container e1afb9f145e12ef3672f79867836727b3c9ee61fdeddf3329b0bce06d32b65c5: Status 404 returned error can't find the container with id e1afb9f145e12ef3672f79867836727b3c9ee61fdeddf3329b0bce06d32b65c5 Jun 10 00:35:29.342255 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.342227 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9615dd_b766_4a43_bf62_99473e41d097.slice/crio-adc3f35afb42d3c46759ea3cb1146cbf664eeec0da5453b965a3479d941abbcf WatchSource:0}: Error finding container adc3f35afb42d3c46759ea3cb1146cbf664eeec0da5453b965a3479d941abbcf: Status 404 returned error can't find the container with id adc3f35afb42d3c46759ea3cb1146cbf664eeec0da5453b965a3479d941abbcf Jun 10 00:35:29.345528 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.345481 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607ea609_dc38_43cc_ba39_cb301b759443.slice/crio-12a051fb9fdf591551af5e86c48fe8c53df51e152bd04e5971f57d4ab7a84652 WatchSource:0}: Error finding container 12a051fb9fdf591551af5e86c48fe8c53df51e152bd04e5971f57d4ab7a84652: Status 404 returned error can't find the container with id 12a051fb9fdf591551af5e86c48fe8c53df51e152bd04e5971f57d4ab7a84652 Jun 10 00:35:29.346850 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.346727 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6b6758_ed28_484a_99d9_5c35937a3647.slice/crio-c7fcab439d2639caf9dc6fd5a4a4c18ca1dba90a449f04a76696095638e7303f WatchSource:0}: Error finding container c7fcab439d2639caf9dc6fd5a4a4c18ca1dba90a449f04a76696095638e7303f: Status 404 returned error can't find the container with id c7fcab439d2639caf9dc6fd5a4a4c18ca1dba90a449f04a76696095638e7303f Jun 10 00:35:29.347912 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.347784 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5846d3bd_03bf_4ccb_ac74_e08368e6f811.slice/crio-9d4baf4321ba54193df86bdfbfe1a6cb38dd8859d4a8611eae9a125910d2b8d2 WatchSource:0}: Error finding container 9d4baf4321ba54193df86bdfbfe1a6cb38dd8859d4a8611eae9a125910d2b8d2: Status 404 returned error can't find the container with id 9d4baf4321ba54193df86bdfbfe1a6cb38dd8859d4a8611eae9a125910d2b8d2 Jun 10 00:35:29.348997 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.348977 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94943c1_6986_406d_a1dc_cdb4fe06f609.slice/crio-3616d8660d8cec9c57260599ebacee41620dc393eabf2fa82ac9c90548e5f87f WatchSource:0}: Error finding container 3616d8660d8cec9c57260599ebacee41620dc393eabf2fa82ac9c90548e5f87f: Status 404 returned error can't find the container with id 3616d8660d8cec9c57260599ebacee41620dc393eabf2fa82ac9c90548e5f87f Jun 10 00:35:29.351233 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.351097 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7560d9_7bd3_46ec_a064_823123b6e105.slice/crio-7b72cc9f160216266cedf19a97d7015dceb01e4d628beab8c21927b6ceee495b WatchSource:0}: Error finding container 7b72cc9f160216266cedf19a97d7015dceb01e4d628beab8c21927b6ceee495b: Status 404 returned error can't find the container with id 7b72cc9f160216266cedf19a97d7015dceb01e4d628beab8c21927b6ceee495b Jun 10 00:35:29.351566 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.351544 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf25c9c_2a0d_469a_9b28_633d6a2eee6d.slice/crio-91fabf6e73d49c37590ac694fdaa18d272f036fc07ecd53868ffff364940bd4a WatchSource:0}: Error finding container 91fabf6e73d49c37590ac694fdaa18d272f036fc07ecd53868ffff364940bd4a: Status 404 returned error can't find the container with id 91fabf6e73d49c37590ac694fdaa18d272f036fc07ecd53868ffff364940bd4a Jun 10 00:35:29.352687 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:35:29.352667 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6479644_4443_4a98_95f8_fea58335c6e4.slice/crio-f0453cc2c779dc59804c78b77c9a5a387ffddc814859f158e7df511c553ca1f5 WatchSource:0}: Error finding container f0453cc2c779dc59804c78b77c9a5a387ffddc814859f158e7df511c553ca1f5: Status 404 returned error can't find the container with id f0453cc2c779dc59804c78b77c9a5a387ffddc814859f158e7df511c553ca1f5 Jun 10 00:35:29.763754 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.763713 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:29.763931 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.763878 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:29.763991 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.763932 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:31.763918767 +0000 UTC m=+5.970890632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:29.864602 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.864520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:29.864818 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.864800 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:29.864879 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.864871 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:31.864851392 +0000 UTC m=+6.071823264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:29.961649 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.961617 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:29.965943 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:29.965913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:29.966095 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.966079 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:29.966167 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.966102 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:29.966167 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.966114 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:29.966167 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:29.966166 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:31.966149457 +0000 UTC m=+6.173121327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:30.181179 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.181064 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:28 +0000 UTC" deadline="2027-12-04 03:15:55.300786109 +0000 UTC" Jun 10 00:35:30.181179 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.181134 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13010h40m25.119658445s" Jun 10 00:35:30.207061 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.206510 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:30.207061 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:30.206711 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:30.207572 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.207342 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:30.207572 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:30.207457 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:30.232792 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.232754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk27l" event={"ID":"c6479644-4443-4a98-95f8-fea58335c6e4","Type":"ContainerStarted","Data":"f0453cc2c779dc59804c78b77c9a5a387ffddc814859f158e7df511c553ca1f5"} Jun 10 00:35:30.236338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.236199 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" event={"ID":"daf25c9c-2a0d-469a-9b28-633d6a2eee6d","Type":"ContainerStarted","Data":"91fabf6e73d49c37590ac694fdaa18d272f036fc07ecd53868ffff364940bd4a"} Jun 10 00:35:30.243728 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.243691 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerStarted","Data":"7b72cc9f160216266cedf19a97d7015dceb01e4d628beab8c21927b6ceee495b"} Jun 10 00:35:30.254701 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.254666 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8clrl" event={"ID":"5846d3bd-03bf-4ccb-ac74-e08368e6f811","Type":"ContainerStarted","Data":"9d4baf4321ba54193df86bdfbfe1a6cb38dd8859d4a8611eae9a125910d2b8d2"} Jun 10 00:35:30.262115 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.262030 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" event={"ID":"cc9615dd-b766-4a43-bf62-99473e41d097","Type":"ContainerStarted","Data":"adc3f35afb42d3c46759ea3cb1146cbf664eeec0da5453b965a3479d941abbcf"} Jun 10 00:35:30.288006 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.287457 2583 generic.go:356] "Generic (PLEG): container finished" podID="161cad3abe823b42b81e68d59dd81010" containerID="2ce01d05731b8a8f585c80342d5632f5d2ddb963ffa65a9a86a7c7158c48c7b5" exitCode=0 Jun 10 00:35:30.288006 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.287614 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" event={"ID":"161cad3abe823b42b81e68d59dd81010","Type":"ContainerDied","Data":"2ce01d05731b8a8f585c80342d5632f5d2ddb963ffa65a9a86a7c7158c48c7b5"} Jun 10 00:35:30.295732 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.295701 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h75v9" event={"ID":"f94943c1-6986-406d-a1dc-cdb4fe06f609","Type":"ContainerStarted","Data":"3616d8660d8cec9c57260599ebacee41620dc393eabf2fa82ac9c90548e5f87f"} Jun 10 00:35:30.300071 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.300042 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsl68" event={"ID":"3f6b6758-ed28-484a-99d9-5c35937a3647","Type":"ContainerStarted","Data":"c7fcab439d2639caf9dc6fd5a4a4c18ca1dba90a449f04a76696095638e7303f"} Jun 10 00:35:30.307596 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.307571 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mt8fh" event={"ID":"607ea609-dc38-43cc-ba39-cb301b759443","Type":"ContainerStarted","Data":"12a051fb9fdf591551af5e86c48fe8c53df51e152bd04e5971f57d4ab7a84652"} Jun 10 00:35:30.318677 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.315344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"e1afb9f145e12ef3672f79867836727b3c9ee61fdeddf3329b0bce06d32b65c5"} Jun 10 00:35:30.330170 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:30.330138 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" event={"ID":"d33387642d531998c39a007c9f865a02","Type":"ContainerStarted","Data":"792144c4ac55ff5005f0d51a90bb6fcc1235fdf0b7f6355ca126e57f69c26d56"} Jun 10 00:35:31.205970 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.205937 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:31.206452 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.206069 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:31.356755 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.356442 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" event={"ID":"161cad3abe823b42b81e68d59dd81010","Type":"ContainerStarted","Data":"519eb0f7b466a89e3a50b7f87270fca36d29a46af50e68ac05b497c36115daf2"} Jun 10 00:35:31.374603 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.374545 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-5.ec2.internal" podStartSLOduration=4.374524679 podStartE2EDuration="4.374524679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:30.347435751 +0000 UTC m=+4.554407652" watchObservedRunningTime="2026-06-10 00:35:31.374524679 +0000 UTC m=+5.581496563" Jun 10 00:35:31.781121 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.781037 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:31.781357 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.781204 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:31.781357 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.781275 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:35.781255733 +0000 UTC m=+9.988227614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:31.883094 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.882408 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:31.883094 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.882601 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:31.883094 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.882664 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:35.88264627 +0000 UTC m=+10.089618141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:31.983260 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:31.983222 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:31.983469 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.983445 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:31.983469 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.983466 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:31.983601 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.983480 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:31.983601 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:31.983538 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:35.983519994 +0000 UTC m=+10.190491863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:32.207048 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:32.206506 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:32.207048 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:32.206634 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:32.210139 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:32.207701 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:32.210139 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:32.207863 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:33.205849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:33.205805 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:33.206022 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:33.205944 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:34.205925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:34.205514 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:34.205925 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:34.205647 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:34.205925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:34.205707 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:34.205925 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:34.205831 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:35.205344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:35.205309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:35.205556 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:35.205455 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:35.816473 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:35.816433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:35.816966 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:35.816621 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:35.816966 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:35.816679 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:43.816663436 +0000 UTC m=+18.023635317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:35.917815 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:35.917309 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:35.917815 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:35.917450 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:35.917815 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:35.917518 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:43.917500608 +0000 UTC m=+18.124472482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:36.017807 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:36.017762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:36.017980 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.017954 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:36.017980 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.017980 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:36.018156 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.017991 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:36.018156 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.018056 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:44.018036964 +0000 UTC m=+18.225008844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:36.208821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:36.208689 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:36.213065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:36.213015 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:36.213625 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.213316 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:36.213625 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:36.212724 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:37.205225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:37.205192 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:37.205734 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:37.205338 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:38.210356 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:38.209597 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:38.210356 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:38.209737 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:38.210356 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:38.210137 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:38.210356 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:38.210255 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:39.205282 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:39.205243 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:39.205456 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:39.205408 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:40.207972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:40.207901 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:40.208321 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:40.207905 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:40.208321 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:40.208007 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:40.208321 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:40.208087 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:41.205281 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:41.205229 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:41.205483 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:41.205367 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:42.208126 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:42.208099 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:42.208602 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:42.208230 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:42.208602 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:42.208285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:42.208602 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:42.208377 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:43.205897 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:43.205861 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:43.206079 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:43.205970 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:43.879848 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:43.879801 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:43.880255 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:43.879951 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:43.880255 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:43.880017 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:35:59.880001883 +0000 UTC m=+34.086973763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:43.981023 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:43.980983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:43.981193 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:43.981159 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:43.981257 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:43.981232 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:59.981210605 +0000 UTC m=+34.188182490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:44.082304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:44.082270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:44.082487 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.082455 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:44.082487 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.082476 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:44.082487 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.082487 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:44.082584 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.082544 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:00.082530392 +0000 UTC m=+34.289502271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:44.208291 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:44.208218 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:44.208432 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:44.208218 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:44.208432 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.208314 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:44.208432 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:44.208383 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:45.205807 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:45.205763 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:45.206278 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:45.205891 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:46.208033 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:46.208004 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:46.208459 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:46.208106 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:46.208459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:46.208158 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:46.208459 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:46.208271 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:47.205342 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:47.205293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:47.205536 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:47.205450 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:48.205482 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:48.205446 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:48.205482 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:48.205476 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:48.205948 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:48.205576 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:48.205948 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:48.205688 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:49.205471 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.205075 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:49.205665 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:49.205516 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:49.410427 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.410371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk27l" event={"ID":"c6479644-4443-4a98-95f8-fea58335c6e4","Type":"ContainerStarted","Data":"53d7f6c89e2096acd56a621ee5402a9f85b19653f10a9d147531cf4cfcd0ecd6"} Jun 10 00:35:49.411679 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.411649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" event={"ID":"daf25c9c-2a0d-469a-9b28-633d6a2eee6d","Type":"ContainerStarted","Data":"c56a76b93e975d355b412d28b8c12ea326b27279fefa0443a7a60b9e1dd8b7fd"} Jun 10 00:35:49.413052 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.413026 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="90f92a95ae0ce283858aa8e90bac00ccbc13d236f49f4508a6fa08d2f928a76b" exitCode=0 Jun 10 00:35:49.413157 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.413096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"90f92a95ae0ce283858aa8e90bac00ccbc13d236f49f4508a6fa08d2f928a76b"} Jun 10 00:35:49.414663 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.414644 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" event={"ID":"cc9615dd-b766-4a43-bf62-99473e41d097","Type":"ContainerStarted","Data":"3ca5f251a0c3598c15585c842758af6708d96e25f6104a4293be412459ccc946"} Jun 10 00:35:49.416095 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.416070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h75v9" event={"ID":"f94943c1-6986-406d-a1dc-cdb4fe06f609","Type":"ContainerStarted","Data":"59e5c386a92490d3e7a463becc7b76bd3a965f25b2e90135707789bc4fa89bbc"} Jun 10 00:35:49.417442 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.417421 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsl68" event={"ID":"3f6b6758-ed28-484a-99d9-5c35937a3647","Type":"ContainerStarted","Data":"d24a3d5215741f3bdd0a297362454f582c1e1b8482a7b31f4195797b8471c579"} Jun 10 00:35:49.418830 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.418810 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mt8fh" event={"ID":"607ea609-dc38-43cc-ba39-cb301b759443","Type":"ContainerStarted","Data":"622406cfb4d268f719efe922b08404ead1dbde04739f27bbe42074670d9a4822"} Jun 10 00:35:49.421450 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421433 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:35:49.421746 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421729 2583 generic.go:356] "Generic (PLEG): container finished" podID="3d3a990c-5e07-4449-97ac-3e231d963168" containerID="a8df0060f52f1fedda37d4ab652c75303fc7786a849ef13a788f2fe761935cb1" exitCode=1 Jun 10 00:35:49.421818 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421756 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"696a8bdcd5009713062a9c0efb63f98fd335b6664b8011894b547c7401423a02"} Jun 10 00:35:49.421872 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421820 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"58140bdae072d1b0ccf4d052c9b40357bee0ab174bb61ffe1458f4505ebfecc9"} Jun 10 00:35:49.421929 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421872 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"c88d1a4fc8371978cae022f444e8932f871e9825fefb3308b9505b586d9ef6a4"} Jun 10 00:35:49.421929 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421921 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"ffc3aaa995159b9eabe573951c72f61afd8b45cb5b11baac823606555c22da21"} Jun 10 00:35:49.422029 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.421972 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerDied","Data":"a8df0060f52f1fedda37d4ab652c75303fc7786a849ef13a788f2fe761935cb1"} Jun 10 00:35:49.422029 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.422022 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"2d3d2f1130d694ae257117260ab54b8c4028dbbe48e37d152e9400430be269e0"} Jun 10 00:35:49.430357 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.430317 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bk27l" podStartSLOduration=4.561637614 podStartE2EDuration="23.43030672s" totalImagesPullingTime="18.868669106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:49.429464659 +0000 UTC m=+23.636436546" watchObservedRunningTime="2026-06-10 00:35:49.43030672 +0000 UTC m=+23.637278638" Jun 10 00:35:49.430490 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.430420 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-5.ec2.internal" podStartSLOduration=22.430413031 podStartE2EDuration="22.430413031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:31.375011087 +0000 UTC m=+5.581982977" watchObservedRunningTime="2026-06-10 00:35:49.430413031 +0000 UTC m=+23.637384919" Jun 10 00:35:49.472945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.472897 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h75v9" podStartSLOduration=8.595729333 podStartE2EDuration="23.472883172s" totalImagesPullingTime="14.877153839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:49.471890849 +0000 UTC m=+23.678862736" watchObservedRunningTime="2026-06-10 00:35:49.472883172 +0000 UTC m=+23.679855060" Jun 10 00:35:49.572759 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.572713 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dcc7s" podStartSLOduration=4.692732835 podStartE2EDuration="23.572696926s" totalImagesPullingTime="18.879964091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:49.522033134 +0000 UTC m=+23.729005023" watchObservedRunningTime="2026-06-10 00:35:49.572696926 +0000 UTC m=+23.779668851" Jun 10 00:35:49.572900 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.572873 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qsl68" podStartSLOduration=4.622512103 podStartE2EDuration="23.572869394s" totalImagesPullingTime="18.950357291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:49.572761514 +0000 UTC m=+23.779733450" watchObservedRunningTime="2026-06-10 00:35:49.572869394 +0000 UTC m=+23.779841282" Jun 10 00:35:49.601881 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.601824 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mt8fh" podStartSLOduration=4.99430395 podStartE2EDuration="23.601802867s" totalImagesPullingTime="18.607498917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:49.601589347 +0000 UTC m=+23.808561236" watchObservedRunningTime="2026-06-10 00:35:49.601802867 +0000 UTC m=+23.808774754" Jun 10 00:35:49.682332 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.682300 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 00:35:49.927112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.927023 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:49.927666 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:49.927642 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:50.205492 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.205408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:50.205641 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:50.205571 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:50.206079 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.206057 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:50.206467 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:50.206175 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:50.208418 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.208152 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T00:35:49.68233039Z","UUID":"564176f4-3aca-4a4a-9c35-cae4d75304b5","Handler":null,"Name":"","Endpoint":""} Jun 10 00:35:50.210337 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.210316 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 00:35:50.210465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.210357 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 00:35:50.426322 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.426080 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8clrl" event={"ID":"5846d3bd-03bf-4ccb-ac74-e08368e6f811","Type":"ContainerStarted","Data":"e96a9071cf0da1522e0d1de3377d6df89f95558af34642bf95ca7a917472c5d6"} Jun 10 00:35:50.428233 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.428174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" event={"ID":"cc9615dd-b766-4a43-bf62-99473e41d097","Type":"ContainerStarted","Data":"621a6abe90c2c2148d0c17021dc4948a0e9d3a50db7e0488d94138d8ddefdb1f"} Jun 10 00:35:50.441561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:50.441518 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8clrl" podStartSLOduration=5.568609546 podStartE2EDuration="24.441504277s" totalImagesPullingTime="18.872894731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:50.441436086 +0000 UTC m=+24.648407977" watchObservedRunningTime="2026-06-10 00:35:50.441504277 +0000 UTC m=+24.648476165" Jun 10 00:35:51.205096 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.205067 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:51.205282 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:51.205172 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:51.432101 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.432009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" event={"ID":"cc9615dd-b766-4a43-bf62-99473e41d097","Type":"ContainerStarted","Data":"bb1af03825d94fd1e4f78a58d331b5c1df0dd812cecf3f002202c8f383583be1"} Jun 10 00:35:51.434927 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.434907 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:35:51.435535 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.435510 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"77ac72a2917a9ff4b77654afbd8737366e3961d6e3ab681fd687585ae9b5a9a2"} Jun 10 00:35:51.435735 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.435711 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 00:35:51.449014 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:51.448972 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x57s" podStartSLOduration=8.533938431 podStartE2EDuration="25.448958297s" totalImagesPullingTime="16.915019866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:51.448672016 +0000 UTC m=+25.655643904" watchObservedRunningTime="2026-06-10 00:35:51.448958297 +0000 UTC m=+25.655930184" Jun 10 00:35:52.206278 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:52.205432 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:52.206278 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:52.205490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:52.206278 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:52.205574 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:52.206278 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:52.205716 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:53.205472 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:53.205440 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:53.206070 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:53.205553 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:53.978036 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:53.977850 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:53.978212 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:53.978140 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 00:35:53.978468 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:53.978448 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mt8fh" Jun 10 00:35:54.205371 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.205291 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:54.205371 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.205332 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:54.205977 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:54.205430 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:54.205977 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:54.205578 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:54.444589 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.444554 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="05b464fea9a9b71945b558b0ddf88367263cf605da1ce3a8ebd9bcf242ed2a1e" exitCode=0 Jun 10 00:35:54.444747 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.444651 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"05b464fea9a9b71945b558b0ddf88367263cf605da1ce3a8ebd9bcf242ed2a1e"} Jun 10 00:35:54.448030 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.448009 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:35:54.448422 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.448383 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"3f158945ee8f55b3deae3e6307f284e61580ac62d1262b15b69decf544441946"} Jun 10 00:35:54.450582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:54.449628 2583 scope.go:117] "RemoveContainer" containerID="a8df0060f52f1fedda37d4ab652c75303fc7786a849ef13a788f2fe761935cb1" Jun 10 00:35:55.205636 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.205606 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:55.206019 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:55.205707 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:55.458582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.456836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:35:55.458582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.457864 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" event={"ID":"3d3a990c-5e07-4449-97ac-3e231d963168","Type":"ContainerStarted","Data":"386a7400c97386f3e4b851fd29816a093d49ad1742c6de4feaff245a5d0c1ee8"} Jun 10 00:35:55.458582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.457954 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:55.458582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.458023 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:55.458582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.458135 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:55.461411 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.461137 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="155ce265b280192c76b776ccb80a03cd5eb3597b092ad0ea3d63f6f5ffd713c9" exitCode=0 Jun 10 00:35:55.461411 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.461182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"155ce265b280192c76b776ccb80a03cd5eb3597b092ad0ea3d63f6f5ffd713c9"} Jun 10 00:35:55.478326 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.478302 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:55.478652 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.478494 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:35:55.489299 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.489256 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" podStartSLOduration=10.53046552 podStartE2EDuration="29.489242919s" totalImagesPullingTime="18.958777399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:55.488927739 +0000 UTC m=+29.695899628" watchObservedRunningTime="2026-06-10 00:35:55.489242919 +0000 UTC m=+29.696214786" Jun 10 00:35:55.677462 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.677424 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8w9cf"] Jun 10 00:35:55.677636 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.677610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:55.677754 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:55.677733 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:55.677967 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.677943 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8wnlj"] Jun 10 00:35:55.678044 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.678023 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:55.678105 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:55.678086 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:55.679713 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.679684 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkrmd"] Jun 10 00:35:55.679817 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:55.679800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:55.679908 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:55.679887 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:56.465761 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:56.465665 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="dfc810f2e60c14fa439ea9b99e83d81988bc52871f9ae13656969fba67923c71" exitCode=0 Jun 10 00:35:56.466373 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:56.465755 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"dfc810f2e60c14fa439ea9b99e83d81988bc52871f9ae13656969fba67923c71"} Jun 10 00:35:57.205349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:57.205317 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:57.205504 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:57.205324 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:57.205504 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:57.205327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:57.205504 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:57.205477 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:57.205618 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:57.205531 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:57.205648 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:57.205612 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:59.205675 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:59.205639 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:59.205675 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:59.205669 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:35:59.206414 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:59.205774 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8w9cf" podUID="76c7076b-a42c-407a-ae30-f057b438529e" Jun 10 00:35:59.206414 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:59.205818 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:35:59.206414 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:59.205924 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8wnlj" podUID="e37b3a40-c01f-4b88-8638-7af1e7021728" Jun 10 00:35:59.206414 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:59.206012 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:35:59.911139 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:35:59.911106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:35:59.911350 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:59.911222 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:59.911350 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:35:59.911282 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret podName:76c7076b-a42c-407a-ae30-f057b438529e nodeName:}" failed. No retries permitted until 2026-06-10 00:36:31.911267859 +0000 UTC m=+66.118239725 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret") pod "global-pull-secret-syncer-8w9cf" (UID: "76c7076b-a42c-407a-ae30-f057b438529e") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:36:00.011989 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:00.011953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:36:00.012182 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.012092 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:36:00.012182 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.012168 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:32.012147201 +0000 UTC m=+66.219119087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:36:00.112782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:00.112736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:36:00.112945 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.112874 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:36:00.112945 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.112896 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:36:00.112945 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.112907 2583 projected.go:196] Error preparing data for projected volume kube-api-access-ldz4q for pod openshift-network-diagnostics/network-check-target-8wnlj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:36:00.113055 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:00.112954 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q podName:e37b3a40-c01f-4b88-8638-7af1e7021728 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:32.11294221 +0000 UTC m=+66.319914090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ldz4q" (UniqueName: "kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q") pod "network-check-target-8wnlj" (UID: "e37b3a40-c01f-4b88-8638-7af1e7021728") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:36:01.100057 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.099977 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-5.ec2.internal" event="NodeReady" Jun 10 00:36:01.100405 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.100122 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 00:36:01.148603 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.148578 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s4vww"] Jun 10 00:36:01.171167 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.171131 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7k6ln"] Jun 10 00:36:01.171336 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.171285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.174366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.174338 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 00:36:01.174542 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.174406 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:36:01.174542 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.174495 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 00:36:01.189509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.189476 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4vww"] Jun 10 00:36:01.189626 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.189521 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7k6ln"] Jun 10 00:36:01.189673 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.189624 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.192694 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.192668 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 00:36:01.192822 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.192675 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 00:36:01.192822 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.192675 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 00:36:01.192980 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.192966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2q8pl\"" Jun 10 00:36:01.205190 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.205170 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:36:01.205303 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.205279 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:36:01.205365 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.205305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:36:01.208799 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.208781 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:36:01.208799 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.208795 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:36:01.208953 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.208795 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:36:01.208953 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.208872 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:36:01.209056 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.209047 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:36:01.209110 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.209090 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:36:01.321990 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.321949 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-cert\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.322162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.322014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6706430f-e440-41af-8a79-617fe0897a2f-tmp-dir\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.322162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.322069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.322162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.322090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7gc\" (UniqueName: \"kubernetes.io/projected/6706430f-e440-41af-8a79-617fe0897a2f-kube-api-access-xv7gc\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.322162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.322136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfcm2\" (UniqueName: \"kubernetes.io/projected/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-kube-api-access-dfcm2\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.322378 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.322180 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6706430f-e440-41af-8a79-617fe0897a2f-config-volume\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423226 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7gc\" (UniqueName: \"kubernetes.io/projected/6706430f-e440-41af-8a79-617fe0897a2f-kube-api-access-xv7gc\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423226 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfcm2\" (UniqueName: \"kubernetes.io/projected/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-kube-api-access-dfcm2\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.423226 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6706430f-e440-41af-8a79-617fe0897a2f-config-volume\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423610 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-cert\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.423610 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423312 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6706430f-e440-41af-8a79-617fe0897a2f-tmp-dir\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423610 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423340 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423610 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:01.423462 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:01.423610 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:01.423545 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:01.923525358 +0000 UTC m=+36.130497246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:01.423838 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423700 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6706430f-e440-41af-8a79-617fe0897a2f-tmp-dir\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.423897 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.423875 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6706430f-e440-41af-8a79-617fe0897a2f-config-volume\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.427669 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.427640 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-cert\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.433237 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.433208 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7gc\" (UniqueName: \"kubernetes.io/projected/6706430f-e440-41af-8a79-617fe0897a2f-kube-api-access-xv7gc\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.434015 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.433998 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfcm2\" (UniqueName: \"kubernetes.io/projected/1fb03565-aff6-42fb-96f8-3c1efa0e87c3-kube-api-access-dfcm2\") pod \"ingress-canary-7k6ln\" (UID: \"1fb03565-aff6-42fb-96f8-3c1efa0e87c3\") " pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.480256 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.480223 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="dad1296dbcf3741d5a80e7a4b310f32ff1aab5aaa65a2990247deada250da474" exitCode=0 Jun 10 00:36:01.480420 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.480271 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"dad1296dbcf3741d5a80e7a4b310f32ff1aab5aaa65a2990247deada250da474"} Jun 10 00:36:01.498236 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.498215 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7k6ln" Jun 10 00:36:01.682644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.682577 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7k6ln"] Jun 10 00:36:01.733297 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:36:01.733265 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb03565_aff6_42fb_96f8_3c1efa0e87c3.slice/crio-d320675dd9a1a0078d1668f97991cfac7870536b71d91ca2b1977ad7b275c993 WatchSource:0}: Error finding container d320675dd9a1a0078d1668f97991cfac7870536b71d91ca2b1977ad7b275c993: Status 404 returned error can't find the container with id d320675dd9a1a0078d1668f97991cfac7870536b71d91ca2b1977ad7b275c993 Jun 10 00:36:01.927564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:01.927525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:01.927734 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:01.927633 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:01.927734 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:01.927695 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:02.927682096 +0000 UTC m=+37.134653975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:02.483961 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:02.483923 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7k6ln" event={"ID":"1fb03565-aff6-42fb-96f8-3c1efa0e87c3","Type":"ContainerStarted","Data":"d320675dd9a1a0078d1668f97991cfac7870536b71d91ca2b1977ad7b275c993"} Jun 10 00:36:02.487166 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:02.487134 2583 generic.go:356] "Generic (PLEG): container finished" podID="4e7560d9-7bd3-46ec-a064-823123b6e105" containerID="ca87b7cd1ac7a50dee23075fd639a97ccd55e790b132f046d3c27df49163550c" exitCode=0 Jun 10 00:36:02.487316 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:02.487183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerDied","Data":"ca87b7cd1ac7a50dee23075fd639a97ccd55e790b132f046d3c27df49163550c"} Jun 10 00:36:02.935861 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:02.935826 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:02.936044 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:02.935983 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:02.936096 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:02.936049 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:04.936034385 +0000 UTC m=+39.143006251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:03.493073 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:03.493038 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" event={"ID":"4e7560d9-7bd3-46ec-a064-823123b6e105","Type":"ContainerStarted","Data":"40c9fb9d1dc3ead5ca2a4000ae96cf9fcf7b8b8c4d66911395708694fcc50474"} Jun 10 00:36:03.520714 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:03.520643 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fs4k5" podStartSLOduration=8.44723857 podStartE2EDuration="37.520625533s" totalImagesPullingTime="29.073386963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:03.518701871 +0000 UTC m=+37.725673774" watchObservedRunningTime="2026-06-10 00:36:03.520625533 +0000 UTC m=+37.727597421" Jun 10 00:36:04.952385 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:04.952305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:04.952897 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:04.952435 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:04.952897 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:04.952489 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:08.952474925 +0000 UTC m=+43.159446790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:05.499828 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:05.499740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7k6ln" event={"ID":"1fb03565-aff6-42fb-96f8-3c1efa0e87c3","Type":"ContainerStarted","Data":"309e6fc3ca93fe8bea272c32c6af8fa3752e525d89be397dc437f72dc52120c1"} Jun 10 00:36:05.517308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:05.517244 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7k6ln" podStartSLOduration=1.5599142000000001 podStartE2EDuration="4.517214852s" totalImagesPullingTime="2.957300652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:05.515450166 +0000 UTC m=+39.722422073" watchObservedRunningTime="2026-06-10 00:36:05.517214852 +0000 UTC m=+39.724186741" Jun 10 00:36:08.977453 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:08.977407 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:08.977949 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:08.977502 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:08.977949 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:08.977570 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:16.977555526 +0000 UTC m=+51.184527405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:17.027256 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:17.027212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:17.027900 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:17.027382 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:17.027900 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:17.027488 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:36:33.027466584 +0000 UTC m=+67.234438474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:27.479542 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:27.479512 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ps7l" Jun 10 00:36:31.926468 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:31.926419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:36:31.929476 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:31.929455 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:36:31.940306 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:31.940271 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/76c7076b-a42c-407a-ae30-f057b438529e-original-pull-secret\") pod \"global-pull-secret-syncer-8w9cf\" (UID: \"76c7076b-a42c-407a-ae30-f057b438529e\") " pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:36:32.027599 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.027558 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:36:32.030625 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.030607 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:36:32.038818 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:32.038791 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:36:32.038889 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:32.038878 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:36.038859132 +0000 UTC m=+130.245831019 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : secret "metrics-daemon-secret" not found Jun 10 00:36:32.114953 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.114910 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8w9cf" Jun 10 00:36:32.128581 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.128553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:36:32.131690 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.131669 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:36:32.141625 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.141598 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:36:32.152168 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.152146 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz4q\" (UniqueName: \"kubernetes.io/projected/e37b3a40-c01f-4b88-8638-7af1e7021728-kube-api-access-ldz4q\") pod \"network-check-target-8wnlj\" (UID: \"e37b3a40-c01f-4b88-8638-7af1e7021728\") " pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:36:32.270895 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.270856 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8w9cf"] Jun 10 00:36:32.275164 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:36:32.275135 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c7076b_a42c_407a_ae30_f057b438529e.slice/crio-dfd5c55bd5bd75c9d7f1b022a69d028cdf4894080fe2e0dc2d0f25e6009ab0b4 WatchSource:0}: Error finding container dfd5c55bd5bd75c9d7f1b022a69d028cdf4894080fe2e0dc2d0f25e6009ab0b4: Status 404 returned error can't find the container with id dfd5c55bd5bd75c9d7f1b022a69d028cdf4894080fe2e0dc2d0f25e6009ab0b4 Jun 10 00:36:32.423795 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.423765 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:36:32.431164 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.431124 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:36:32.565287 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.565237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8w9cf" event={"ID":"76c7076b-a42c-407a-ae30-f057b438529e","Type":"ContainerStarted","Data":"dfd5c55bd5bd75c9d7f1b022a69d028cdf4894080fe2e0dc2d0f25e6009ab0b4"} Jun 10 00:36:32.577208 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:32.577177 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8wnlj"] Jun 10 00:36:32.579951 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:36:32.579921 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37b3a40_c01f_4b88_8638_7af1e7021728.slice/crio-e944ade3c86be9977f65a44ce39d6b011d014c16fe0a7eb568ca7982ded42d6b WatchSource:0}: Error finding container e944ade3c86be9977f65a44ce39d6b011d014c16fe0a7eb568ca7982ded42d6b: Status 404 returned error can't find the container with id e944ade3c86be9977f65a44ce39d6b011d014c16fe0a7eb568ca7982ded42d6b Jun 10 00:36:33.035478 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:33.035435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:36:33.036059 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:33.035630 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:33.036059 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:36:33.035698 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:37:05.035680757 +0000 UTC m=+99.242652622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:36:33.569407 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:33.569314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8wnlj" event={"ID":"e37b3a40-c01f-4b88-8638-7af1e7021728","Type":"ContainerStarted","Data":"e944ade3c86be9977f65a44ce39d6b011d014c16fe0a7eb568ca7982ded42d6b"} Jun 10 00:36:36.579034 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:36.578945 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8w9cf" event={"ID":"76c7076b-a42c-407a-ae30-f057b438529e","Type":"ContainerStarted","Data":"226d905a94a4a0bb36783ba142d42bed31816358279367389e55c0b33f7c5f50"} Jun 10 00:36:36.596188 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:36.596132 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8w9cf" podStartSLOduration=66.63624021 podStartE2EDuration="1m10.596116541s" totalImagesPullingTime="3.959876331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:36.595278399 +0000 UTC m=+70.802250288" watchObservedRunningTime="2026-06-10 00:36:36.596116541 +0000 UTC m=+70.803088428" Jun 10 00:36:38.586202 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:38.586166 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8wnlj" event={"ID":"e37b3a40-c01f-4b88-8638-7af1e7021728","Type":"ContainerStarted","Data":"c9530f9791766a4e2212e909218c6e1f39e061f40ad487397192a74c1ae26888"} Jun 10 00:36:38.586624 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:36:38.586297 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:37:05.056171 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:05.056118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:37:05.056701 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:05.056250 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:37:05.056701 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:05.056305 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:38:09.056291697 +0000 UTC m=+163.263263575 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:37:09.590279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:09.590241 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8wnlj" Jun 10 00:37:09.604689 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:09.604645 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8wnlj" podStartSLOduration=98.476208147 podStartE2EDuration="1m43.604630833s" totalImagesPullingTime="5.128422686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:38.602465683 +0000 UTC m=+72.809437572" watchObservedRunningTime="2026-06-10 00:37:09.604630833 +0000 UTC m=+103.811602720" Jun 10 00:37:36.059069 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:36.059022 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:37:36.059619 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:36.059181 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:37:36.059619 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:36.059260 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs podName:149a7194-c82c-4d12-a165-c8dcb4bd8561 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:38.059243957 +0000 UTC m=+252.266215841 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs") pod "network-metrics-daemon-mkrmd" (UID: "149a7194-c82c-4d12-a165-c8dcb4bd8561") : secret "metrics-daemon-secret" not found Jun 10 00:37:55.751563 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.751528 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q"] Jun 10 00:37:55.753263 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.753246 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" Jun 10 00:37:55.755915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.755891 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grlbz\"" Jun 10 00:37:55.758231 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.758210 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk"] Jun 10 00:37:55.759905 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.759862 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l"] Jun 10 00:37:55.760031 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.760011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.761512 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.761496 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw"] Jun 10 00:37:55.761644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.761628 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.763102 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.763295 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763276 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gvjhj\"" Jun 10 00:37:55.763514 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763298 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 00:37:55.763801 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763705 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.763801 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763592 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 00:37:55.763960 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.763554 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.764747 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.764717 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q"] Jun 10 00:37:55.764834 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.764749 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 00:37:55.764930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.764888 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 00:37:55.766552 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.766450 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.767910 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.767892 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.768259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.768167 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6zcxd\"" Jun 10 00:37:55.768439 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.768376 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 00:37:55.768539 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.768524 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 00:37:55.768625 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.768606 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hrqs9\"" Jun 10 00:37:55.771750 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.771728 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk"] Jun 10 00:37:55.775205 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.775143 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw"] Jun 10 00:37:55.777915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.777895 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l"] Jun 10 00:37:55.851303 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.851270 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf"] Jun 10 00:37:55.852960 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.852942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" Jun 10 00:37:55.855650 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.855625 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.855776 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.855633 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.855776 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.855702 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9h2h5\"" Jun 10 00:37:55.857938 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.857906 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6"] Jun 10 00:37:55.860148 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.860119 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4m2xp"] Jun 10 00:37:55.860338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.860319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:55.862015 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.861998 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:37:55.862170 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.862110 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:55.863489 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.863467 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 00:37:55.863602 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.863476 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.863602 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.863531 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 00:37:55.863969 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.863763 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.863969 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.863791 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x2pvz\"" Jun 10 00:37:55.864684 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.864660 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.865196 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.865172 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 00:37:55.866810 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.866786 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 00:37:55.867325 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.867303 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.867782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.867764 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.868495 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.868477 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5jq92\"" Jun 10 00:37:55.868848 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.868832 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 00:37:55.869227 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.869211 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 00:37:55.869720 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.869696 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf"] Jun 10 00:37:55.871966 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.871585 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 00:37:55.872260 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.872244 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wfgj8\"" Jun 10 00:37:55.875626 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.875600 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 00:37:55.876943 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.876924 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6"] Jun 10 00:37:55.877353 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.877334 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 00:37:55.878082 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.878064 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4m2xp"] Jun 10 00:37:55.884444 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.884427 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:37:55.893591 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb78a89d-c309-40fa-872c-30b9981227e4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.893695 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893624 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.893695 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7td8m\" (UniqueName: \"kubernetes.io/projected/38fb5233-8ea1-42ba-8520-5cf3409e3154-kube-api-access-7td8m\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.893809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893704 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf292f7a-a47f-4600-af2e-5b25423c30dd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.893809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38fb5233-8ea1-42ba-8520-5cf3409e3154-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.893911 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf292f7a-a47f-4600-af2e-5b25423c30dd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.893911 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmnz\" (UniqueName: \"kubernetes.io/projected/bf292f7a-a47f-4600-af2e-5b25423c30dd-kube-api-access-rhmnz\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.893911 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.894027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.893921 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tdh\" (UniqueName: \"kubernetes.io/projected/f0d16cbd-0589-4edf-b775-661e763923f2-kube-api-access-w8tdh\") pod \"network-check-source-dbd9cf844-lbq8q\" (UID: \"f0d16cbd-0589-4edf-b775-661e763923f2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" Jun 10 00:37:55.995213 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tdh\" (UniqueName: \"kubernetes.io/projected/f0d16cbd-0589-4edf-b775-661e763923f2-kube-api-access-w8tdh\") pod \"network-check-source-dbd9cf844-lbq8q\" (UID: \"f0d16cbd-0589-4edf-b775-661e763923f2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" Jun 10 00:37:55.995213 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995219 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-trusted-ca\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995246 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb78a89d-c309-40fa-872c-30b9981227e4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995335 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995379 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-serving-cert\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38fb5233-8ea1-42ba-8520-5cf3409e3154-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:55.995461 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:55.995484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf292f7a-a47f-4600-af2e-5b25423c30dd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:55.995530 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.49550946 +0000 UTC m=+150.702481328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995592 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995617 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e655c243-6f8a-4f11-8f53-0442224c1b7a-config\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995698 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvqz\" (UniqueName: \"kubernetes.io/projected/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-kube-api-access-6bvqz\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-config\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:55.995757 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmct\" (UniqueName: \"kubernetes.io/projected/15e0a34c-60b2-4ccc-bda2-7a5109460f06-kube-api-access-jfmct\") pod \"volume-data-source-validator-78dd696465-z5hsf\" (UID: \"15e0a34c-60b2-4ccc-bda2-7a5109460f06\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7td8m\" (UniqueName: \"kubernetes.io/projected/38fb5233-8ea1-42ba-8520-5cf3409e3154-kube-api-access-7td8m\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e655c243-6f8a-4f11-8f53-0442224c1b7a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:55.995851 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.495828641 +0000 UTC m=+150.702800507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:37:55.995925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf292f7a-a47f-4600-af2e-5b25423c30dd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.995968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmnz\" (UniqueName: \"kubernetes.io/projected/bf292f7a-a47f-4600-af2e-5b25423c30dd-kube-api-access-rhmnz\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhfv6\" (UniqueName: \"kubernetes.io/projected/e655c243-6f8a-4f11-8f53-0442224c1b7a-kube-api-access-jhfv6\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996092 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb78a89d-c309-40fa-872c-30b9981227e4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rbd\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996111 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf292f7a-a47f-4600-af2e-5b25423c30dd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:55.996464 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.996195 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38fb5233-8ea1-42ba-8520-5cf3409e3154-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:55.998375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:55.998356 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf292f7a-a47f-4600-af2e-5b25423c30dd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:56.011967 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.011906 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmnz\" (UniqueName: \"kubernetes.io/projected/bf292f7a-a47f-4600-af2e-5b25423c30dd-kube-api-access-rhmnz\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7jjnk\" (UID: \"bf292f7a-a47f-4600-af2e-5b25423c30dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:56.012064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.012046 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tdh\" (UniqueName: \"kubernetes.io/projected/f0d16cbd-0589-4edf-b775-661e763923f2-kube-api-access-w8tdh\") pod \"network-check-source-dbd9cf844-lbq8q\" (UID: \"f0d16cbd-0589-4edf-b775-661e763923f2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" Jun 10 00:37:56.012166 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.012149 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7td8m\" (UniqueName: \"kubernetes.io/projected/38fb5233-8ea1-42ba-8520-5cf3409e3154-kube-api-access-7td8m\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:56.062383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.062348 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" Jun 10 00:37:56.072202 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.072174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" Jun 10 00:37:56.096840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.096809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.096840 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.096849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097069 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.096871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097069 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.096970 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhfv6\" (UniqueName: \"kubernetes.io/projected/e655c243-6f8a-4f11-8f53-0442224c1b7a-kube-api-access-jhfv6\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.097069 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rbd\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-trusted-ca\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.097221 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.096976 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:37:56.097221 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.097116 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-544f54c6d5-rz59w: secret "image-registry-tls" not found Jun 10 00:37:56.097221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097221 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.097205 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls podName:4b9a848d-7325-42ad-bc86-14bd91cb70e2 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.597183327 +0000 UTC m=+150.804155210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls") pod "image-registry-544f54c6d5-rz59w" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2") : secret "image-registry-tls" not found Jun 10 00:37:56.097499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097282 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-serving-cert\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.097499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e655c243-6f8a-4f11-8f53-0442224c1b7a-config\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097537 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvqz\" (UniqueName: \"kubernetes.io/projected/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-kube-api-access-6bvqz\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097608 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-config\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097639 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmct\" (UniqueName: \"kubernetes.io/projected/15e0a34c-60b2-4ccc-bda2-7a5109460f06-kube-api-access-jfmct\") pod \"volume-data-source-validator-78dd696465-z5hsf\" (UID: \"15e0a34c-60b2-4ccc-bda2-7a5109460f06\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" Jun 10 00:37:56.097692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e655c243-6f8a-4f11-8f53-0442224c1b7a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.097985 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.097926 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.098334 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.098309 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-trusted-ca\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.098633 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.098569 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-config\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.098786 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.098764 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e655c243-6f8a-4f11-8f53-0442224c1b7a-config\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.099366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.099311 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.100883 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.100843 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e655c243-6f8a-4f11-8f53-0442224c1b7a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.100883 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.100849 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-serving-cert\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.101009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.100970 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.101266 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.101247 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.107282 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.106951 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhfv6\" (UniqueName: \"kubernetes.io/projected/e655c243-6f8a-4f11-8f53-0442224c1b7a-kube-api-access-jhfv6\") pod \"service-ca-operator-6bc5ff68f5-wg4z6\" (UID: \"e655c243-6f8a-4f11-8f53-0442224c1b7a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.107458 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.107428 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.107755 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.107738 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvqz\" (UniqueName: \"kubernetes.io/projected/606beaeb-d5ac-43cb-b599-02d4cc4f6e36-kube-api-access-6bvqz\") pod \"console-operator-668fdbf85c-4m2xp\" (UID: \"606beaeb-d5ac-43cb-b599-02d4cc4f6e36\") " pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.107845 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.107826 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rbd\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.108187 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.108172 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmct\" (UniqueName: \"kubernetes.io/projected/15e0a34c-60b2-4ccc-bda2-7a5109460f06-kube-api-access-jfmct\") pod \"volume-data-source-validator-78dd696465-z5hsf\" (UID: \"15e0a34c-60b2-4ccc-bda2-7a5109460f06\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" Jun 10 00:37:56.162664 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.162636 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" Jun 10 00:37:56.178046 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.177975 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" Jun 10 00:37:56.184972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.184924 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:37:56.205458 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.205417 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q"] Jun 10 00:37:56.210207 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:37:56.210148 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d16cbd_0589_4edf_b775_661e763923f2.slice/crio-15b56dc3ebec22ecfe61e0a8d1037c150fa13ef36278776a6ecd385d8ae6a1aa WatchSource:0}: Error finding container 15b56dc3ebec22ecfe61e0a8d1037c150fa13ef36278776a6ecd385d8ae6a1aa: Status 404 returned error can't find the container with id 15b56dc3ebec22ecfe61e0a8d1037c150fa13ef36278776a6ecd385d8ae6a1aa Jun 10 00:37:56.228997 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.227230 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk"] Jun 10 00:37:56.234316 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:37:56.234279 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf292f7a_a47f_4600_af2e_5b25423c30dd.slice/crio-750cc990f9479c99902e72f542348ea70f4167b35a9c8807eb0cdc067eca3fcb WatchSource:0}: Error finding container 750cc990f9479c99902e72f542348ea70f4167b35a9c8807eb0cdc067eca3fcb: Status 404 returned error can't find the container with id 750cc990f9479c99902e72f542348ea70f4167b35a9c8807eb0cdc067eca3fcb Jun 10 00:37:56.322738 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.322713 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf"] Jun 10 00:37:56.326022 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:37:56.325976 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e0a34c_60b2_4ccc_bda2_7a5109460f06.slice/crio-f301b0dc7f00c8bc10399b2dbed310cb48ac598305e60801a75dbcfca2e01848 WatchSource:0}: Error finding container f301b0dc7f00c8bc10399b2dbed310cb48ac598305e60801a75dbcfca2e01848: Status 404 returned error can't find the container with id f301b0dc7f00c8bc10399b2dbed310cb48ac598305e60801a75dbcfca2e01848 Jun 10 00:37:56.340368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.340340 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6"] Jun 10 00:37:56.342252 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:37:56.342223 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode655c243_6f8a_4f11_8f53_0442224c1b7a.slice/crio-cadd20e0f570d61f43f525063216999a56a3b2ffeb966e753567c9d2bb3af5ef WatchSource:0}: Error finding container cadd20e0f570d61f43f525063216999a56a3b2ffeb966e753567c9d2bb3af5ef: Status 404 returned error can't find the container with id cadd20e0f570d61f43f525063216999a56a3b2ffeb966e753567c9d2bb3af5ef Jun 10 00:37:56.357492 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.357477 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4m2xp"] Jun 10 00:37:56.359806 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:37:56.359780 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606beaeb_d5ac_43cb_b599_02d4cc4f6e36.slice/crio-d2010f5f681e97a0f0ef651f8f7141cb2b4436414ef25c51b2f5c8943bcc0224 WatchSource:0}: Error finding container d2010f5f681e97a0f0ef651f8f7141cb2b4436414ef25c51b2f5c8943bcc0224: Status 404 returned error can't find the container with id d2010f5f681e97a0f0ef651f8f7141cb2b4436414ef25c51b2f5c8943bcc0224 Jun 10 00:37:56.500758 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.500725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:56.500943 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.500783 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:56.500943 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.500873 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:37:56.500943 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.500916 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:56.500943 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.500932 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.500918002 +0000 UTC m=+151.707889869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:37:56.501132 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.500992 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.500973416 +0000 UTC m=+151.707945300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:56.601431 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.601381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:56.601580 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.601538 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:37:56.601580 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.601559 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-544f54c6d5-rz59w: secret "image-registry-tls" not found Jun 10 00:37:56.601647 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:56.601623 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls podName:4b9a848d-7325-42ad-bc86-14bd91cb70e2 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.601608897 +0000 UTC m=+151.808580763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls") pod "image-registry-544f54c6d5-rz59w" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2") : secret "image-registry-tls" not found Jun 10 00:37:56.775019 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.774977 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" event={"ID":"f0d16cbd-0589-4edf-b775-661e763923f2","Type":"ContainerStarted","Data":"23a1260d427f478c61ac34762589a183ac97dc434a76fcbeb299ac1473d0af61"} Jun 10 00:37:56.775484 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.775082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" event={"ID":"f0d16cbd-0589-4edf-b775-661e763923f2","Type":"ContainerStarted","Data":"15b56dc3ebec22ecfe61e0a8d1037c150fa13ef36278776a6ecd385d8ae6a1aa"} Jun 10 00:37:56.776950 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.776915 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" event={"ID":"606beaeb-d5ac-43cb-b599-02d4cc4f6e36","Type":"ContainerStarted","Data":"d2010f5f681e97a0f0ef651f8f7141cb2b4436414ef25c51b2f5c8943bcc0224"} Jun 10 00:37:56.778596 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.778525 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" event={"ID":"bf292f7a-a47f-4600-af2e-5b25423c30dd","Type":"ContainerStarted","Data":"750cc990f9479c99902e72f542348ea70f4167b35a9c8807eb0cdc067eca3fcb"} Jun 10 00:37:56.780547 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.780509 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" event={"ID":"e655c243-6f8a-4f11-8f53-0442224c1b7a","Type":"ContainerStarted","Data":"cadd20e0f570d61f43f525063216999a56a3b2ffeb966e753567c9d2bb3af5ef"} Jun 10 00:37:56.781980 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.781894 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" event={"ID":"15e0a34c-60b2-4ccc-bda2-7a5109460f06","Type":"ContainerStarted","Data":"f301b0dc7f00c8bc10399b2dbed310cb48ac598305e60801a75dbcfca2e01848"} Jun 10 00:37:56.791185 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:56.790765 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lbq8q" podStartSLOduration=1.790747861 podStartE2EDuration="1.790747861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:37:56.789621096 +0000 UTC m=+150.996592985" watchObservedRunningTime="2026-06-10 00:37:56.790747861 +0000 UTC m=+150.997719750" Jun 10 00:37:57.510044 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:57.509952 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:57.510044 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:57.510029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:57.510480 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.510164 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:37:57.510480 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.510227 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.510208811 +0000 UTC m=+153.717180681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:37:57.510614 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.510602 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:57.510732 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.510642 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.510630651 +0000 UTC m=+153.717602516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:57.611274 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:57.611226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:57.611475 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.611429 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:37:57.611475 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.611455 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-544f54c6d5-rz59w: secret "image-registry-tls" not found Jun 10 00:37:57.611603 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:57.611526 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls podName:4b9a848d-7325-42ad-bc86-14bd91cb70e2 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.611505199 +0000 UTC m=+153.818477084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls") pod "image-registry-544f54c6d5-rz59w" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2") : secret "image-registry-tls" not found Jun 10 00:37:57.787945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:57.787863 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" event={"ID":"15e0a34c-60b2-4ccc-bda2-7a5109460f06","Type":"ContainerStarted","Data":"b8e860672bf0ea40a4ce370750a5a2d6d8d42f877fb1f44eb313ef7cff6d63ec"} Jun 10 00:37:57.803124 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:57.803068 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z5hsf" podStartSLOduration=1.470816733 podStartE2EDuration="2.803047179s" totalImagesPullingTime="1.332230446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:37:57.802561605 +0000 UTC m=+152.009533495" watchObservedRunningTime="2026-06-10 00:37:57.803047179 +0000 UTC m=+152.010019070" Jun 10 00:37:59.530245 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:59.530202 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:37:59.530751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:59.530291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:37:59.530751 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.530376 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:59.530751 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.530420 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:37:59.530751 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.530477 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.530457594 +0000 UTC m=+157.737429477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:37:59.530751 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.530495 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.530485142 +0000 UTC m=+157.737457011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:37:59.631602 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:37:59.631556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:37:59.631794 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.631735 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:37:59.631794 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.631758 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-544f54c6d5-rz59w: secret "image-registry-tls" not found Jun 10 00:37:59.631910 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:37:59.631829 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls podName:4b9a848d-7325-42ad-bc86-14bd91cb70e2 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.631809447 +0000 UTC m=+157.838781327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls") pod "image-registry-544f54c6d5-rz59w" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2") : secret "image-registry-tls" not found Jun 10 00:38:00.799153 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.799120 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/0.log" Jun 10 00:38:00.799644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.799171 2583 generic.go:356] "Generic (PLEG): container finished" podID="606beaeb-d5ac-43cb-b599-02d4cc4f6e36" containerID="d146850037c321d4d48226475b548a1c42fa004cf9d1ff7c0354b06cffecb2ea" exitCode=255 Jun 10 00:38:00.799644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.799249 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" event={"ID":"606beaeb-d5ac-43cb-b599-02d4cc4f6e36","Type":"ContainerDied","Data":"d146850037c321d4d48226475b548a1c42fa004cf9d1ff7c0354b06cffecb2ea"} Jun 10 00:38:00.799644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.799517 2583 scope.go:117] "RemoveContainer" containerID="d146850037c321d4d48226475b548a1c42fa004cf9d1ff7c0354b06cffecb2ea" Jun 10 00:38:00.800836 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.800804 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" event={"ID":"bf292f7a-a47f-4600-af2e-5b25423c30dd","Type":"ContainerStarted","Data":"148cc7df1937ce0754a523d98918f43cdb744f83137b69972081381a276f1753"} Jun 10 00:38:00.802267 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.802243 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" event={"ID":"e655c243-6f8a-4f11-8f53-0442224c1b7a","Type":"ContainerStarted","Data":"58482944854a812e4a32a1c2f30a2b675d6258d9b189a7b8237aa8e6edb54b33"} Jun 10 00:38:00.830312 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.830267 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" podStartSLOduration=2.196322855 podStartE2EDuration="5.83025289s" totalImagesPullingTime="3.633930035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:00.829704122 +0000 UTC m=+155.036676011" watchObservedRunningTime="2026-06-10 00:38:00.83025289 +0000 UTC m=+155.037224777" Jun 10 00:38:00.847675 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:00.847630 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" podStartSLOduration=2.311202826 podStartE2EDuration="5.847614553s" totalImagesPullingTime="3.536411727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:00.846583266 +0000 UTC m=+155.053555171" watchObservedRunningTime="2026-06-10 00:38:00.847614553 +0000 UTC m=+155.054586440" Jun 10 00:38:01.019338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.019305 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h75v9_f94943c1-6986-406d-a1dc-cdb4fe06f609/dns-node-resolver/0.log" Jun 10 00:38:01.607318 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.607280 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r"] Jun 10 00:38:01.609446 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.609430 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" Jun 10 00:38:01.612263 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.612236 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 00:38:01.612365 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.612238 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 00:38:01.613635 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.613617 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-csk8m\"" Jun 10 00:38:01.619125 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.619095 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r"] Jun 10 00:38:01.624788 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.624752 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk27l_c6479644-4443-4a98-95f8-fea58335c6e4/node-ca/0.log" Jun 10 00:38:01.751067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.751031 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59xj\" (UniqueName: \"kubernetes.io/projected/a3c3371c-1a8e-41b8-beb3-252027fed045-kube-api-access-s59xj\") pod \"migrator-955ffdf5f-nh55r\" (UID: \"a3c3371c-1a8e-41b8-beb3-252027fed045\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" Jun 10 00:38:01.806403 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.806375 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:38:01.806820 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.806807 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/0.log" Jun 10 00:38:01.806868 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.806845 2583 generic.go:356] "Generic (PLEG): container finished" podID="606beaeb-d5ac-43cb-b599-02d4cc4f6e36" containerID="bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217" exitCode=255 Jun 10 00:38:01.806963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.806938 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" event={"ID":"606beaeb-d5ac-43cb-b599-02d4cc4f6e36","Type":"ContainerDied","Data":"bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217"} Jun 10 00:38:01.807037 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.807022 2583 scope.go:117] "RemoveContainer" containerID="d146850037c321d4d48226475b548a1c42fa004cf9d1ff7c0354b06cffecb2ea" Jun 10 00:38:01.807244 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.807220 2583 scope.go:117] "RemoveContainer" containerID="bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217" Jun 10 00:38:01.807448 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:01.807420 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4m2xp_openshift-console-operator(606beaeb-d5ac-43cb-b599-02d4cc4f6e36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" podUID="606beaeb-d5ac-43cb-b599-02d4cc4f6e36" Jun 10 00:38:01.851863 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.851824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59xj\" (UniqueName: \"kubernetes.io/projected/a3c3371c-1a8e-41b8-beb3-252027fed045-kube-api-access-s59xj\") pod \"migrator-955ffdf5f-nh55r\" (UID: \"a3c3371c-1a8e-41b8-beb3-252027fed045\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" Jun 10 00:38:01.859972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.859912 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59xj\" (UniqueName: \"kubernetes.io/projected/a3c3371c-1a8e-41b8-beb3-252027fed045-kube-api-access-s59xj\") pod \"migrator-955ffdf5f-nh55r\" (UID: \"a3c3371c-1a8e-41b8-beb3-252027fed045\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" Jun 10 00:38:01.919517 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:01.919479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" Jun 10 00:38:02.044021 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:02.043993 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r"] Jun 10 00:38:02.046279 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:02.046253 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c3371c_1a8e_41b8_beb3_252027fed045.slice/crio-371d9e82e93b791b5364c64a17d5906290a71c85cf7a79c027e9aca05788efdc WatchSource:0}: Error finding container 371d9e82e93b791b5364c64a17d5906290a71c85cf7a79c027e9aca05788efdc: Status 404 returned error can't find the container with id 371d9e82e93b791b5364c64a17d5906290a71c85cf7a79c027e9aca05788efdc Jun 10 00:38:02.619972 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:02.619946 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7k6ln_1fb03565-aff6-42fb-96f8-3c1efa0e87c3/serve-healthcheck-canary/0.log" Jun 10 00:38:02.811779 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:02.811752 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:38:02.812250 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:02.812130 2583 scope.go:117] "RemoveContainer" containerID="bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217" Jun 10 00:38:02.812353 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:02.812327 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4m2xp_openshift-console-operator(606beaeb-d5ac-43cb-b599-02d4cc4f6e36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" podUID="606beaeb-d5ac-43cb-b599-02d4cc4f6e36" Jun 10 00:38:02.812878 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:02.812856 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" event={"ID":"a3c3371c-1a8e-41b8-beb3-252027fed045","Type":"ContainerStarted","Data":"371d9e82e93b791b5364c64a17d5906290a71c85cf7a79c027e9aca05788efdc"} Jun 10 00:38:03.566051 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.566002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:38:03.566223 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.566073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:38:03.566223 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.566165 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:38:03.566223 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.566165 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:38:03.566223 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.566218 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.566203964 +0000 UTC m=+165.773175844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:38:03.566381 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.566232 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.566225639 +0000 UTC m=+165.773197505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:38:03.667459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.667422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:03.667630 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.667565 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:38:03.667630 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.667586 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-544f54c6d5-rz59w: secret "image-registry-tls" not found Jun 10 00:38:03.667707 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:03.667639 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls podName:4b9a848d-7325-42ad-bc86-14bd91cb70e2 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.667624605 +0000 UTC m=+165.874596497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls") pod "image-registry-544f54c6d5-rz59w" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2") : secret "image-registry-tls" not found Jun 10 00:38:03.818356 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.818320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" event={"ID":"a3c3371c-1a8e-41b8-beb3-252027fed045","Type":"ContainerStarted","Data":"5de160d00c1ef14fca03b64e41a24761edac183eb9f9c404deb8c042a8a42276"} Jun 10 00:38:03.818732 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.818413 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" event={"ID":"a3c3371c-1a8e-41b8-beb3-252027fed045","Type":"ContainerStarted","Data":"b5d62c6bc62b9a517eae152eddc655d9b406724c439b02b49b6a7bb3c7311b29"} Jun 10 00:38:03.837302 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:03.837258 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-nh55r" podStartSLOduration=1.557639435 podStartE2EDuration="2.837244281s" totalImagesPullingTime="1.279604846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:03.835485048 +0000 UTC m=+158.042456936" watchObservedRunningTime="2026-06-10 00:38:03.837244281 +0000 UTC m=+158.044216169" Jun 10 00:38:04.180209 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:04.180166 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4vww" podUID="6706430f-e440-41af-8a79-617fe0897a2f" Jun 10 00:38:04.225930 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:04.225878 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mkrmd" podUID="149a7194-c82c-4d12-a165-c8dcb4bd8561" Jun 10 00:38:04.821588 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:04.821554 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4vww" Jun 10 00:38:06.185469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:06.185435 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:38:06.185937 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:06.185492 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:38:06.185937 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:06.185827 2583 scope.go:117] "RemoveContainer" containerID="bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217" Jun 10 00:38:06.186026 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:06.186003 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4m2xp_openshift-console-operator(606beaeb-d5ac-43cb-b599-02d4cc4f6e36)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" podUID="606beaeb-d5ac-43cb-b599-02d4cc4f6e36" Jun 10 00:38:09.107558 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:09.107504 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:38:09.107912 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:09.107667 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:38:09.107912 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:09.107733 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls podName:6706430f-e440-41af-8a79-617fe0897a2f nodeName:}" failed. No retries permitted until 2026-06-10 00:40:11.107716985 +0000 UTC m=+285.314688851 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls") pod "dns-default-s4vww" (UID: "6706430f-e440-41af-8a79-617fe0897a2f") : secret "dns-default-metrics-tls" not found Jun 10 00:38:11.627271 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.627232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:38:11.627657 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.627289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:38:11.627657 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:11.627378 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 00:38:11.627657 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:11.627407 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 00:38:11.627657 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:11.627453 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls podName:38fb5233-8ea1-42ba-8520-5cf3409e3154 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:27.627438685 +0000 UTC m=+181.834410564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s9lcw" (UID: "38fb5233-8ea1-42ba-8520-5cf3409e3154") : secret "cluster-monitoring-operator-tls" not found Jun 10 00:38:11.627657 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:11.627468 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert podName:fb78a89d-c309-40fa-872c-30b9981227e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:27.627461739 +0000 UTC m=+181.834433605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-4qn9l" (UID: "fb78a89d-c309-40fa-872c-30b9981227e4") : secret "networking-console-plugin-cert" not found Jun 10 00:38:11.728606 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.728569 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:11.731047 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.731016 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"image-registry-544f54c6d5-rz59w\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:11.790198 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.790163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:11.916532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:11.916509 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:38:11.918966 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:11.918936 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a848d_7325_42ad_bc86_14bd91cb70e2.slice/crio-d026b49de6a902f2190fed26dcab8050cf845b00db33dd273d55db3f49f584a7 WatchSource:0}: Error finding container d026b49de6a902f2190fed26dcab8050cf845b00db33dd273d55db3f49f584a7: Status 404 returned error can't find the container with id d026b49de6a902f2190fed26dcab8050cf845b00db33dd273d55db3f49f584a7 Jun 10 00:38:12.847506 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:12.847473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" event={"ID":"4b9a848d-7325-42ad-bc86-14bd91cb70e2","Type":"ContainerStarted","Data":"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a"} Jun 10 00:38:12.847939 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:12.847548 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" event={"ID":"4b9a848d-7325-42ad-bc86-14bd91cb70e2","Type":"ContainerStarted","Data":"d026b49de6a902f2190fed26dcab8050cf845b00db33dd273d55db3f49f584a7"} Jun 10 00:38:12.847939 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:12.847594 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:12.867565 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:12.867512 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" podStartSLOduration=17.867497043 podStartE2EDuration="17.867497043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:12.865490851 +0000 UTC m=+167.072462772" watchObservedRunningTime="2026-06-10 00:38:12.867497043 +0000 UTC m=+167.074468931" Jun 10 00:38:17.205584 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:17.205497 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:38:18.205719 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.205683 2583 scope.go:117] "RemoveContainer" containerID="bad522e4e647252fd184209f5de737233b920bebc2425c8f991a9692fef97217" Jun 10 00:38:18.867902 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.867873 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:38:18.868051 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.867936 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" event={"ID":"606beaeb-d5ac-43cb-b599-02d4cc4f6e36","Type":"ContainerStarted","Data":"1c09a0024cdf60f241727370ea18838f32e526879bdb3b0a8ff7c3e81f0c2fc7"} Jun 10 00:38:18.868236 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.868218 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:38:18.872846 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.872824 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" Jun 10 00:38:18.885501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:18.885449 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-4m2xp" podStartSLOduration=20.366837333 podStartE2EDuration="23.885435813s" totalImagesPullingTime="3.51859848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:18.884828288 +0000 UTC m=+173.091800176" watchObservedRunningTime="2026-06-10 00:38:18.885435813 +0000 UTC m=+173.092407701" Jun 10 00:38:22.296485 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.296453 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:38:22.323219 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.323185 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2h8s5"] Jun 10 00:38:22.328877 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.328855 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.332341 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.332314 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 00:38:22.332551 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.332431 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 00:38:22.334072 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.334048 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 00:38:22.334188 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.334087 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l2vh\"" Jun 10 00:38:22.334188 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.334052 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 00:38:22.346129 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.346109 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56d59977fc-jg544"] Jun 10 00:38:22.350064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.350043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2h8s5"] Jun 10 00:38:22.350165 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.350128 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.367249 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.367216 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56d59977fc-jg544"] Jun 10 00:38:22.411082 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-certificates\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrdkt\" (UniqueName: \"kubernetes.io/projected/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-api-access-vrdkt\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411176 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-trusted-ca\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-installation-pull-secrets\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34da380-8e20-4d34-bb92-06d2d3c04260-ca-trust-extracted\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-tls\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de9155b5-a4b7-448d-af3c-5a335d94a70e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.411279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411281 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-image-registry-private-configuration\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411614 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28qbj\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-kube-api-access-28qbj\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.411614 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411332 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de9155b5-a4b7-448d-af3c-5a335d94a70e-crio-socket\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.411614 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411371 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de9155b5-a4b7-448d-af3c-5a335d94a70e-data-volume\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.411614 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.411422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-bound-sa-token\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.511932 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.511898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de9155b5-a4b7-448d-af3c-5a335d94a70e-crio-socket\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.511932 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.511935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de9155b5-a4b7-448d-af3c-5a335d94a70e-data-volume\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.511951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-bound-sa-token\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512028 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512051 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de9155b5-a4b7-448d-af3c-5a335d94a70e-crio-socket\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-certificates\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrdkt\" (UniqueName: \"kubernetes.io/projected/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-api-access-vrdkt\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512134 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-trusted-ca\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-installation-pull-secrets\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34da380-8e20-4d34-bb92-06d2d3c04260-ca-trust-extracted\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-tls\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512450 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de9155b5-a4b7-448d-af3c-5a335d94a70e-data-volume\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de9155b5-a4b7-448d-af3c-5a335d94a70e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.512509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512487 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-image-registry-private-configuration\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512741 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28qbj\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-kube-api-access-28qbj\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512799 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512779 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e34da380-8e20-4d34-bb92-06d2d3c04260-ca-trust-extracted\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.512917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.512805 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.513202 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.513149 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-certificates\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.513487 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.513429 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e34da380-8e20-4d34-bb92-06d2d3c04260-trusted-ca\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.515150 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.515130 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de9155b5-a4b7-448d-af3c-5a335d94a70e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.515451 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.515418 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-image-registry-private-configuration\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.515530 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.515445 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e34da380-8e20-4d34-bb92-06d2d3c04260-installation-pull-secrets\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.515530 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.515525 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-registry-tls\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.520108 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.520086 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrdkt\" (UniqueName: \"kubernetes.io/projected/de9155b5-a4b7-448d-af3c-5a335d94a70e-kube-api-access-vrdkt\") pod \"insights-runtime-extractor-2h8s5\" (UID: \"de9155b5-a4b7-448d-af3c-5a335d94a70e\") " pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.520959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.520938 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-bound-sa-token\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.521118 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.521101 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28qbj\" (UniqueName: \"kubernetes.io/projected/e34da380-8e20-4d34-bb92-06d2d3c04260-kube-api-access-28qbj\") pod \"image-registry-56d59977fc-jg544\" (UID: \"e34da380-8e20-4d34-bb92-06d2d3c04260\") " pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.638616 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.638581 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2h8s5" Jun 10 00:38:22.658276 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.658248 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.798578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.798538 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2h8s5"] Jun 10 00:38:22.802307 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:22.802274 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9155b5_a4b7_448d_af3c_5a335d94a70e.slice/crio-96824bd1dd9e0f7904f0fbe099a9d2db635573331b5d28f09d41187e1b701335 WatchSource:0}: Error finding container 96824bd1dd9e0f7904f0fbe099a9d2db635573331b5d28f09d41187e1b701335: Status 404 returned error can't find the container with id 96824bd1dd9e0f7904f0fbe099a9d2db635573331b5d28f09d41187e1b701335 Jun 10 00:38:22.827231 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.827210 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56d59977fc-jg544"] Jun 10 00:38:22.830370 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:22.830343 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34da380_8e20_4d34_bb92_06d2d3c04260.slice/crio-48076a58794a0693f13a6a82bd3fbe468ada4ba8f38eada344a5784c093c740d WatchSource:0}: Error finding container 48076a58794a0693f13a6a82bd3fbe468ada4ba8f38eada344a5784c093c740d: Status 404 returned error can't find the container with id 48076a58794a0693f13a6a82bd3fbe468ada4ba8f38eada344a5784c093c740d Jun 10 00:38:22.885045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.885008 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h8s5" event={"ID":"de9155b5-a4b7-448d-af3c-5a335d94a70e","Type":"ContainerStarted","Data":"e14f07108e265530ae75818e5b2267a1ed533c9182688f0375fd01e6d7116211"} Jun 10 00:38:22.885162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.885085 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h8s5" event={"ID":"de9155b5-a4b7-448d-af3c-5a335d94a70e","Type":"ContainerStarted","Data":"96824bd1dd9e0f7904f0fbe099a9d2db635573331b5d28f09d41187e1b701335"} Jun 10 00:38:22.886660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.886636 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerStarted","Data":"edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87"} Jun 10 00:38:22.886754 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.886679 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerStarted","Data":"48076a58794a0693f13a6a82bd3fbe468ada4ba8f38eada344a5784c093c740d"} Jun 10 00:38:22.886814 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.886759 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:38:22.904682 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:22.904558 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podStartSLOduration=0.904534968 podStartE2EDuration="904.534968ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:22.90350455 +0000 UTC m=+177.110476473" watchObservedRunningTime="2026-06-10 00:38:22.904534968 +0000 UTC m=+177.111506917" Jun 10 00:38:23.892271 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:23.892237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h8s5" event={"ID":"de9155b5-a4b7-448d-af3c-5a335d94a70e","Type":"ContainerStarted","Data":"a86c0e900ce2582358a55390dfae75e8b99dbebeea220f61bc880b8e1d2c3c40"} Jun 10 00:38:25.901197 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:25.901153 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h8s5" event={"ID":"de9155b5-a4b7-448d-af3c-5a335d94a70e","Type":"ContainerStarted","Data":"727a6fef7392a5cb7f9c785b3d625334c83b83987a1018073dde5b0f128d0741"} Jun 10 00:38:25.921700 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:25.921638 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2h8s5" podStartSLOduration=1.5315775249999999 podStartE2EDuration="3.92162391s" totalImagesPullingTime="2.390046385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:25.919995796 +0000 UTC m=+180.126967686" watchObservedRunningTime="2026-06-10 00:38:25.92162391 +0000 UTC m=+180.128595797" Jun 10 00:38:27.659414 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.659350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:38:27.659881 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.659436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:38:27.661937 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.661904 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38fb5233-8ea1-42ba-8520-5cf3409e3154-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s9lcw\" (UID: \"38fb5233-8ea1-42ba-8520-5cf3409e3154\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:38:27.662075 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.662050 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb78a89d-c309-40fa-872c-30b9981227e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-4qn9l\" (UID: \"fb78a89d-c309-40fa-872c-30b9981227e4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:38:27.882261 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.882229 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6zcxd\"" Jun 10 00:38:27.887761 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.887742 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hrqs9\"" Jun 10 00:38:27.889759 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.889741 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" Jun 10 00:38:27.896159 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:27.896132 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" Jun 10 00:38:28.039338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:28.039313 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw"] Jun 10 00:38:28.042074 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:28.042035 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fb5233_8ea1_42ba_8520_5cf3409e3154.slice/crio-d6db64bd2502510e0c974c5a1025cc647bac227c72c1c6383d180a2a9b2574f0 WatchSource:0}: Error finding container d6db64bd2502510e0c974c5a1025cc647bac227c72c1c6383d180a2a9b2574f0: Status 404 returned error can't find the container with id d6db64bd2502510e0c974c5a1025cc647bac227c72c1c6383d180a2a9b2574f0 Jun 10 00:38:28.055987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:28.055955 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l"] Jun 10 00:38:28.058438 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:28.058419 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb78a89d_c309_40fa_872c_30b9981227e4.slice/crio-5c0fedfd8b1040abea6cfffefb6c273940eeb323eab2141bc6b85f7364962556 WatchSource:0}: Error finding container 5c0fedfd8b1040abea6cfffefb6c273940eeb323eab2141bc6b85f7364962556: Status 404 returned error can't find the container with id 5c0fedfd8b1040abea6cfffefb6c273940eeb323eab2141bc6b85f7364962556 Jun 10 00:38:28.916078 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:28.916035 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" event={"ID":"fb78a89d-c309-40fa-872c-30b9981227e4","Type":"ContainerStarted","Data":"5c0fedfd8b1040abea6cfffefb6c273940eeb323eab2141bc6b85f7364962556"} Jun 10 00:38:28.917454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:28.917425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" event={"ID":"38fb5233-8ea1-42ba-8520-5cf3409e3154","Type":"ContainerStarted","Data":"d6db64bd2502510e0c974c5a1025cc647bac227c72c1c6383d180a2a9b2574f0"} Jun 10 00:38:30.926352 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:30.926299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" event={"ID":"fb78a89d-c309-40fa-872c-30b9981227e4","Type":"ContainerStarted","Data":"2c308f2f07b466bffb447e98d48ffdd61a3ad68729457a347612ea760698afa2"} Jun 10 00:38:30.927781 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:30.927749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" event={"ID":"38fb5233-8ea1-42ba-8520-5cf3409e3154","Type":"ContainerStarted","Data":"7486df7808b8d3128b38974b8757b0b2fea18e7c4d6c27ef81466c568d44b670"} Jun 10 00:38:30.941640 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:30.941584 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-4qn9l" podStartSLOduration=33.666966348 podStartE2EDuration="35.941569655s" totalImagesPullingTime="2.274603307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:30.940710836 +0000 UTC m=+185.147682786" watchObservedRunningTime="2026-06-10 00:38:30.941569655 +0000 UTC m=+185.148541569" Jun 10 00:38:30.960459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:30.960406 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s9lcw" podStartSLOduration=33.665411978 podStartE2EDuration="35.960372017s" totalImagesPullingTime="2.294960039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:30.959718498 +0000 UTC m=+185.166690387" watchObservedRunningTime="2026-06-10 00:38:30.960372017 +0000 UTC m=+185.167343904" Jun 10 00:38:32.301648 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:32.301614 2583 patch_prober.go:28] interesting pod/image-registry-544f54c6d5-rz59w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:32.302021 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:32.301664 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:38.215945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.215917 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc"] Jun 10 00:38:38.220026 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.220003 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.222888 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.222857 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 00:38:38.223168 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.223148 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 00:38:38.224403 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.224368 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-78hwj\"" Jun 10 00:38:38.224491 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.224441 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 00:38:38.229552 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.229529 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc"] Jun 10 00:38:38.240361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.240339 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mf75h"] Jun 10 00:38:38.243525 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.243499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.246084 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.246026 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5gdb\"" Jun 10 00:38:38.246239 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.246202 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 00:38:38.246468 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.246451 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 00:38:38.246543 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.246460 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 00:38:38.349534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349497 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.349534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8q8p\" (UniqueName: \"kubernetes.io/projected/2300545e-0688-41ce-b769-3dcdde7ae326-kube-api-access-k8q8p\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-wtmp\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-metrics-client-ca\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-root\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349852 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-sys\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349852 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349785 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349852 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.349945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349854 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349881 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-textfile\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.349945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.349945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.349930 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knt7h\" (UniqueName: \"kubernetes.io/projected/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-kube-api-access-knt7h\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.451336 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-sys\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.451336 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.451573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.451573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451442 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-sys\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.451573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.451722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-textfile\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.451722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.451823 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knt7h\" (UniqueName: \"kubernetes.io/projected/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-kube-api-access-knt7h\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.451871 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451817 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.451871 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8q8p\" (UniqueName: \"kubernetes.io/projected/2300545e-0688-41ce-b769-3dcdde7ae326-kube-api-access-k8q8p\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451916 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-textfile\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-wtmp\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-metrics-client-ca\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.451974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-root\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.452159 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-accelerators-collector-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.452210 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-root\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.452265 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-wtmp\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.452368 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:38.452329 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.452563 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:38.452413 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls podName:2300545e-0688-41ce-b769-3dcdde7ae326 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:38.95236848 +0000 UTC m=+193.159340347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls") pod "node-exporter-mf75h" (UID: "2300545e-0688-41ce-b769-3dcdde7ae326") : secret "node-exporter-tls" not found Jun 10 00:38:38.452634 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.452611 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.453077 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.453055 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300545e-0688-41ce-b769-3dcdde7ae326-metrics-client-ca\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.453952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.453926 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.454031 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.454005 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.454344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.454324 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.460461 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.460441 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8q8p\" (UniqueName: \"kubernetes.io/projected/2300545e-0688-41ce-b769-3dcdde7ae326-kube-api-access-k8q8p\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.460851 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.460830 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knt7h\" (UniqueName: \"kubernetes.io/projected/139f447e-2076-4ec8-b7a2-f1e37fe2fd3a-kube-api-access-knt7h\") pod \"openshift-state-metrics-65f78d5c66-7spqc\" (UID: \"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.529875 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.529777 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" Jun 10 00:38:38.661722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.661699 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc"] Jun 10 00:38:38.663453 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:38.663426 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139f447e_2076_4ec8_b7a2_f1e37fe2fd3a.slice/crio-26ccd0283f6eb7da2fb256ac5df4d21f1fee2e1e7219e02570826c6933fb0537 WatchSource:0}: Error finding container 26ccd0283f6eb7da2fb256ac5df4d21f1fee2e1e7219e02570826c6933fb0537: Status 404 returned error can't find the container with id 26ccd0283f6eb7da2fb256ac5df4d21f1fee2e1e7219e02570826c6933fb0537 Jun 10 00:38:38.956087 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.956048 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" event={"ID":"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a","Type":"ContainerStarted","Data":"2013a939e4977d26e30f292c36587205fd6af54ec7010ee84a3eb364cd5ea4aa"} Jun 10 00:38:38.956280 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.956135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" event={"ID":"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a","Type":"ContainerStarted","Data":"d01ad9923c0c1d583cf63b33cda5843f6deb6aa8bd3699f3210c89ed9c44a094"} Jun 10 00:38:38.956280 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.956153 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" event={"ID":"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a","Type":"ContainerStarted","Data":"26ccd0283f6eb7da2fb256ac5df4d21f1fee2e1e7219e02570826c6933fb0537"} Jun 10 00:38:38.957344 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:38.957320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:38.957502 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:38.957484 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.957558 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:38.957549 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls podName:2300545e-0688-41ce-b769-3dcdde7ae326 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:39.957534365 +0000 UTC m=+194.164506245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls") pod "node-exporter-mf75h" (UID: "2300545e-0688-41ce-b769-3dcdde7ae326") : secret "node-exporter-tls" not found Jun 10 00:38:39.964664 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:39.964631 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" event={"ID":"139f447e-2076-4ec8-b7a2-f1e37fe2fd3a","Type":"ContainerStarted","Data":"554484cacf8033f2b129eecc28b7c7764dbdeec25b756d4fa2f2b608565dda80"} Jun 10 00:38:39.965067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:39.964777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:39.967309 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:39.967282 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300545e-0688-41ce-b769-3dcdde7ae326-node-exporter-tls\") pod \"node-exporter-mf75h\" (UID: \"2300545e-0688-41ce-b769-3dcdde7ae326\") " pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:39.983012 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:39.982963 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7spqc" podStartSLOduration=0.891075912 podStartE2EDuration="1.982949875s" totalImagesPullingTime="1.091873963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:39.982446705 +0000 UTC m=+194.189418594" watchObservedRunningTime="2026-06-10 00:38:39.982949875 +0000 UTC m=+194.189921762" Jun 10 00:38:40.052797 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.052762 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mf75h" Jun 10 00:38:40.063636 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:40.063607 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2300545e_0688_41ce_b769_3dcdde7ae326.slice/crio-cc6a4115b8e4974afbf570bdd37e1b0bb1443c1a9458e640506708e1c2baa856 WatchSource:0}: Error finding container cc6a4115b8e4974afbf570bdd37e1b0bb1443c1a9458e640506708e1c2baa856: Status 404 returned error can't find the container with id cc6a4115b8e4974afbf570bdd37e1b0bb1443c1a9458e640506708e1c2baa856 Jun 10 00:38:40.309377 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.309282 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7594775456-slsgg"] Jun 10 00:38:40.314001 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.313982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.317812 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.317778 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 00:38:40.317952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.317936 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1vofgu282sh6q\"" Jun 10 00:38:40.318124 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.318110 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 00:38:40.322223 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.322207 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 00:38:40.322349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.322337 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 00:38:40.322471 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.322455 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z6tdh\"" Jun 10 00:38:40.322553 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.322485 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 00:38:40.340581 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.340550 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7594775456-slsgg"] Jun 10 00:38:40.469544 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3d8b8-a502-4deb-a081-b316d6118233-metrics-client-ca\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469544 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlf2w\" (UniqueName: \"kubernetes.io/projected/b2d3d8b8-a502-4deb-a081-b316d6118233-kube-api-access-dlf2w\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-grpc-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469682 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469861 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469861 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469970 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.469970 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.469917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571029 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.570946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3d8b8-a502-4deb-a081-b316d6118233-metrics-client-ca\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571029 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.570989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlf2w\" (UniqueName: \"kubernetes.io/projected/b2d3d8b8-a502-4deb-a081-b316d6118233-kube-api-access-dlf2w\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571258 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-grpc-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571258 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571258 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571121 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571381 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571381 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571520 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.571846 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.571797 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3d8b8-a502-4deb-a081-b316d6118233-metrics-client-ca\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.574666 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.574602 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.574666 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.574657 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-grpc-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.574933 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.574879 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-tls\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.575225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.575178 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.575312 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.575259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.576514 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.576491 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2d3d8b8-a502-4deb-a081-b316d6118233-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.579145 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.579121 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlf2w\" (UniqueName: \"kubernetes.io/projected/b2d3d8b8-a502-4deb-a081-b316d6118233-kube-api-access-dlf2w\") pod \"thanos-querier-7594775456-slsgg\" (UID: \"b2d3d8b8-a502-4deb-a081-b316d6118233\") " pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.623585 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.623553 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:40.919909 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.919806 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7594775456-slsgg"] Jun 10 00:38:40.922813 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:40.922784 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d3d8b8_a502_4deb_a081_b316d6118233.slice/crio-9c2c83205beb3046fb2a7b73a0771208fc5b39a506fa41269cb40d82710c4595 WatchSource:0}: Error finding container 9c2c83205beb3046fb2a7b73a0771208fc5b39a506fa41269cb40d82710c4595: Status 404 returned error can't find the container with id 9c2c83205beb3046fb2a7b73a0771208fc5b39a506fa41269cb40d82710c4595 Jun 10 00:38:40.970804 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.970771 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf75h" event={"ID":"2300545e-0688-41ce-b769-3dcdde7ae326","Type":"ContainerStarted","Data":"a3458292582b241635872bfec5399628f9623db9c20a809423663655f830fa6d"} Jun 10 00:38:40.971175 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.970836 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf75h" event={"ID":"2300545e-0688-41ce-b769-3dcdde7ae326","Type":"ContainerStarted","Data":"cc6a4115b8e4974afbf570bdd37e1b0bb1443c1a9458e640506708e1c2baa856"} Jun 10 00:38:40.972104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:40.972082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"9c2c83205beb3046fb2a7b73a0771208fc5b39a506fa41269cb40d82710c4595"} Jun 10 00:38:41.976896 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:41.976863 2583 generic.go:356] "Generic (PLEG): container finished" podID="2300545e-0688-41ce-b769-3dcdde7ae326" containerID="a3458292582b241635872bfec5399628f9623db9c20a809423663655f830fa6d" exitCode=0 Jun 10 00:38:41.977289 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:41.976904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf75h" event={"ID":"2300545e-0688-41ce-b769-3dcdde7ae326","Type":"ContainerDied","Data":"a3458292582b241635872bfec5399628f9623db9c20a809423663655f830fa6d"} Jun 10 00:38:42.302754 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.302668 2583 patch_prober.go:28] interesting pod/image-registry-544f54c6d5-rz59w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:42.302754 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.302729 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:42.623345 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.623304 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b65cfdb59-65v9w"] Jun 10 00:38:42.626609 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.626588 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.629410 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.629364 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 00:38:42.629510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.629481 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 00:38:42.630667 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.630647 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 00:38:42.630792 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.630761 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1u301dfmvqsmj\"" Jun 10 00:38:42.630899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.630843 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vzdr7\"" Jun 10 00:38:42.630969 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.630916 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 00:38:42.636790 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.636770 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b65cfdb59-65v9w"] Jun 10 00:38:42.663184 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.663154 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:42.663357 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.663202 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:42.791405 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791346 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgz2w\" (UniqueName: \"kubernetes.io/projected/e72c903a-9895-4415-b53b-0bdc75ee43de-kube-api-access-fgz2w\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-metrics-server-audit-profiles\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-client-certs\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791494 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-tls\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e72c903a-9895-4415-b53b-0bdc75ee43de-audit-log\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791691 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791607 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.791691 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.791630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-client-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgz2w\" (UniqueName: \"kubernetes.io/projected/e72c903a-9895-4415-b53b-0bdc75ee43de-kube-api-access-fgz2w\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-metrics-server-audit-profiles\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-client-certs\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892854 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-tls\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e72c903a-9895-4415-b53b-0bdc75ee43de-audit-log\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.892988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.892984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-client-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.893801 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.893699 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e72c903a-9895-4415-b53b-0bdc75ee43de-audit-log\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.893801 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.893800 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.894245 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.894197 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e72c903a-9895-4415-b53b-0bdc75ee43de-metrics-server-audit-profiles\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.895780 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.895752 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-tls\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.895954 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.895933 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-client-ca-bundle\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.896054 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.896034 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e72c903a-9895-4415-b53b-0bdc75ee43de-secret-metrics-server-client-certs\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.900347 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.900326 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgz2w\" (UniqueName: \"kubernetes.io/projected/e72c903a-9895-4415-b53b-0bdc75ee43de-kube-api-access-fgz2w\") pod \"metrics-server-5b65cfdb59-65v9w\" (UID: \"e72c903a-9895-4415-b53b-0bdc75ee43de\") " pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.936629 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.936595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:38:42.984923 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.984888 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf75h" event={"ID":"2300545e-0688-41ce-b769-3dcdde7ae326","Type":"ContainerStarted","Data":"e6521df439b4f30616213d00c5256c5f47a6a9f49c00f0a0568cafbe811c15cb"} Jun 10 00:38:42.985334 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:42.984962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mf75h" event={"ID":"2300545e-0688-41ce-b769-3dcdde7ae326","Type":"ContainerStarted","Data":"2a51648f19fac242fbe66d9e103be7b92f660f79d3c976fbb8942c7573cd8b65"} Jun 10 00:38:43.005142 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.005090 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mf75h" podStartSLOduration=4.161190375 podStartE2EDuration="5.005071712s" totalImagesPullingTime="769.049673ms" totalInitContainerRuntime="74.831664ms" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:43.004489672 +0000 UTC m=+197.211461582" watchObservedRunningTime="2026-06-10 00:38:43.005071712 +0000 UTC m=+197.212043600" Jun 10 00:38:43.008711 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.008688 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw"] Jun 10 00:38:43.011973 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.011954 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.014578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.014556 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 00:38:43.014680 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.014593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pwj52\"" Jun 10 00:38:43.020519 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.020493 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw"] Jun 10 00:38:43.094510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.094471 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.094717 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.094555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hm4\" (UniqueName: \"kubernetes.io/projected/96b25d3a-e958-4db8-8c78-9c78f9f114e4-kube-api-access-j2hm4\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.195966 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.195871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hm4\" (UniqueName: \"kubernetes.io/projected/96b25d3a-e958-4db8-8c78-9c78f9f114e4-kube-api-access-j2hm4\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.196136 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.196003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.196136 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:43.196124 2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 00:38:43.196233 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:43.196189 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert podName:96b25d3a-e958-4db8-8c78-9c78f9f114e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:43.696169288 +0000 UTC m=+197.903141178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-r4vrw" (UID: "96b25d3a-e958-4db8-8c78-9c78f9f114e4") : secret "monitoring-plugin-cert" not found Jun 10 00:38:43.205536 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.205509 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hm4\" (UniqueName: \"kubernetes.io/projected/96b25d3a-e958-4db8-8c78-9c78f9f114e4-kube-api-access-j2hm4\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.517863 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.517833 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b65cfdb59-65v9w"] Jun 10 00:38:43.521086 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:43.521059 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72c903a_9895_4415_b53b_0bdc75ee43de.slice/crio-091b1d2b3e42dbc41158a70d89b386eb5e00af74cb7882a549dad42d96d058d8 WatchSource:0}: Error finding container 091b1d2b3e42dbc41158a70d89b386eb5e00af74cb7882a549dad42d96d058d8: Status 404 returned error can't find the container with id 091b1d2b3e42dbc41158a70d89b386eb5e00af74cb7882a549dad42d96d058d8 Jun 10 00:38:43.700699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.700607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:43.700833 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:43.700758 2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 00:38:43.700890 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:43.700841 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert podName:96b25d3a-e958-4db8-8c78-9c78f9f114e4 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:44.700820325 +0000 UTC m=+198.907792210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-r4vrw" (UID: "96b25d3a-e958-4db8-8c78-9c78f9f114e4") : secret "monitoring-plugin-cert" not found Jun 10 00:38:43.898086 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.898054 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:43.898241 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.898102 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:43.992268 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.992170 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"5fee9162edce221892a11376a9411a3043053c033e4eb70509bf9eba3cde5e7d"} Jun 10 00:38:43.992268 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.992260 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"4afa4c3768947ed3fcb3ecae6bbef782e28903ab6ea21819bd8554e1785db278"} Jun 10 00:38:43.992765 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.992320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"b0d36e37b69844453646297e2b0d0735ee6e215016b4220be041fc6b6c7633ee"} Jun 10 00:38:43.993673 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:43.993649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" event={"ID":"e72c903a-9895-4415-b53b-0bdc75ee43de","Type":"ContainerStarted","Data":"091b1d2b3e42dbc41158a70d89b386eb5e00af74cb7882a549dad42d96d058d8"} Jun 10 00:38:44.174490 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.174457 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:38:44.179604 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.179573 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.186185 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.186158 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 00:38:44.186310 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.186184 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 00:38:44.186310 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.186203 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 00:38:44.189653 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.189381 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 00:38:44.189653 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.189414 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 00:38:44.189653 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.189511 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q9p89\"" Jun 10 00:38:44.189870 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.189814 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 00:38:44.189870 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.189818 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 00:38:44.195253 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.195225 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:38:44.196371 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.196350 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 00:38:44.306275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306375 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306597 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306551 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.306640 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.306602 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtsfm\" (UniqueName: \"kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.407746 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.407708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.407951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.407762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.407951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.407936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsfm\" (UniqueName: \"kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408050 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408171 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408171 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408824 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408791 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.408943 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.408878 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.409414 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.409350 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.409579 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.409562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.411182 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.411159 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.411365 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.411339 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.416100 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.416075 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtsfm\" (UniqueName: \"kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm\") pod \"console-b989568b-n66ht\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.492151 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.492125 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:44.652031 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.651936 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:38:44.711278 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.711232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:44.714075 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.714042 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/96b25d3a-e958-4db8-8c78-9c78f9f114e4-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-r4vrw\" (UID: \"96b25d3a-e958-4db8-8c78-9c78f9f114e4\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:44.823683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:44.823595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:45.001717 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:45.001678 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"af5ce12c9e3b13626d3b231bcede782359f050daec60d31102fa7f73ded49639"} Jun 10 00:38:45.002127 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:45.001766 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"a474c74b4105f714407dc1f7e1155f26a9fdfae5e377e5ae30ac39427a5b7c05"} Jun 10 00:38:45.014813 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:45.014787 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf6d6ae_b05c_4187_9d0a_606c84544e3d.slice/crio-e477e6998c7690d5c0da0f12a61155d03ac0f8d8a79b0ef55d14742c82ee4b9e WatchSource:0}: Error finding container e477e6998c7690d5c0da0f12a61155d03ac0f8d8a79b0ef55d14742c82ee4b9e: Status 404 returned error can't find the container with id e477e6998c7690d5c0da0f12a61155d03ac0f8d8a79b0ef55d14742c82ee4b9e Jun 10 00:38:45.160518 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:45.160494 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw"] Jun 10 00:38:45.163409 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:45.163364 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b25d3a_e958_4db8_8c78_9c78f9f114e4.slice/crio-30bd1078c3f7e74f1ef22be465eaa5700460354a2ac5dad00910963909baf42e WatchSource:0}: Error finding container 30bd1078c3f7e74f1ef22be465eaa5700460354a2ac5dad00910963909baf42e: Status 404 returned error can't find the container with id 30bd1078c3f7e74f1ef22be465eaa5700460354a2ac5dad00910963909baf42e Jun 10 00:38:46.008134 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.008091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" event={"ID":"96b25d3a-e958-4db8-8c78-9c78f9f114e4","Type":"ContainerStarted","Data":"30bd1078c3f7e74f1ef22be465eaa5700460354a2ac5dad00910963909baf42e"} Jun 10 00:38:46.012938 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.012904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" event={"ID":"b2d3d8b8-a502-4deb-a081-b316d6118233","Type":"ContainerStarted","Data":"02104f122106e3b5e321c33c501cb7876a34546beeecc24cf48c0053193f7809"} Jun 10 00:38:46.013092 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.013074 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:46.014538 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.014514 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" event={"ID":"e72c903a-9895-4415-b53b-0bdc75ee43de","Type":"ContainerStarted","Data":"c050905351272be83a55ebff28de8f96e9b5d2dae98a949bc7313edaa4a6fe85"} Jun 10 00:38:46.015962 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.015914 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b989568b-n66ht" event={"ID":"6bf6d6ae-b05c-4187-9d0a-606c84544e3d","Type":"ContainerStarted","Data":"e477e6998c7690d5c0da0f12a61155d03ac0f8d8a79b0ef55d14742c82ee4b9e"} Jun 10 00:38:46.037171 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.037096 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" podStartSLOduration=2.644963582 podStartE2EDuration="6.037073795s" totalImagesPullingTime="3.392110213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:46.034320512 +0000 UTC m=+200.241292420" watchObservedRunningTime="2026-06-10 00:38:46.037073795 +0000 UTC m=+200.244045683" Jun 10 00:38:46.052569 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:46.052516 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" podStartSLOduration=2.510452672 podStartE2EDuration="4.052494306s" totalImagesPullingTime="1.542041634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:46.050403091 +0000 UTC m=+200.257374995" watchObservedRunningTime="2026-06-10 00:38:46.052494306 +0000 UTC m=+200.259466194" Jun 10 00:38:47.023699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.023609 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" event={"ID":"96b25d3a-e958-4db8-8c78-9c78f9f114e4","Type":"ContainerStarted","Data":"9df7f67d8433ece57edb7abda08564345e3d12978820e17941f67bab21c4766f"} Jun 10 00:38:47.040563 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.040505 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" podStartSLOduration=3.533740122 podStartE2EDuration="5.040483812s" totalImagesPullingTime="1.50674369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:47.038822911 +0000 UTC m=+201.245794817" watchObservedRunningTime="2026-06-10 00:38:47.040483812 +0000 UTC m=+201.247455701" Jun 10 00:38:47.115240 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.115204 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:38:47.118733 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.118711 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.130997 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.130971 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:38:47.235211 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235252 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wptsh\" (UniqueName: \"kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235284 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235320 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235404 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.235706 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.235450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.317441 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.317296 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" containerID="cri-o://a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a" gracePeriod=30 Jun 10 00:38:47.336239 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wptsh\" (UniqueName: \"kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336353 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.336660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.336471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.337031 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.337004 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.337339 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.337319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.337339 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.337331 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.337539 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.337407 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.339370 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.339351 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.339587 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.339561 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.344049 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.344029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wptsh\" (UniqueName: \"kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh\") pod \"console-794df98858-c95ph\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.430318 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.430275 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:47.932494 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.932469 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:47.940682 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:47.940660 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:38:47.941799 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:38:47.941741 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d783922_09fc_48f1_8b78_b37691392073.slice/crio-72bc00df57d6a6fdd0202e74111789a7f559c859de884d0260c3314f39f882de WatchSource:0}: Error finding container 72bc00df57d6a6fdd0202e74111789a7f559c859de884d0260c3314f39f882de: Status 404 returned error can't find the container with id 72bc00df57d6a6fdd0202e74111789a7f559c859de884d0260c3314f39f882de Jun 10 00:38:48.029197 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.029096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794df98858-c95ph" event={"ID":"0d783922-09fc-48f1-8b78-b37691392073","Type":"ContainerStarted","Data":"4d3b68bf23cb88e04678fb7ecfa78616a3c126f0ccfc5a3f1c3424a57ef6d84e"} Jun 10 00:38:48.029197 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.029161 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794df98858-c95ph" event={"ID":"0d783922-09fc-48f1-8b78-b37691392073","Type":"ContainerStarted","Data":"72bc00df57d6a6fdd0202e74111789a7f559c859de884d0260c3314f39f882de"} Jun 10 00:38:48.030667 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.030641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b989568b-n66ht" event={"ID":"6bf6d6ae-b05c-4187-9d0a-606c84544e3d","Type":"ContainerStarted","Data":"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8"} Jun 10 00:38:48.031984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.031960 2583 generic.go:356] "Generic (PLEG): container finished" podID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerID="a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a" exitCode=0 Jun 10 00:38:48.032104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.031993 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" Jun 10 00:38:48.032104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.032046 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" event={"ID":"4b9a848d-7325-42ad-bc86-14bd91cb70e2","Type":"ContainerDied","Data":"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a"} Jun 10 00:38:48.032104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.032082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f54c6d5-rz59w" event={"ID":"4b9a848d-7325-42ad-bc86-14bd91cb70e2","Type":"ContainerDied","Data":"d026b49de6a902f2190fed26dcab8050cf845b00db33dd273d55db3f49f584a7"} Jun 10 00:38:48.032267 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.032107 2583 scope.go:117] "RemoveContainer" containerID="a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a" Jun 10 00:38:48.032439 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.032422 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:48.037958 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.037939 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-r4vrw" Jun 10 00:38:48.040671 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.040641 2583 scope.go:117] "RemoveContainer" containerID="a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a" Jun 10 00:38:48.041002 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:38:48.040981 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a\": container with ID starting with a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a not found: ID does not exist" containerID="a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a" Jun 10 00:38:48.041082 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.041008 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a"} err="failed to get container status \"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a\": rpc error: code = NotFound desc = could not find container \"a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a\": container with ID starting with a09d379bcdff7f139d298e11575925e3a79026fe2975401fb87471344f7dea7a not found: ID does not exist" Jun 10 00:38:48.045720 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045696 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88rbd\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.045818 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045757 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.045818 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045801 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.045912 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045833 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.045912 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045899 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.046006 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045927 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.046006 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045954 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.046006 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.045981 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") pod \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\" (UID: \"4b9a848d-7325-42ad-bc86-14bd91cb70e2\") " Jun 10 00:38:48.046791 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.046665 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:38:48.047349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.047309 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:38:48.047473 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.047327 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794df98858-c95ph" podStartSLOduration=1.047309271 podStartE2EDuration="1.047309271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:48.045729096 +0000 UTC m=+202.252700987" watchObservedRunningTime="2026-06-10 00:38:48.047309271 +0000 UTC m=+202.254281161" Jun 10 00:38:48.048983 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.048926 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:38:48.049059 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.048989 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:38:48.049334 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.049315 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:38:48.050438 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.050414 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd" (OuterVolumeSpecName: "kube-api-access-88rbd") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "kube-api-access-88rbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:38:48.050624 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.050607 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:38:48.058687 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.058660 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4b9a848d-7325-42ad-bc86-14bd91cb70e2" (UID: "4b9a848d-7325-42ad-bc86-14bd91cb70e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:38:48.062847 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.062804 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b989568b-n66ht" podStartSLOduration=1.250359362 podStartE2EDuration="4.062791007s" totalImagesPullingTime="2.812431645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:48.062036232 +0000 UTC m=+202.269008120" watchObservedRunningTime="2026-06-10 00:38:48.062791007 +0000 UTC m=+202.269762895" Jun 10 00:38:48.148136 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148090 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-certificates\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148136 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148124 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9a848d-7325-42ad-bc86-14bd91cb70e2-trusted-ca\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148136 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148141 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-installation-pull-secrets\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148406 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148180 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-bound-sa-token\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148406 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148204 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9a848d-7325-42ad-bc86-14bd91cb70e2-image-registry-private-configuration\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148406 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148220 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9a848d-7325-42ad-bc86-14bd91cb70e2-ca-trust-extracted\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148406 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148236 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-registry-tls\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.148406 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.148246 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88rbd\" (UniqueName: \"kubernetes.io/projected/4b9a848d-7325-42ad-bc86-14bd91cb70e2-kube-api-access-88rbd\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:38:48.347678 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.347645 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:38:48.352672 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:48.352647 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-544f54c6d5-rz59w"] Jun 10 00:38:50.210487 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:50.210454 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" path="/var/lib/kubelet/pods/4b9a848d-7325-42ad-bc86-14bd91cb70e2/volumes" Jun 10 00:38:52.030501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:52.030473 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7594775456-slsgg" Jun 10 00:38:52.663516 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:52.663470 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:52.663672 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:52.663537 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:53.897106 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:53.897070 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:38:53.897503 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:53.897118 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:38:54.493196 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:54.493151 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:54.493447 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:54.493250 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:38:54.494767 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:54.494742 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:38:54.494845 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:54.494786 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:38:57.430952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:57.430918 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:57.431372 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:57.430998 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:38:57.432315 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:57.432293 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:38:57.432446 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:38:57.432342 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:02.663794 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.663761 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:02.664287 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.663816 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:02.664287 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.663859 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:39:02.664443 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.664384 2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87"} pod="openshift-image-registry/image-registry-56d59977fc-jg544" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 00:39:02.668251 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.668225 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:02.668382 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.668263 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:02.937582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.937490 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:39:02.937582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:02.937562 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:39:04.492843 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:04.492807 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:04.493216 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:04.492859 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:07.430711 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:07.430672 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:07.431115 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:07.430734 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:12.668240 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:12.668206 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:12.668638 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:12.668255 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:14.492729 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:14.492693 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:14.493106 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:14.492739 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:17.431351 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:17.431309 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:17.431765 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:17.431371 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:22.668295 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:22.668266 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:22.668699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:22.668313 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:22.943541 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:22.943461 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:39:22.949042 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:22.949014 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b65cfdb59-65v9w" Jun 10 00:39:24.492974 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:24.492934 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:24.493375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:24.492998 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:26.174375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:26.174347 2583 generic.go:356] "Generic (PLEG): container finished" podID="e655c243-6f8a-4f11-8f53-0442224c1b7a" containerID="58482944854a812e4a32a1c2f30a2b675d6258d9b189a7b8237aa8e6edb54b33" exitCode=0 Jun 10 00:39:26.174722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:26.174417 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" event={"ID":"e655c243-6f8a-4f11-8f53-0442224c1b7a","Type":"ContainerDied","Data":"58482944854a812e4a32a1c2f30a2b675d6258d9b189a7b8237aa8e6edb54b33"} Jun 10 00:39:26.174722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:26.174680 2583 scope.go:117] "RemoveContainer" containerID="58482944854a812e4a32a1c2f30a2b675d6258d9b189a7b8237aa8e6edb54b33" Jun 10 00:39:27.180207 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:27.180173 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wg4z6" event={"ID":"e655c243-6f8a-4f11-8f53-0442224c1b7a","Type":"ContainerStarted","Data":"80a1526c2adde497fcaae169f2a3ec7e31c38bfc8a931e73012761bb85b2288d"} Jun 10 00:39:27.431141 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:27.431042 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:27.431141 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:27.431114 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:27.683882 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:27.683787 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" containerID="cri-o://edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87" gracePeriod=30 Jun 10 00:39:29.190633 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:29.190598 2583 generic.go:356] "Generic (PLEG): container finished" podID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerID="edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87" exitCode=0 Jun 10 00:39:29.191000 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:29.190675 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerDied","Data":"edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87"} Jun 10 00:39:29.191000 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:29.190745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerStarted","Data":"eb1a63548e9071889727b032d73c5b8a8341d2ef088444e8a51350f40e4e16d1"} Jun 10 00:39:29.191000 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:29.190937 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:39:31.200810 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:31.200777 2583 generic.go:356] "Generic (PLEG): container finished" podID="bf292f7a-a47f-4600-af2e-5b25423c30dd" containerID="148cc7df1937ce0754a523d98918f43cdb744f83137b69972081381a276f1753" exitCode=0 Jun 10 00:39:31.201175 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:31.200843 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" event={"ID":"bf292f7a-a47f-4600-af2e-5b25423c30dd","Type":"ContainerDied","Data":"148cc7df1937ce0754a523d98918f43cdb744f83137b69972081381a276f1753"} Jun 10 00:39:31.201175 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:31.201142 2583 scope.go:117] "RemoveContainer" containerID="148cc7df1937ce0754a523d98918f43cdb744f83137b69972081381a276f1753" Jun 10 00:39:32.209448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:32.209413 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7jjnk" event={"ID":"bf292f7a-a47f-4600-af2e-5b25423c30dd","Type":"ContainerStarted","Data":"f1cacf659707fc18a95793736545706d8c7f0ff006fa8d66134d4e5457f133ed"} Jun 10 00:39:34.493415 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:34.493352 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:34.493966 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:34.493434 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:37.431239 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:37.431201 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:37.431618 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:37.431257 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:37.838747 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:37.838668 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-s9lcw_38fb5233-8ea1-42ba-8520-5cf3409e3154/cluster-monitoring-operator/0.log" Jun 10 00:39:38.064578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.064546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:39:38.066975 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.066953 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149a7194-c82c-4d12-a165-c8dcb4bd8561-metrics-certs\") pod \"network-metrics-daemon-mkrmd\" (UID: \"149a7194-c82c-4d12-a165-c8dcb4bd8561\") " pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:39:38.209569 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.209545 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:39:38.217770 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.217749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkrmd" Jun 10 00:39:38.344416 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.344370 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkrmd"] Jun 10 00:39:38.346267 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:39:38.346239 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149a7194_c82c_4d12_a165_c8dcb4bd8561.slice/crio-81a56f329cc29d8e26180c0289d73958c3c96a0e51841a75b529b73499dc4083 WatchSource:0}: Error finding container 81a56f329cc29d8e26180c0289d73958c3c96a0e51841a75b529b73499dc4083: Status 404 returned error can't find the container with id 81a56f329cc29d8e26180c0289d73958c3c96a0e51841a75b529b73499dc4083 Jun 10 00:39:38.625936 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.625901 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b65cfdb59-65v9w_e72c903a-9895-4415-b53b-0bdc75ee43de/metrics-server/0.log" Jun 10 00:39:38.825668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:38.825634 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-r4vrw_96b25d3a-e958-4db8-8c78-9c78f9f114e4/monitoring-plugin/0.log" Jun 10 00:39:39.026309 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:39.026233 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/init-textfile/0.log" Jun 10 00:39:39.227072 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:39.227051 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/node-exporter/0.log" Jun 10 00:39:39.233189 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:39.233155 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkrmd" event={"ID":"149a7194-c82c-4d12-a165-c8dcb4bd8561","Type":"ContainerStarted","Data":"81a56f329cc29d8e26180c0289d73958c3c96a0e51841a75b529b73499dc4083"} Jun 10 00:39:39.426285 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:39.426257 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/kube-rbac-proxy/0.log" Jun 10 00:39:40.239283 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:40.239244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkrmd" event={"ID":"149a7194-c82c-4d12-a165-c8dcb4bd8561","Type":"ContainerStarted","Data":"9ccbbcf5633b108fb5859007095ee837f317d6b731abffca7a371b6a298be974"} Jun 10 00:39:40.239681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:40.239301 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkrmd" event={"ID":"149a7194-c82c-4d12-a165-c8dcb4bd8561","Type":"ContainerStarted","Data":"a8699a272beb519323b3038e7ddd7498663f7698482b884c06be5e6527553691"} Jun 10 00:39:40.255677 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:40.255633 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mkrmd" podStartSLOduration=253.451718513 podStartE2EDuration="4m14.255619115s" totalImagesPullingTime="803.900602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:39:40.253841742 +0000 UTC m=+254.460813631" watchObservedRunningTime="2026-06-10 00:39:40.255619115 +0000 UTC m=+254.462591002" Jun 10 00:39:40.826355 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:40.826325 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/kube-rbac-proxy-main/0.log" Jun 10 00:39:41.026590 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:41.026558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/kube-rbac-proxy-self/0.log" Jun 10 00:39:41.225646 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:41.225618 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/openshift-state-metrics/0.log" Jun 10 00:39:42.664639 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:42.664607 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:42.664986 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:42.664666 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:44.026976 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.026895 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/thanos-query/0.log" Jun 10 00:39:44.225842 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.225810 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-web/0.log" Jun 10 00:39:44.426621 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.426592 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy/0.log" Jun 10 00:39:44.493504 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.493462 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:44.493692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.493522 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:44.627082 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.627047 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/prom-label-proxy/0.log" Jun 10 00:39:44.827300 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:44.827226 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-rules/0.log" Jun 10 00:39:45.026105 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:45.026073 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-metrics/0.log" Jun 10 00:39:45.229038 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:45.229010 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-4qn9l_fb78a89d-c309-40fa-872c-30b9981227e4/networking-console-plugin/0.log" Jun 10 00:39:45.426492 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:45.426462 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:39:45.628690 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:45.628661 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/2.log" Jun 10 00:39:45.826794 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:45.826764 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-794df98858-c95ph_0d783922-09fc-48f1-8b78-b37691392073/console/0.log" Jun 10 00:39:46.027231 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:46.027161 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b989568b-n66ht_6bf6d6ae-b05c-4187-9d0a-606c84544e3d/console/0.log" Jun 10 00:39:47.430944 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:47.430908 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:47.431318 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:47.430961 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:39:48.026613 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:48.026584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h75v9_f94943c1-6986-406d-a1dc-cdb4fe06f609/dns-node-resolver/0.log" Jun 10 00:39:48.226540 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:48.226513 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56d59977fc-jg544_e34da380-8e20-4d34-bb92-06d2d3c04260/registry/0.log" Jun 10 00:39:48.426968 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:48.426935 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56d59977fc-jg544_e34da380-8e20-4d34-bb92-06d2d3c04260/registry/1.log" Jun 10 00:39:48.826734 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:48.826655 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk27l_c6479644-4443-4a98-95f8-fea58335c6e4/node-ca/0.log" Jun 10 00:39:49.825927 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:49.825894 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7k6ln_1fb03565-aff6-42fb-96f8-3c1efa0e87c3/serve-healthcheck-canary/0.log" Jun 10 00:39:50.201583 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:50.201551 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:50.201931 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:50.201610 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:52.666477 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:52.666442 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:39:52.666844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:52.666506 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:39:54.492538 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.492499 2583 patch_prober.go:28] interesting pod/console-b989568b-n66ht container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 10 00:39:54.492930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.492550 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 10 00:39:54.915572 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.915527 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:39:54.941071 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.941036 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:39:54.941353 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.941340 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" Jun 10 00:39:54.941416 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.941355 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" Jun 10 00:39:54.941458 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.941434 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9a848d-7325-42ad-bc86-14bd91cb70e2" containerName="registry" Jun 10 00:39:54.944149 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.944130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:54.954178 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.954152 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:39:54.999757 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999728 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:54.999930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526ln\" (UniqueName: \"kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:54.999930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999803 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:54.999930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.000028 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999932 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.000028 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.000028 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:54.999992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.100721 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.100682 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.100721 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.100722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.100959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.100754 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101018 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.100977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101076 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526ln\" (UniqueName: \"kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101076 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101619 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101581 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101756 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101719 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101827 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101793 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.101827 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.101796 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.103319 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.103295 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.103454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.103434 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.110042 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.110024 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-526ln\" (UniqueName: \"kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln\") pod \"console-7b575bdf86-2cmdr\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.253695 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.253601 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:39:55.384071 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:55.384035 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:39:55.386856 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:39:55.386830 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58844cf9_e19f_4f1b_b2f9_d5754e5e24db.slice/crio-e08f66b153dfb121bdbdf23745121af7e59292c3b875e064ab71ef1727bbd406 WatchSource:0}: Error finding container e08f66b153dfb121bdbdf23745121af7e59292c3b875e064ab71ef1727bbd406: Status 404 returned error can't find the container with id e08f66b153dfb121bdbdf23745121af7e59292c3b875e064ab71ef1727bbd406 Jun 10 00:39:56.308451 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:56.308414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575bdf86-2cmdr" event={"ID":"58844cf9-e19f-4f1b-b2f9-d5754e5e24db","Type":"ContainerStarted","Data":"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a"} Jun 10 00:39:56.308835 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:56.308464 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575bdf86-2cmdr" event={"ID":"58844cf9-e19f-4f1b-b2f9-d5754e5e24db","Type":"ContainerStarted","Data":"e08f66b153dfb121bdbdf23745121af7e59292c3b875e064ab71ef1727bbd406"} Jun 10 00:39:56.327012 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:56.326968 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b575bdf86-2cmdr" podStartSLOduration=2.326953548 podStartE2EDuration="2.326953548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:39:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:39:56.326650799 +0000 UTC m=+270.533622710" watchObservedRunningTime="2026-06-10 00:39:56.326953548 +0000 UTC m=+270.533925435" Jun 10 00:39:57.431123 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:57.431081 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:39:57.431593 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:39:57.431151 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:40:00.200033 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:00.199995 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:40:00.200459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:00.200049 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:40:02.663522 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.663484 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:40:02.663896 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.663566 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:40:02.663896 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.663618 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:40:02.664255 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.664230 2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"eb1a63548e9071889727b032d73c5b8a8341d2ef088444e8a51350f40e4e16d1"} pod="openshift-image-registry/image-registry-56d59977fc-jg544" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 00:40:02.668047 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.668021 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:40:02.668164 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:02.668060 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:40:05.254506 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:05.254474 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:40:05.254816 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:05.254607 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:40:05.255875 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:05.255855 2583 patch_prober.go:28] interesting pod/console-7b575bdf86-2cmdr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" start-of-body= Jun 10 00:40:05.255926 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:05.255905 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b575bdf86-2cmdr" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" Jun 10 00:40:07.430962 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:07.430927 2583 patch_prober.go:28] interesting pod/console-794df98858-c95ph container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" start-of-body= Jun 10 00:40:07.431454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:07.430986 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" probeResult="failure" output="Get \"https://10.134.0.24:8443/health\": dial tcp 10.134.0.24:8443: connect: connection refused" Jun 10 00:40:07.822908 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:40:07.822816 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4vww" podUID="6706430f-e440-41af-8a79-617fe0897a2f" Jun 10 00:40:08.366880 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:08.366850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:11.146320 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:11.146264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:11.148856 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:11.148830 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6706430f-e440-41af-8a79-617fe0897a2f-metrics-tls\") pod \"dns-default-s4vww\" (UID: \"6706430f-e440-41af-8a79-617fe0897a2f\") " pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:11.371156 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:11.371122 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:40:11.377920 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:11.377898 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:11.504256 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:11.504214 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4vww"] Jun 10 00:40:11.505814 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:40:11.505782 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6706430f_e440_41af_8a79_617fe0897a2f.slice/crio-4b6d54e25f4086a348d459062eed73cb12a67c9037630e5661ecaa628535c50e WatchSource:0}: Error finding container 4b6d54e25f4086a348d459062eed73cb12a67c9037630e5661ecaa628535c50e: Status 404 returned error can't find the container with id 4b6d54e25f4086a348d459062eed73cb12a67c9037630e5661ecaa628535c50e Jun 10 00:40:12.386589 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:12.386550 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4vww" event={"ID":"6706430f-e440-41af-8a79-617fe0897a2f","Type":"ContainerStarted","Data":"4b6d54e25f4086a348d459062eed73cb12a67c9037630e5661ecaa628535c50e"} Jun 10 00:40:12.669289 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:12.669204 2583 patch_prober.go:28] interesting pod/image-registry-56d59977fc-jg544 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:40:12.669289 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:12.669262 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:40:13.391884 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:13.391847 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4vww" event={"ID":"6706430f-e440-41af-8a79-617fe0897a2f","Type":"ContainerStarted","Data":"d606c0b6f6f2e0f4f1c8287d328f249cc8714c825aa6057552194b87f0c5f4cb"} Jun 10 00:40:13.392275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:13.391901 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4vww" event={"ID":"6706430f-e440-41af-8a79-617fe0897a2f","Type":"ContainerStarted","Data":"464631a23f7efbe756cef01130e513138e433e492ccee7dee0368a9a674512c1"} Jun 10 00:40:13.392275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:13.391958 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:13.408683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:13.408626 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s4vww" podStartSLOduration=250.984154799 podStartE2EDuration="4m12.408610168s" totalImagesPullingTime="1.424455369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:40:13.408144238 +0000 UTC m=+287.615116144" watchObservedRunningTime="2026-06-10 00:40:13.408610168 +0000 UTC m=+287.615582057" Jun 10 00:40:15.254244 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:15.254209 2583 patch_prober.go:28] interesting pod/console-7b575bdf86-2cmdr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" start-of-body= Jun 10 00:40:15.254637 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:15.254269 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b575bdf86-2cmdr" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" Jun 10 00:40:17.435127 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:17.435096 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:40:17.438943 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:17.438917 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:40:19.935859 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:19.935796 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b989568b-n66ht" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" containerID="cri-o://2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8" gracePeriod=15 Jun 10 00:40:20.183895 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.183870 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:40:20.331144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331051 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331101 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331140 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331165 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtsfm\" (UniqueName: \"kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331212 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331236 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331295 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca\") pod \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\" (UID: \"6bf6d6ae-b05c-4187-9d0a-606c84544e3d\") " Jun 10 00:40:20.331735 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331687 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:20.331735 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331710 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:20.331996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331739 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:20.331996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.331972 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config" (OuterVolumeSpecName: "console-config") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:20.333535 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.333513 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:20.334149 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.334122 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:20.334149 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.334128 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm" (OuterVolumeSpecName: "kube-api-access-xtsfm") pod "6bf6d6ae-b05c-4187-9d0a-606c84544e3d" (UID: "6bf6d6ae-b05c-4187-9d0a-606c84544e3d"). InnerVolumeSpecName "kube-api-access-xtsfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:20.421316 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.421279 2583 generic.go:356] "Generic (PLEG): container finished" podID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerID="2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8" exitCode=0 Jun 10 00:40:20.421510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.421334 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b989568b-n66ht" Jun 10 00:40:20.421510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.421362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b989568b-n66ht" event={"ID":"6bf6d6ae-b05c-4187-9d0a-606c84544e3d","Type":"ContainerDied","Data":"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8"} Jun 10 00:40:20.421510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.421436 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b989568b-n66ht" event={"ID":"6bf6d6ae-b05c-4187-9d0a-606c84544e3d","Type":"ContainerDied","Data":"e477e6998c7690d5c0da0f12a61155d03ac0f8d8a79b0ef55d14742c82ee4b9e"} Jun 10 00:40:20.421510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.421456 2583 scope.go:117] "RemoveContainer" containerID="2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8" Jun 10 00:40:20.430352 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.430332 2583 scope.go:117] "RemoveContainer" containerID="2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8" Jun 10 00:40:20.430629 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:40:20.430612 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8\": container with ID starting with 2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8 not found: ID does not exist" containerID="2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8" Jun 10 00:40:20.430683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.430637 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8"} err="failed to get container status \"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8\": rpc error: code = NotFound desc = could not find container \"2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8\": container with ID starting with 2cac63898fee7dfe9050190199332ae21b005dbe2eb45c457174c74ff27601c8 not found: ID does not exist" Jun 10 00:40:20.431992 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.431975 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432036 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.431996 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-oauth-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432036 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.432005 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtsfm\" (UniqueName: \"kubernetes.io/projected/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-kube-api-access-xtsfm\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432036 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.432018 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-trusted-ca-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432036 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.432030 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432206 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.432038 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-service-ca\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.432206 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.432046 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bf6d6ae-b05c-4187-9d0a-606c84544e3d-console-oauth-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:20.441645 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.441621 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:40:20.445003 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:20.444983 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b989568b-n66ht"] Jun 10 00:40:22.210338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:22.210305 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" path="/var/lib/kubelet/pods/6bf6d6ae-b05c-4187-9d0a-606c84544e3d/volumes" Jun 10 00:40:22.668775 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:22.668750 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:40:23.398151 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:23.398115 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s4vww" Jun 10 00:40:25.259041 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:25.259013 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:40:25.262794 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:25.262770 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:40:25.323520 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:25.323492 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:40:26.157333 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:26.157294 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:40:26.158151 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:26.158127 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:40:26.167699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:26.167679 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:40:26.168174 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:26.168153 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:40:26.170366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:26.170348 2583 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 00:40:27.684359 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:27.684313 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56d59977fc-jg544" podUID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerName="registry" containerID="cri-o://eb1a63548e9071889727b032d73c5b8a8341d2ef088444e8a51350f40e4e16d1" gracePeriod=30 Jun 10 00:40:29.462227 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:29.462189 2583 generic.go:356] "Generic (PLEG): container finished" podID="e34da380-8e20-4d34-bb92-06d2d3c04260" containerID="eb1a63548e9071889727b032d73c5b8a8341d2ef088444e8a51350f40e4e16d1" exitCode=0 Jun 10 00:40:29.462665 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:29.462276 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerDied","Data":"eb1a63548e9071889727b032d73c5b8a8341d2ef088444e8a51350f40e4e16d1"} Jun 10 00:40:29.462665 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:29.462335 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:40:29.462665 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:29.462357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56d59977fc-jg544" event={"ID":"e34da380-8e20-4d34-bb92-06d2d3c04260","Type":"ContainerStarted","Data":"1cf640d0df9d191a0c639c10951efdaba70c401d84bda681ce45ae8f92ff2eca"} Jun 10 00:40:29.462665 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:29.462383 2583 scope.go:117] "RemoveContainer" containerID="edbcd06eb277698564de112ac9133859943f5a51b61bbf9c9c4ef899d82dcd87" Jun 10 00:40:50.347338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.347295 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-794df98858-c95ph" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" containerID="cri-o://4d3b68bf23cb88e04678fb7ecfa78616a3c126f0ccfc5a3f1c3424a57ef6d84e" gracePeriod=15 Jun 10 00:40:50.475376 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.475341 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56d59977fc-jg544" Jun 10 00:40:50.552556 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.552523 2583 generic.go:356] "Generic (PLEG): container finished" podID="0d783922-09fc-48f1-8b78-b37691392073" containerID="4d3b68bf23cb88e04678fb7ecfa78616a3c126f0ccfc5a3f1c3424a57ef6d84e" exitCode=0 Jun 10 00:40:50.552900 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.552594 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794df98858-c95ph" event={"ID":"0d783922-09fc-48f1-8b78-b37691392073","Type":"ContainerDied","Data":"4d3b68bf23cb88e04678fb7ecfa78616a3c126f0ccfc5a3f1c3424a57ef6d84e"} Jun 10 00:40:50.602595 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.602537 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:40:50.683067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683030 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683084 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683294 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683112 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683294 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683127 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683294 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683255 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683294 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683292 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wptsh\" (UniqueName: \"kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683520 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683319 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config\") pod \"0d783922-09fc-48f1-8b78-b37691392073\" (UID: \"0d783922-09fc-48f1-8b78-b37691392073\") " Jun 10 00:40:50.683578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683548 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config" (OuterVolumeSpecName: "console-config") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:50.683578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683557 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:50.683578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683567 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:50.683968 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.683946 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:50.685764 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.685730 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:50.685860 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.685775 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:50.685860 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.685803 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh" (OuterVolumeSpecName: "kube-api-access-wptsh") pod "0d783922-09fc-48f1-8b78-b37691392073" (UID: "0d783922-09fc-48f1-8b78-b37691392073"). InnerVolumeSpecName "kube-api-access-wptsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:50.784525 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784486 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-trusted-ca-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784525 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784517 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-console-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784525 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784530 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784525 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784538 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-service-ca\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784547 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d783922-09fc-48f1-8b78-b37691392073-oauth-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784555 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wptsh\" (UniqueName: \"kubernetes.io/projected/0d783922-09fc-48f1-8b78-b37691392073-kube-api-access-wptsh\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:50.784782 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:50.784564 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d783922-09fc-48f1-8b78-b37691392073-console-oauth-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:40:51.558367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:51.558333 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794df98858-c95ph" event={"ID":"0d783922-09fc-48f1-8b78-b37691392073","Type":"ContainerDied","Data":"72bc00df57d6a6fdd0202e74111789a7f559c859de884d0260c3314f39f882de"} Jun 10 00:40:51.558828 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:51.558375 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794df98858-c95ph" Jun 10 00:40:51.558828 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:51.558415 2583 scope.go:117] "RemoveContainer" containerID="4d3b68bf23cb88e04678fb7ecfa78616a3c126f0ccfc5a3f1c3424a57ef6d84e" Jun 10 00:40:51.579430 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:51.579381 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:40:51.585281 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:51.585255 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794df98858-c95ph"] Jun 10 00:40:52.210370 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:40:52.210338 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d783922-09fc-48f1-8b78-b37691392073" path="/var/lib/kubelet/pods/0d783922-09fc-48f1-8b78-b37691392073/volumes" Jun 10 00:43:57.957329 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957286 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6dbfcff9-9v6vc"] Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957627 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957641 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957654 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957661 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957731 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf6d6ae-b05c-4187-9d0a-606c84544e3d" containerName="console" Jun 10 00:43:57.957849 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.957746 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d783922-09fc-48f1-8b78-b37691392073" containerName="console" Jun 10 00:43:57.960564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.960546 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.977932 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.977910 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6dbfcff9-9v6vc"] Jun 10 00:43:57.996366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-console-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996536 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-oauth-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996536 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996406 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-service-ca\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996536 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996430 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2ghs\" (UniqueName: \"kubernetes.io/projected/df3df779-de86-43a2-9608-f94e19a749a8-kube-api-access-d2ghs\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996536 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-oauth-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996765 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:57.996765 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:57.996654 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-trusted-ca-bundle\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097490 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097453 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-oauth-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097490 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-service-ca\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097721 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2ghs\" (UniqueName: \"kubernetes.io/projected/df3df779-de86-43a2-9608-f94e19a749a8-kube-api-access-d2ghs\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097721 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-oauth-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097823 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097823 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097771 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-trusted-ca-bundle\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.097823 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.097815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-console-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.098449 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.098370 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-oauth-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.098585 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.098477 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-service-ca\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.098654 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.098579 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-console-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.098654 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.098626 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df3df779-de86-43a2-9608-f94e19a749a8-trusted-ca-bundle\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.100093 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.100064 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-oauth-config\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.100271 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.100250 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df3df779-de86-43a2-9608-f94e19a749a8-console-serving-cert\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.105551 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.105530 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2ghs\" (UniqueName: \"kubernetes.io/projected/df3df779-de86-43a2-9608-f94e19a749a8-kube-api-access-d2ghs\") pod \"console-5f6dbfcff9-9v6vc\" (UID: \"df3df779-de86-43a2-9608-f94e19a749a8\") " pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.270728 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.270635 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:43:58.406692 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:58.406662 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6dbfcff9-9v6vc"] Jun 10 00:43:58.409208 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:43:58.409169 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3df779_de86_43a2_9608_f94e19a749a8.slice/crio-6dd4ac0c1ddba7b55a08d8f1be9d2c5be693f5dfeb6fc25b7bf994d0f90abcd7 WatchSource:0}: Error finding container 6dd4ac0c1ddba7b55a08d8f1be9d2c5be693f5dfeb6fc25b7bf994d0f90abcd7: Status 404 returned error can't find the container with id 6dd4ac0c1ddba7b55a08d8f1be9d2c5be693f5dfeb6fc25b7bf994d0f90abcd7 Jun 10 00:43:59.308195 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:59.308156 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dbfcff9-9v6vc" event={"ID":"df3df779-de86-43a2-9608-f94e19a749a8","Type":"ContainerStarted","Data":"e06a0912942eecb9b8cb73ada459d2c0dfb37c9820e8e9dc1e5a9db50cce0cce"} Jun 10 00:43:59.308195 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:59.308203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dbfcff9-9v6vc" event={"ID":"df3df779-de86-43a2-9608-f94e19a749a8","Type":"ContainerStarted","Data":"6dd4ac0c1ddba7b55a08d8f1be9d2c5be693f5dfeb6fc25b7bf994d0f90abcd7"} Jun 10 00:43:59.324559 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:43:59.324513 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6dbfcff9-9v6vc" podStartSLOduration=2.324498491 podStartE2EDuration="2.324498491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:43:59.323456471 +0000 UTC m=+513.530428380" watchObservedRunningTime="2026-06-10 00:43:59.324498491 +0000 UTC m=+513.531470378" Jun 10 00:44:08.271243 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:08.271137 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:44:08.271243 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:08.271211 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:44:08.276318 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:08.276294 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:44:08.346656 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:08.346626 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6dbfcff9-9v6vc" Jun 10 00:44:08.387669 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:08.387628 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:44:33.415483 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.415346 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b575bdf86-2cmdr" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" containerID="cri-o://6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a" gracePeriod=15 Jun 10 00:44:33.664011 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.663986 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:44:33.811821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811738 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.811821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811779 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-526ln\" (UniqueName: \"kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.811821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811795 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.812091 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811837 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.812091 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811877 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.812091 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.811904 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.812091 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812016 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert\") pod \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\" (UID: \"58844cf9-e19f-4f1b-b2f9-d5754e5e24db\") " Jun 10 00:44:33.812326 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812295 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca" (OuterVolumeSpecName: "service-ca") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:44:33.812384 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812331 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:44:33.812384 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812341 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config" (OuterVolumeSpecName: "console-config") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:44:33.812510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812417 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:44:33.812838 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812820 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-oauth-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.812875 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812845 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-service-ca\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.812875 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812859 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-trusted-ca-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.812939 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.812872 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.814146 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.814117 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:44:33.814246 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.814175 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:44:33.814246 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.814207 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln" (OuterVolumeSpecName: "kube-api-access-526ln") pod "58844cf9-e19f-4f1b-b2f9-d5754e5e24db" (UID: "58844cf9-e19f-4f1b-b2f9-d5754e5e24db"). InnerVolumeSpecName "kube-api-access-526ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:44:33.913718 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.913664 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-serving-cert\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.913718 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.913712 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-526ln\" (UniqueName: \"kubernetes.io/projected/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-kube-api-access-526ln\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:33.913718 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:33.913722 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58844cf9-e19f-4f1b-b2f9-d5754e5e24db-console-oauth-config\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:44:34.448680 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.448649 2583 generic.go:356] "Generic (PLEG): container finished" podID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerID="6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a" exitCode=0 Jun 10 00:44:34.449066 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.448695 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575bdf86-2cmdr" Jun 10 00:44:34.449066 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.448734 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575bdf86-2cmdr" event={"ID":"58844cf9-e19f-4f1b-b2f9-d5754e5e24db","Type":"ContainerDied","Data":"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a"} Jun 10 00:44:34.449066 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.448783 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575bdf86-2cmdr" event={"ID":"58844cf9-e19f-4f1b-b2f9-d5754e5e24db","Type":"ContainerDied","Data":"e08f66b153dfb121bdbdf23745121af7e59292c3b875e064ab71ef1727bbd406"} Jun 10 00:44:34.449066 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.448807 2583 scope.go:117] "RemoveContainer" containerID="6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a" Jun 10 00:44:34.457187 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.457168 2583 scope.go:117] "RemoveContainer" containerID="6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a" Jun 10 00:44:34.457514 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:44:34.457493 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a\": container with ID starting with 6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a not found: ID does not exist" containerID="6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a" Jun 10 00:44:34.457599 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.457521 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a"} err="failed to get container status \"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a\": rpc error: code = NotFound desc = could not find container \"6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a\": container with ID starting with 6e21e684664a6226498b1c8785019025c75e79a5ab65b7982863819e92a7dd6a not found: ID does not exist" Jun 10 00:44:34.464242 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.464217 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:44:34.467900 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:34.467846 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b575bdf86-2cmdr"] Jun 10 00:44:36.210148 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:44:36.210119 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" path="/var/lib/kubelet/pods/58844cf9-e19f-4f1b-b2f9-d5754e5e24db/volumes" Jun 10 00:45:26.183078 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:26.183048 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:45:26.184899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:26.184877 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:45:26.191730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:26.191709 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:45:26.193713 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:26.193695 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:45:42.371259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.371220 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7"] Jun 10 00:45:42.372751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.371533 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" Jun 10 00:45:42.372751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.371543 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" Jun 10 00:45:42.372751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.371605 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58844cf9-e19f-4f1b-b2f9-d5754e5e24db" containerName="console" Jun 10 00:45:42.373601 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.373586 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.376327 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.376304 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:45:42.377561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.377535 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:45:42.377561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.377552 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:45:42.381985 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.381963 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7"] Jun 10 00:45:42.464368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.464337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.464368 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.464370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.464581 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.464411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtcj\" (UniqueName: \"kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.565556 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.565520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.565556 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.565560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.565791 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.565588 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtcj\" (UniqueName: \"kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.565933 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.565912 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.566009 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.565967 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.573711 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.573685 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtcj\" (UniqueName: \"kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.682759 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.682686 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:45:42.809329 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.809301 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7"] Jun 10 00:45:42.810990 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:45:42.810959 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode398f4b7_311b_4de3_866f_7760cc873a58.slice/crio-94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62 WatchSource:0}: Error finding container 94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62: Status 404 returned error can't find the container with id 94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62 Jun 10 00:45:42.812886 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:42.812870 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:45:43.728755 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:43.728717 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" event={"ID":"e398f4b7-311b-4de3-866f-7760cc873a58","Type":"ContainerStarted","Data":"94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62"} Jun 10 00:45:49.756838 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:49.756750 2583 generic.go:356] "Generic (PLEG): container finished" podID="e398f4b7-311b-4de3-866f-7760cc873a58" containerID="3f7b6bcbf70b46aee0dd6c2c73d3a279a4687ce1679af81dfca126cf8fffd9bd" exitCode=0 Jun 10 00:45:49.756838 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:49.756807 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" event={"ID":"e398f4b7-311b-4de3-866f-7760cc873a58","Type":"ContainerDied","Data":"3f7b6bcbf70b46aee0dd6c2c73d3a279a4687ce1679af81dfca126cf8fffd9bd"} Jun 10 00:45:53.774524 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:53.774486 2583 generic.go:356] "Generic (PLEG): container finished" podID="e398f4b7-311b-4de3-866f-7760cc873a58" containerID="a0987c57a69bafa138565c382998f7dcd02c9b374f4e4a0929acdbbb257addac" exitCode=0 Jun 10 00:45:53.774935 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:45:53.774540 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" event={"ID":"e398f4b7-311b-4de3-866f-7760cc873a58","Type":"ContainerDied","Data":"a0987c57a69bafa138565c382998f7dcd02c9b374f4e4a0929acdbbb257addac"} Jun 10 00:46:03.826058 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:03.826019 2583 generic.go:356] "Generic (PLEG): container finished" podID="e398f4b7-311b-4de3-866f-7760cc873a58" containerID="be90884b8e35c96069f79b737ce3091ea7b92830854c122b4d48316c870c5824" exitCode=0 Jun 10 00:46:03.826442 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:03.826105 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" event={"ID":"e398f4b7-311b-4de3-866f-7760cc873a58","Type":"ContainerDied","Data":"be90884b8e35c96069f79b737ce3091ea7b92830854c122b4d48316c870c5824"} Jun 10 00:46:04.977471 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:04.977441 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:46:05.060851 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.060813 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util\") pod \"e398f4b7-311b-4de3-866f-7760cc873a58\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " Jun 10 00:46:05.061039 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.060866 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtcj\" (UniqueName: \"kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj\") pod \"e398f4b7-311b-4de3-866f-7760cc873a58\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " Jun 10 00:46:05.061039 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.060914 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle\") pod \"e398f4b7-311b-4de3-866f-7760cc873a58\" (UID: \"e398f4b7-311b-4de3-866f-7760cc873a58\") " Jun 10 00:46:05.061660 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.061636 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle" (OuterVolumeSpecName: "bundle") pod "e398f4b7-311b-4de3-866f-7760cc873a58" (UID: "e398f4b7-311b-4de3-866f-7760cc873a58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:05.063216 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.063188 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj" (OuterVolumeSpecName: "kube-api-access-6rtcj") pod "e398f4b7-311b-4de3-866f-7760cc873a58" (UID: "e398f4b7-311b-4de3-866f-7760cc873a58"). InnerVolumeSpecName "kube-api-access-6rtcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:46:05.066429 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.066383 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util" (OuterVolumeSpecName: "util") pod "e398f4b7-311b-4de3-866f-7760cc873a58" (UID: "e398f4b7-311b-4de3-866f-7760cc873a58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:05.161730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.161699 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:05.161730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.161727 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e398f4b7-311b-4de3-866f-7760cc873a58-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:05.161926 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.161736 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtcj\" (UniqueName: \"kubernetes.io/projected/e398f4b7-311b-4de3-866f-7760cc873a58-kube-api-access-6rtcj\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:05.836007 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.835976 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" Jun 10 00:46:05.836173 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.835974 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlhvc7" event={"ID":"e398f4b7-311b-4de3-866f-7760cc873a58","Type":"ContainerDied","Data":"94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62"} Jun 10 00:46:05.836173 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:05.836095 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94eace35f73ae1e412cba5d010f6fc35fe5f2c5b58c949afbac80947a9427a62" Jun 10 00:46:10.069643 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069595 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7"] Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069921 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="util" Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069932 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="util" Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069948 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="pull" Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069953 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="pull" Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069961 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="extract" Jun 10 00:46:10.069999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.069965 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="extract" Jun 10 00:46:10.070198 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.070019 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e398f4b7-311b-4de3-866f-7760cc873a58" containerName="extract" Jun 10 00:46:10.071996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.071979 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.074973 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.074946 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:46:10.075100 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.075033 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mrgfx\"" Jun 10 00:46:10.075100 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.075036 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 00:46:10.084737 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.084717 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7"] Jun 10 00:46:10.204338 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.204298 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a6128a-c903-4bf9-a5e9-46a5894d76c2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.204517 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.204443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k6k5\" (UniqueName: \"kubernetes.io/projected/47a6128a-c903-4bf9-a5e9-46a5894d76c2-kube-api-access-5k6k5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.305903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.305866 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k6k5\" (UniqueName: \"kubernetes.io/projected/47a6128a-c903-4bf9-a5e9-46a5894d76c2-kube-api-access-5k6k5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.306096 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.305920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a6128a-c903-4bf9-a5e9-46a5894d76c2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.306306 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.306285 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47a6128a-c903-4bf9-a5e9-46a5894d76c2-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.314376 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.314355 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k6k5\" (UniqueName: \"kubernetes.io/projected/47a6128a-c903-4bf9-a5e9-46a5894d76c2-kube-api-access-5k6k5\") pod \"cert-manager-operator-controller-manager-57757f7cfc-7nmm7\" (UID: \"47a6128a-c903-4bf9-a5e9-46a5894d76c2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.380988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.380952 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" Jun 10 00:46:10.514417 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.514375 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7"] Jun 10 00:46:10.516413 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:46:10.516368 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a6128a_c903_4bf9_a5e9_46a5894d76c2.slice/crio-4e9514ec76e3da9547ad9ad411abdae97b11d117dc86474be2ff9ddd0be08a44 WatchSource:0}: Error finding container 4e9514ec76e3da9547ad9ad411abdae97b11d117dc86474be2ff9ddd0be08a44: Status 404 returned error can't find the container with id 4e9514ec76e3da9547ad9ad411abdae97b11d117dc86474be2ff9ddd0be08a44 Jun 10 00:46:10.858551 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:10.858516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" event={"ID":"47a6128a-c903-4bf9-a5e9-46a5894d76c2","Type":"ContainerStarted","Data":"4e9514ec76e3da9547ad9ad411abdae97b11d117dc86474be2ff9ddd0be08a44"} Jun 10 00:46:11.865439 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:11.865412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" event={"ID":"47a6128a-c903-4bf9-a5e9-46a5894d76c2","Type":"ContainerStarted","Data":"8f552b4ea448a11464bc2e96e076363a9e46238a8c68654d47e02ff2a1671022"} Jun 10 00:46:11.887106 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:11.887051 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-7nmm7" podStartSLOduration=0.600319062 podStartE2EDuration="1.887034449s" totalImagesPullingTime="1.286715387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:11.884300061 +0000 UTC m=+646.091271948" watchObservedRunningTime="2026-06-10 00:46:11.887034449 +0000 UTC m=+646.094006336" Jun 10 00:46:13.175947 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.175912 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf"] Jun 10 00:46:13.178518 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.178500 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.181273 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.181247 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:46:13.182529 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.182506 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:46:13.182636 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.182528 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:46:13.194947 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.194917 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf"] Jun 10 00:46:13.331425 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.331353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.331667 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.331603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.331731 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.331663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbd9f\" (UniqueName: \"kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.432240 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.432161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.432240 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.432216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.432423 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.432249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbd9f\" (UniqueName: \"kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.432645 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.432623 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.432681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.432637 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.445018 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.444985 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbd9f\" (UniqueName: \"kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.487555 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.487520 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:13.626480 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.626339 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf"] Jun 10 00:46:13.876127 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.876095 2583 generic.go:356] "Generic (PLEG): container finished" podID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerID="c8efa7078cdd083197615907d02696dce0f2fd545a42b9f3e508514b781315fa" exitCode=0 Jun 10 00:46:13.876298 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.876134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" event={"ID":"40a1a41e-38e0-4176-87a6-ed195c7602f2","Type":"ContainerDied","Data":"c8efa7078cdd083197615907d02696dce0f2fd545a42b9f3e508514b781315fa"} Jun 10 00:46:13.876298 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:13.876171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" event={"ID":"40a1a41e-38e0-4176-87a6-ed195c7602f2","Type":"ContainerStarted","Data":"bdb84702bf633c7d09f12c900e29c427d1cc43c2db42df49debae2282837989b"} Jun 10 00:46:16.894604 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:16.894566 2583 generic.go:356] "Generic (PLEG): container finished" podID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerID="958388aaaa8d918a06e9bc2636312bac6e8b9deb171965942222c7ef656c41d8" exitCode=0 Jun 10 00:46:16.894991 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:16.894650 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" event={"ID":"40a1a41e-38e0-4176-87a6-ed195c7602f2","Type":"ContainerDied","Data":"958388aaaa8d918a06e9bc2636312bac6e8b9deb171965942222c7ef656c41d8"} Jun 10 00:46:17.901304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:17.901269 2583 generic.go:356] "Generic (PLEG): container finished" podID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerID="5091fc14ed45901b929b471684d534d82e721dcbbe674c4e02f0e13fb23b6d30" exitCode=0 Jun 10 00:46:17.901304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:17.901309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" event={"ID":"40a1a41e-38e0-4176-87a6-ed195c7602f2","Type":"ContainerDied","Data":"5091fc14ed45901b929b471684d534d82e721dcbbe674c4e02f0e13fb23b6d30"} Jun 10 00:46:18.055466 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.055429 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kr757"] Jun 10 00:46:18.057507 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.057492 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.060554 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.060530 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5bcjs\"" Jun 10 00:46:18.060683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.060530 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 00:46:18.060683 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.060670 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 00:46:18.069706 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.069680 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kr757"] Jun 10 00:46:18.175452 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.175337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.175616 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.175477 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r2th\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-kube-api-access-6r2th\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.276282 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.276248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r2th\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-kube-api-access-6r2th\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.276492 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.276298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.286765 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.286734 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.286903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.286830 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r2th\" (UniqueName: \"kubernetes.io/projected/63bb6340-458f-4383-956a-b37aab725189-kube-api-access-6r2th\") pod \"cert-manager-cainjector-5d99449ffd-kr757\" (UID: \"63bb6340-458f-4383-956a-b37aab725189\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.375577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.375547 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" Jun 10 00:46:18.502847 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.502822 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-kr757"] Jun 10 00:46:18.504865 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:46:18.504826 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63bb6340_458f_4383_956a_b37aab725189.slice/crio-e3571184f6e85b6964fbac517d65a43a8b705f6bb106ed6bd715372f5ebd1b96 WatchSource:0}: Error finding container e3571184f6e85b6964fbac517d65a43a8b705f6bb106ed6bd715372f5ebd1b96: Status 404 returned error can't find the container with id e3571184f6e85b6964fbac517d65a43a8b705f6bb106ed6bd715372f5ebd1b96 Jun 10 00:46:18.906598 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:18.906566 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" event={"ID":"63bb6340-458f-4383-956a-b37aab725189","Type":"ContainerStarted","Data":"e3571184f6e85b6964fbac517d65a43a8b705f6bb106ed6bd715372f5ebd1b96"} Jun 10 00:46:19.039366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.039341 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:19.184405 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.184301 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle\") pod \"40a1a41e-38e0-4176-87a6-ed195c7602f2\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " Jun 10 00:46:19.184405 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.184336 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbd9f\" (UniqueName: \"kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f\") pod \"40a1a41e-38e0-4176-87a6-ed195c7602f2\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " Jun 10 00:46:19.184609 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.184435 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util\") pod \"40a1a41e-38e0-4176-87a6-ed195c7602f2\" (UID: \"40a1a41e-38e0-4176-87a6-ed195c7602f2\") " Jun 10 00:46:19.184825 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.184788 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle" (OuterVolumeSpecName: "bundle") pod "40a1a41e-38e0-4176-87a6-ed195c7602f2" (UID: "40a1a41e-38e0-4176-87a6-ed195c7602f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:19.186863 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.186804 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f" (OuterVolumeSpecName: "kube-api-access-tbd9f") pod "40a1a41e-38e0-4176-87a6-ed195c7602f2" (UID: "40a1a41e-38e0-4176-87a6-ed195c7602f2"). InnerVolumeSpecName "kube-api-access-tbd9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:46:19.190562 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.190536 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util" (OuterVolumeSpecName: "util") pod "40a1a41e-38e0-4176-87a6-ed195c7602f2" (UID: "40a1a41e-38e0-4176-87a6-ed195c7602f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:19.285122 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.285080 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:19.285122 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.285119 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40a1a41e-38e0-4176-87a6-ed195c7602f2-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:19.285122 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.285132 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbd9f\" (UniqueName: \"kubernetes.io/projected/40a1a41e-38e0-4176-87a6-ed195c7602f2-kube-api-access-tbd9f\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:19.914891 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.914859 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" Jun 10 00:46:19.915324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.914881 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9w7pf" event={"ID":"40a1a41e-38e0-4176-87a6-ed195c7602f2","Type":"ContainerDied","Data":"bdb84702bf633c7d09f12c900e29c427d1cc43c2db42df49debae2282837989b"} Jun 10 00:46:19.915324 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:19.914945 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdb84702bf633c7d09f12c900e29c427d1cc43c2db42df49debae2282837989b" Jun 10 00:46:20.921268 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:20.921227 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" event={"ID":"63bb6340-458f-4383-956a-b37aab725189","Type":"ContainerStarted","Data":"07431b207a228a0155c72aa506818772f9978441c6b1449e666d3560f2020053"} Jun 10 00:46:20.937313 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:20.937259 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-kr757" podStartSLOduration=0.720488309 podStartE2EDuration="2.93724414s" totalImagesPullingTime="2.216755831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:20.935764469 +0000 UTC m=+655.142736356" watchObservedRunningTime="2026-06-10 00:46:20.93724414 +0000 UTC m=+655.144216028" Jun 10 00:46:24.373375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373339 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj"] Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373666 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="pull" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373677 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="pull" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373691 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="util" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373696 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="util" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373704 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="extract" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373709 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="extract" Jun 10 00:46:24.373773 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.373766 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a1a41e-38e0-4176-87a6-ed195c7602f2" containerName="extract" Jun 10 00:46:24.375609 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.375592 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.378310 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.378287 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:46:24.378467 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.378326 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4z5w5\"" Jun 10 00:46:24.379687 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.379670 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 00:46:24.383871 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.383847 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj"] Jun 10 00:46:24.531262 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.531226 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92v6q\" (UniqueName: \"kubernetes.io/projected/29862b33-7fd0-4989-8dbf-657aa5c48892-kube-api-access-92v6q\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.531463 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.531355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29862b33-7fd0-4989-8dbf-657aa5c48892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.632647 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.632581 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29862b33-7fd0-4989-8dbf-657aa5c48892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.632647 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.632624 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92v6q\" (UniqueName: \"kubernetes.io/projected/29862b33-7fd0-4989-8dbf-657aa5c48892-kube-api-access-92v6q\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.632941 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.632921 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29862b33-7fd0-4989-8dbf-657aa5c48892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.640873 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.640849 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92v6q\" (UniqueName: \"kubernetes.io/projected/29862b33-7fd0-4989-8dbf-657aa5c48892-kube-api-access-92v6q\") pod \"openshift-lws-operator-fd8ccff4c-f5msj\" (UID: \"29862b33-7fd0-4989-8dbf-657aa5c48892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.685686 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.685658 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" Jun 10 00:46:24.814434 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.814381 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj"] Jun 10 00:46:24.818484 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:46:24.818442 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29862b33_7fd0_4989_8dbf_657aa5c48892.slice/crio-7b1cda459afff3bab58e58b1ff6095e4b14cd3d0ee4ef3914195ecaeac366b91 WatchSource:0}: Error finding container 7b1cda459afff3bab58e58b1ff6095e4b14cd3d0ee4ef3914195ecaeac366b91: Status 404 returned error can't find the container with id 7b1cda459afff3bab58e58b1ff6095e4b14cd3d0ee4ef3914195ecaeac366b91 Jun 10 00:46:24.940057 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:24.939968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" event={"ID":"29862b33-7fd0-4989-8dbf-657aa5c48892","Type":"ContainerStarted","Data":"7b1cda459afff3bab58e58b1ff6095e4b14cd3d0ee4ef3914195ecaeac366b91"} Jun 10 00:46:26.959109 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:26.959071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" event={"ID":"29862b33-7fd0-4989-8dbf-657aa5c48892","Type":"ContainerStarted","Data":"4a0e714ff65b690b5a429e8eacbfa8d226c525b11045f34398488bd1a46fdd58"} Jun 10 00:46:26.975443 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:26.975367 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f5msj" podStartSLOduration=1.293874966 podStartE2EDuration="2.975353061s" totalImagesPullingTime="1.681478095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:26.973934727 +0000 UTC m=+661.180906618" watchObservedRunningTime="2026-06-10 00:46:26.975353061 +0000 UTC m=+661.182324949" Jun 10 00:46:30.023266 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.023230 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np"] Jun 10 00:46:30.026964 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.026946 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.029689 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.029651 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:46:30.029812 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.029741 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:46:30.031067 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.031047 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:46:30.034266 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.033972 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np"] Jun 10 00:46:30.070874 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.070822 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.071054 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.070912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.071054 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.070940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbxxz\" (UniqueName: \"kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.172063 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.172024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.172209 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.172102 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.172209 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.172134 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbxxz\" (UniqueName: \"kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.172567 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.172549 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.172608 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.172548 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.180459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.180432 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbxxz\" (UniqueName: \"kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.337623 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.337533 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:30.473569 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.473539 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np"] Jun 10 00:46:30.475273 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:46:30.475238 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4671592a_e4d1_463e_bc8e_1ee9ea62233e.slice/crio-60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695 WatchSource:0}: Error finding container 60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695: Status 404 returned error can't find the container with id 60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695 Jun 10 00:46:30.977843 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.977808 2583 generic.go:356] "Generic (PLEG): container finished" podID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerID="35506fdd5fa0dd44ee7de19dc9c877a07b64e9f873054f94310d6f1a5ab7721a" exitCode=0 Jun 10 00:46:30.978013 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.977888 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" event={"ID":"4671592a-e4d1-463e-bc8e-1ee9ea62233e","Type":"ContainerDied","Data":"35506fdd5fa0dd44ee7de19dc9c877a07b64e9f873054f94310d6f1a5ab7721a"} Jun 10 00:46:30.978013 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:30.977935 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" event={"ID":"4671592a-e4d1-463e-bc8e-1ee9ea62233e","Type":"ContainerStarted","Data":"60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695"} Jun 10 00:46:31.984543 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:31.984458 2583 generic.go:356] "Generic (PLEG): container finished" podID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerID="d448d6e4e64ce6a4964e404b34fb99aacfa404a3b4edf842041cb8e45d891cb1" exitCode=0 Jun 10 00:46:31.984543 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:31.984498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" event={"ID":"4671592a-e4d1-463e-bc8e-1ee9ea62233e","Type":"ContainerDied","Data":"d448d6e4e64ce6a4964e404b34fb99aacfa404a3b4edf842041cb8e45d891cb1"} Jun 10 00:46:32.991248 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:32.991209 2583 generic.go:356] "Generic (PLEG): container finished" podID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerID="bfe8e538bb88d13dc1a680e2cb4bb1103932f5877171ede33ce5b85891a3fc2a" exitCode=0 Jun 10 00:46:32.991654 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:32.991309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" event={"ID":"4671592a-e4d1-463e-bc8e-1ee9ea62233e","Type":"ContainerDied","Data":"bfe8e538bb88d13dc1a680e2cb4bb1103932f5877171ede33ce5b85891a3fc2a"} Jun 10 00:46:34.136909 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.136886 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:34.201796 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.201764 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbxxz\" (UniqueName: \"kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz\") pod \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " Jun 10 00:46:34.201987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.201812 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util\") pod \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " Jun 10 00:46:34.201987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.201862 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle\") pod \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\" (UID: \"4671592a-e4d1-463e-bc8e-1ee9ea62233e\") " Jun 10 00:46:34.202550 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.202528 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle" (OuterVolumeSpecName: "bundle") pod "4671592a-e4d1-463e-bc8e-1ee9ea62233e" (UID: "4671592a-e4d1-463e-bc8e-1ee9ea62233e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:34.204093 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.204068 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz" (OuterVolumeSpecName: "kube-api-access-pbxxz") pod "4671592a-e4d1-463e-bc8e-1ee9ea62233e" (UID: "4671592a-e4d1-463e-bc8e-1ee9ea62233e"). InnerVolumeSpecName "kube-api-access-pbxxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:46:34.207176 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.207147 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util" (OuterVolumeSpecName: "util") pod "4671592a-e4d1-463e-bc8e-1ee9ea62233e" (UID: "4671592a-e4d1-463e-bc8e-1ee9ea62233e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:46:34.303374 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.303274 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:34.303374 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.303306 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4671592a-e4d1-463e-bc8e-1ee9ea62233e-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:34.303374 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:34.303315 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbxxz\" (UniqueName: \"kubernetes.io/projected/4671592a-e4d1-463e-bc8e-1ee9ea62233e-kube-api-access-pbxxz\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:46:35.001883 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:35.001846 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" event={"ID":"4671592a-e4d1-463e-bc8e-1ee9ea62233e","Type":"ContainerDied","Data":"60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695"} Jun 10 00:46:35.001883 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:35.001869 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8p2np" Jun 10 00:46:35.002154 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:35.001894 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60d6b4cd9fcac92aff5f5779734021a1f7b4287daa626d84ce977efbf1779695" Jun 10 00:46:45.981027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.980991 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2"] Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981339 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="util" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981351 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="util" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981366 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="pull" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981371 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="pull" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981384 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="extract" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981405 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="extract" Jun 10 00:46:45.981508 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.981454 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4671592a-e4d1-463e-bc8e-1ee9ea62233e" containerName="extract" Jun 10 00:46:45.986995 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.986976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:45.989703 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.989679 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 00:46:45.989703 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.989686 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 00:46:45.989974 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.989780 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 00:46:45.990027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.990013 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 00:46:45.990065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.990051 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ckhbh\"" Jun 10 00:46:45.999767 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:45.999743 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2"] Jun 10 00:46:46.099092 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.099055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.099092 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.099097 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm4j6\" (UniqueName: \"kubernetes.io/projected/adc250ca-6336-4099-abb7-0425f747dc6e-kube-api-access-jm4j6\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.099304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.099197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.099304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.099233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.099304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.099262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.200693 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.200659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.200693 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.200695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.200917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.200716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.200917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.200830 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.200917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.200871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm4j6\" (UniqueName: \"kubernetes.io/projected/adc250ca-6336-4099-abb7-0425f747dc6e-kube-api-access-jm4j6\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.201232 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.201189 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.203093 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.203074 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adc250ca-6336-4099-abb7-0425f747dc6e-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.203297 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.203280 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.203447 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.203426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adc250ca-6336-4099-abb7-0425f747dc6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.209375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.209350 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm4j6\" (UniqueName: \"kubernetes.io/projected/adc250ca-6336-4099-abb7-0425f747dc6e-kube-api-access-jm4j6\") pod \"opendatahub-operator-controller-manager-7746866678-fd2x2\" (UID: \"adc250ca-6336-4099-abb7-0425f747dc6e\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.297708 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.297628 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:46.453903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:46.453878 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2"] Jun 10 00:46:46.456325 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:46:46.456297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc250ca_6336_4099_abb7_0425f747dc6e.slice/crio-d071eeaba7cbd3f22f3692639e80a17de28d7ef128c6762ec2357a1ddf28e482 WatchSource:0}: Error finding container d071eeaba7cbd3f22f3692639e80a17de28d7ef128c6762ec2357a1ddf28e482: Status 404 returned error can't find the container with id d071eeaba7cbd3f22f3692639e80a17de28d7ef128c6762ec2357a1ddf28e482 Jun 10 00:46:47.059986 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:47.059940 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" event={"ID":"adc250ca-6336-4099-abb7-0425f747dc6e","Type":"ContainerStarted","Data":"d071eeaba7cbd3f22f3692639e80a17de28d7ef128c6762ec2357a1ddf28e482"} Jun 10 00:46:50.077276 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:50.077190 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" event={"ID":"adc250ca-6336-4099-abb7-0425f747dc6e","Type":"ContainerStarted","Data":"592fa8c71b0299e7fef485cc1a6e8bf1ca47c0e8ea343084fcae51d2520f95bf"} Jun 10 00:46:51.083499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:51.083308 2583 generic.go:356] "Generic (PLEG): container finished" podID="adc250ca-6336-4099-abb7-0425f747dc6e" containerID="592fa8c71b0299e7fef485cc1a6e8bf1ca47c0e8ea343084fcae51d2520f95bf" exitCode=0 Jun 10 00:46:51.083499 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:51.083414 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" event={"ID":"adc250ca-6336-4099-abb7-0425f747dc6e","Type":"ContainerDied","Data":"592fa8c71b0299e7fef485cc1a6e8bf1ca47c0e8ea343084fcae51d2520f95bf"} Jun 10 00:46:52.089956 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:52.089920 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" event={"ID":"adc250ca-6336-4099-abb7-0425f747dc6e","Type":"ContainerStarted","Data":"c879bb82c0144777141248a9f2f397c10d2e23b03590683b0e4d7cdd0748f1e1"} Jun 10 00:46:52.090330 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:52.089995 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:46:52.111729 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:46:52.111680 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" podStartSLOduration=2.637616864 podStartE2EDuration="7.111666442s" totalImagesPullingTime="3.497136217s" totalInitContainerRuntime="976.913361ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:52.110006798 +0000 UTC m=+686.316978701" watchObservedRunningTime="2026-06-10 00:46:52.111666442 +0000 UTC m=+686.318638330" Jun 10 00:47:03.097428 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.097384 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-fd2x2" Jun 10 00:47:03.395538 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.395459 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45"] Jun 10 00:47:03.404445 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.404425 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.405610 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.405588 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45"] Jun 10 00:47:03.407678 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.407654 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 00:47:03.407791 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.407711 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 00:47:03.407791 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.407723 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b4jz6\"" Jun 10 00:47:03.407906 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.407815 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 00:47:03.546345 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.546310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.546345 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.546364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-manager-config\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.546607 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.546447 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.546607 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.546501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfcl\" (UniqueName: \"kubernetes.io/projected/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-kube-api-access-2gfcl\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.647752 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.647658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfcl\" (UniqueName: \"kubernetes.io/projected/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-kube-api-access-2gfcl\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.647925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.647755 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.647925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.647792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-manager-config\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.647925 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.647815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.648462 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.648435 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-manager-config\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.650597 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.650575 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.650687 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.650576 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-metrics-cert\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.655405 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.655374 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfcl\" (UniqueName: \"kubernetes.io/projected/eae9596d-0cf8-46ac-b1e9-cf3c7f283e25-kube-api-access-2gfcl\") pod \"lws-controller-manager-cc5ccc596-dns45\" (UID: \"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25\") " pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.714507 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.714469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:03.847437 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:03.847385 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45"] Jun 10 00:47:03.849583 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:47:03.849556 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae9596d_0cf8_46ac_b1e9_cf3c7f283e25.slice/crio-72f76d349aed61f8c61b11166185d548bfc0bc04d2e2d5df553ff8b3a7888fdf WatchSource:0}: Error finding container 72f76d349aed61f8c61b11166185d548bfc0bc04d2e2d5df553ff8b3a7888fdf: Status 404 returned error can't find the container with id 72f76d349aed61f8c61b11166185d548bfc0bc04d2e2d5df553ff8b3a7888fdf Jun 10 00:47:04.149300 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:04.149259 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" event={"ID":"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25","Type":"ContainerStarted","Data":"72f76d349aed61f8c61b11166185d548bfc0bc04d2e2d5df553ff8b3a7888fdf"} Jun 10 00:47:06.160992 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:06.160958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" event={"ID":"eae9596d-0cf8-46ac-b1e9-cf3c7f283e25","Type":"ContainerStarted","Data":"8deec0e4745cc2bea60e5954fedf1b89292aca6ee48fe22f642a543bcfec4fa6"} Jun 10 00:47:06.161469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:06.161013 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:06.179135 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:06.179091 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" podStartSLOduration=1.330124185 podStartE2EDuration="3.179076023s" totalImagesPullingTime="1.848951838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:06.176979144 +0000 UTC m=+700.383951049" watchObservedRunningTime="2026-06-10 00:47:06.179076023 +0000 UTC m=+700.386047910" Jun 10 00:47:08.546423 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.546375 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj"] Jun 10 00:47:08.549949 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.549930 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.552596 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.552576 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:47:08.553950 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.553919 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:47:08.553950 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.553939 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:47:08.561172 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.561151 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj"] Jun 10 00:47:08.702831 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.702796 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqgjv\" (UniqueName: \"kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.703007 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.702846 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.703007 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.702898 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.803866 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.803773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqgjv\" (UniqueName: \"kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.803866 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.803824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.803866 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.803847 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.804156 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.804139 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.804260 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.804238 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.812276 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.812254 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqgjv\" (UniqueName: \"kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.859257 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.859223 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:08.989627 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:08.989603 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj"] Jun 10 00:47:08.991510 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:47:08.991487 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d2e788_f576_4a28_a415_25067f2e6994.slice/crio-60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3 WatchSource:0}: Error finding container 60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3: Status 404 returned error can't find the container with id 60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3 Jun 10 00:47:09.176249 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:09.176218 2583 generic.go:356] "Generic (PLEG): container finished" podID="a6d2e788-f576-4a28-a415-25067f2e6994" containerID="1ea29bdcb65e7b072d93fd8340e4fad9fad39cffaff406c614e33f941cdb117d" exitCode=0 Jun 10 00:47:09.176453 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:09.176314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" event={"ID":"a6d2e788-f576-4a28-a415-25067f2e6994","Type":"ContainerDied","Data":"1ea29bdcb65e7b072d93fd8340e4fad9fad39cffaff406c614e33f941cdb117d"} Jun 10 00:47:09.176453 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:09.176360 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" event={"ID":"a6d2e788-f576-4a28-a415-25067f2e6994","Type":"ContainerStarted","Data":"60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3"} Jun 10 00:47:10.182540 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:10.182506 2583 generic.go:356] "Generic (PLEG): container finished" podID="a6d2e788-f576-4a28-a415-25067f2e6994" containerID="5309e50ec5fab146cd1ff8c05f1ce30d8508eb4bc510b83e8129e34a739fa958" exitCode=0 Jun 10 00:47:10.182915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:10.182593 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" event={"ID":"a6d2e788-f576-4a28-a415-25067f2e6994","Type":"ContainerDied","Data":"5309e50ec5fab146cd1ff8c05f1ce30d8508eb4bc510b83e8129e34a739fa958"} Jun 10 00:47:11.188754 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:11.188719 2583 generic.go:356] "Generic (PLEG): container finished" podID="a6d2e788-f576-4a28-a415-25067f2e6994" containerID="3f1dbd37c16a985d634516a49769a71d1d25d0031a9e1664c55adb08f545afe0" exitCode=0 Jun 10 00:47:11.189105 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:11.188803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" event={"ID":"a6d2e788-f576-4a28-a415-25067f2e6994","Type":"ContainerDied","Data":"3f1dbd37c16a985d634516a49769a71d1d25d0031a9e1664c55adb08f545afe0"} Jun 10 00:47:12.321154 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.321129 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:12.438521 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.438485 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqgjv\" (UniqueName: \"kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv\") pod \"a6d2e788-f576-4a28-a415-25067f2e6994\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " Jun 10 00:47:12.438672 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.438538 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle\") pod \"a6d2e788-f576-4a28-a415-25067f2e6994\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " Jun 10 00:47:12.438672 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.438560 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util\") pod \"a6d2e788-f576-4a28-a415-25067f2e6994\" (UID: \"a6d2e788-f576-4a28-a415-25067f2e6994\") " Jun 10 00:47:12.439424 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.439372 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle" (OuterVolumeSpecName: "bundle") pod "a6d2e788-f576-4a28-a415-25067f2e6994" (UID: "a6d2e788-f576-4a28-a415-25067f2e6994"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:47:12.440803 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.440772 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv" (OuterVolumeSpecName: "kube-api-access-sqgjv") pod "a6d2e788-f576-4a28-a415-25067f2e6994" (UID: "a6d2e788-f576-4a28-a415-25067f2e6994"). InnerVolumeSpecName "kube-api-access-sqgjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:47:12.444247 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.444221 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util" (OuterVolumeSpecName: "util") pod "a6d2e788-f576-4a28-a415-25067f2e6994" (UID: "a6d2e788-f576-4a28-a415-25067f2e6994"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:47:12.539367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.539328 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqgjv\" (UniqueName: \"kubernetes.io/projected/a6d2e788-f576-4a28-a415-25067f2e6994-kube-api-access-sqgjv\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:12.539367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.539359 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:12.539367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:12.539369 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6d2e788-f576-4a28-a415-25067f2e6994-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:13.200731 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:13.200696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" event={"ID":"a6d2e788-f576-4a28-a415-25067f2e6994","Type":"ContainerDied","Data":"60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3"} Jun 10 00:47:13.200731 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:13.200732 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab069xfrj" Jun 10 00:47:13.200935 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:13.200769 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60e655d4965c8229c9725d2cdb4d9a3dce4613ed4da1c0da7a1997123cdcd5f3" Jun 10 00:47:17.168595 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.168515 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cc5ccc596-dns45" Jun 10 00:47:17.950357 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950311 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq"] Jun 10 00:47:17.950914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950897 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="extract" Jun 10 00:47:17.950959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950919 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="extract" Jun 10 00:47:17.950959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950934 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="pull" Jun 10 00:47:17.950959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950944 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="pull" Jun 10 00:47:17.950959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950958 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="util" Jun 10 00:47:17.951096 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.950967 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="util" Jun 10 00:47:17.951096 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.951055 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d2e788-f576-4a28-a415-25067f2e6994" containerName="extract" Jun 10 00:47:17.954667 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.954650 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:17.958990 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.958968 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:47:17.959123 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.959021 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:47:17.959123 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.959043 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:47:17.966874 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:17.966851 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq"] Jun 10 00:47:18.090891 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.090858 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.091095 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.090918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kfx6\" (UniqueName: \"kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.091095 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.091009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.192056 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.192013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.192561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.192093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kfx6\" (UniqueName: \"kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.192561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.192126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.192561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.192367 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.192561 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.192517 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.208321 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.208251 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kfx6\" (UniqueName: \"kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.263934 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.263892 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:18.416168 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:18.416137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq"] Jun 10 00:47:18.417425 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:47:18.417361 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd7c5ff_e173_4ec8_a5c9_851049f51441.slice/crio-62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f WatchSource:0}: Error finding container 62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f: Status 404 returned error can't find the container with id 62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f Jun 10 00:47:19.242473 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:19.242441 2583 generic.go:356] "Generic (PLEG): container finished" podID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerID="f577d522fba62fd3172cb6bc0686edc9ddc82e2e6a4dac74ee1d6a4927ed0711" exitCode=0 Jun 10 00:47:19.242924 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:19.242501 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" event={"ID":"4cd7c5ff-e173-4ec8-a5c9-851049f51441","Type":"ContainerDied","Data":"f577d522fba62fd3172cb6bc0686edc9ddc82e2e6a4dac74ee1d6a4927ed0711"} Jun 10 00:47:19.242924 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:19.242536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" event={"ID":"4cd7c5ff-e173-4ec8-a5c9-851049f51441","Type":"ContainerStarted","Data":"62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f"} Jun 10 00:47:21.254481 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:21.254446 2583 generic.go:356] "Generic (PLEG): container finished" podID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerID="219641a0311744017622d1c6a2d2dc709ef4ff55dbad7731209427feb148928f" exitCode=0 Jun 10 00:47:21.254854 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:21.254508 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" event={"ID":"4cd7c5ff-e173-4ec8-a5c9-851049f51441","Type":"ContainerDied","Data":"219641a0311744017622d1c6a2d2dc709ef4ff55dbad7731209427feb148928f"} Jun 10 00:47:22.155093 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.155059 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-jd8v7"] Jun 10 00:47:22.158319 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.158300 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.161045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.161024 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 00:47:22.161148 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.161029 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m2pff\"" Jun 10 00:47:22.168818 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.168794 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-jd8v7"] Jun 10 00:47:22.261730 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.261699 2583 generic.go:356] "Generic (PLEG): container finished" podID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerID="dc0328c565f091aba3d2ec8011e603abf18b87e9a4c6e96dfc4795e9265e9dbc" exitCode=0 Jun 10 00:47:22.262130 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.261767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" event={"ID":"4cd7c5ff-e173-4ec8-a5c9-851049f51441","Type":"ContainerDied","Data":"dc0328c565f091aba3d2ec8011e603abf18b87e9a4c6e96dfc4795e9265e9dbc"} Jun 10 00:47:22.328780 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.328742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7kh\" (UniqueName: \"kubernetes.io/projected/b4222632-68fe-4094-bf74-c78ad63d5968-kube-api-access-5m7kh\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.329045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.328977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b4222632-68fe-4094-bf74-c78ad63d5968-redirect-config\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.429618 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.429524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7kh\" (UniqueName: \"kubernetes.io/projected/b4222632-68fe-4094-bf74-c78ad63d5968-kube-api-access-5m7kh\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.429776 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.429623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b4222632-68fe-4094-bf74-c78ad63d5968-redirect-config\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.430361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.430334 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b4222632-68fe-4094-bf74-c78ad63d5968-redirect-config\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.442153 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.442131 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7kh\" (UniqueName: \"kubernetes.io/projected/b4222632-68fe-4094-bf74-c78ad63d5968-kube-api-access-5m7kh\") pod \"dashboard-redirect-8449d75f-jd8v7\" (UID: \"b4222632-68fe-4094-bf74-c78ad63d5968\") " pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.470710 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.470679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" Jun 10 00:47:22.601156 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:22.601128 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-jd8v7"] Jun 10 00:47:22.603219 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:47:22.603183 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4222632_68fe_4094_bf74_c78ad63d5968.slice/crio-41d37080ca2cb4a54d063961046a21fd1052b4a3dcd9e830563fa780ff9b24ad WatchSource:0}: Error finding container 41d37080ca2cb4a54d063961046a21fd1052b4a3dcd9e830563fa780ff9b24ad: Status 404 returned error can't find the container with id 41d37080ca2cb4a54d063961046a21fd1052b4a3dcd9e830563fa780ff9b24ad Jun 10 00:47:23.268275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.268236 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" event={"ID":"b4222632-68fe-4094-bf74-c78ad63d5968","Type":"ContainerStarted","Data":"41d37080ca2cb4a54d063961046a21fd1052b4a3dcd9e830563fa780ff9b24ad"} Jun 10 00:47:23.395423 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.395377 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:23.438136 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.438106 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle\") pod \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " Jun 10 00:47:23.438301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.438162 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util\") pod \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " Jun 10 00:47:23.438301 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.438186 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kfx6\" (UniqueName: \"kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6\") pod \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\" (UID: \"4cd7c5ff-e173-4ec8-a5c9-851049f51441\") " Jun 10 00:47:23.439265 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.439234 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle" (OuterVolumeSpecName: "bundle") pod "4cd7c5ff-e173-4ec8-a5c9-851049f51441" (UID: "4cd7c5ff-e173-4ec8-a5c9-851049f51441"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:47:23.440489 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.440465 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6" (OuterVolumeSpecName: "kube-api-access-7kfx6") pod "4cd7c5ff-e173-4ec8-a5c9-851049f51441" (UID: "4cd7c5ff-e173-4ec8-a5c9-851049f51441"). InnerVolumeSpecName "kube-api-access-7kfx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:47:23.443971 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.443950 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util" (OuterVolumeSpecName: "util") pod "4cd7c5ff-e173-4ec8-a5c9-851049f51441" (UID: "4cd7c5ff-e173-4ec8-a5c9-851049f51441"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:47:23.538899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.538808 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:23.538899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.538840 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cd7c5ff-e173-4ec8-a5c9-851049f51441-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:23.538899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:23.538853 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kfx6\" (UniqueName: \"kubernetes.io/projected/4cd7c5ff-e173-4ec8-a5c9-851049f51441-kube-api-access-7kfx6\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:47:24.275335 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:24.275303 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" event={"ID":"4cd7c5ff-e173-4ec8-a5c9-851049f51441","Type":"ContainerDied","Data":"62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f"} Jun 10 00:47:24.275335 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:24.275338 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aprktq" Jun 10 00:47:24.275746 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:24.275349 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62d923303d66d09232a030d01b46ceb778119c229b90e9f203c99eeb90c5871f" Jun 10 00:47:34.326053 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.326012 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" event={"ID":"b4222632-68fe-4094-bf74-c78ad63d5968","Type":"ContainerStarted","Data":"bf2f987b883e28ef42eff0549a42f323c9b8be88d0f4a51f36708d435c401427"} Jun 10 00:47:34.343973 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.343912 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8449d75f-jd8v7" podStartSLOduration=1.164769491 podStartE2EDuration="12.343896598s" totalImagesPullingTime="11.179127107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:34.34301292 +0000 UTC m=+728.549984824" watchObservedRunningTime="2026-06-10 00:47:34.343896598 +0000 UTC m=+728.550868486" Jun 10 00:47:34.870954 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.870922 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d"] Jun 10 00:47:34.871299 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871286 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="util" Jun 10 00:47:34.871366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871301 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="util" Jun 10 00:47:34.871366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871311 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="extract" Jun 10 00:47:34.871366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871317 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="extract" Jun 10 00:47:34.871366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871330 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="pull" Jun 10 00:47:34.871366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871336 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="pull" Jun 10 00:47:34.871644 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.871409 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd7c5ff-e173-4ec8-a5c9-851049f51441" containerName="extract" Jun 10 00:47:34.873618 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.873598 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.876441 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.876385 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 00:47:34.876441 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.876428 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g82d6\"" Jun 10 00:47:34.876441 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.876439 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 00:47:34.876684 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.876405 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 00:47:34.885984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.885963 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d"] Jun 10 00:47:34.923987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.923957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxn96\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-kube-api-access-nxn96\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.923987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.923991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924203 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25a107ce-708f-491b-af39-0cd73e195a83-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924203 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924030 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924203 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924203 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924203 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924449 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:34.924449 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:34.924254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25a107ce-708f-491b-af39-0cd73e195a83-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.024762 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.024719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25a107ce-708f-491b-af39-0cd73e195a83-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.024762 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.024764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxn96\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-kube-api-access-nxn96\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.024976 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.024792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025028 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25a107ce-708f-491b-af39-0cd73e195a83-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025065 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025099 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025246 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025299 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025252 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025335 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025381 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025556 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025526 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25a107ce-708f-491b-af39-0cd73e195a83-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025578 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025646 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.025836 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.025749 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.027510 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.027491 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25a107ce-708f-491b-af39-0cd73e195a83-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.027751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.027730 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25a107ce-708f-491b-af39-0cd73e195a83-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.035608 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.035584 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxn96\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-kube-api-access-nxn96\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.035949 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.035926 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25a107ce-708f-491b-af39-0cd73e195a83-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bclcg4d\" (UID: \"25a107ce-708f-491b-af39-0cd73e195a83\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.185879 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.185789 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:35.322104 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.322076 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d"] Jun 10 00:47:35.323478 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:47:35.323449 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a107ce_708f_491b_af39_0cd73e195a83.slice/crio-78dd8fb8a3f68721bc6acf6e23a7fbcb569c3bee719690708e929f2c1c3233c7 WatchSource:0}: Error finding container 78dd8fb8a3f68721bc6acf6e23a7fbcb569c3bee719690708e929f2c1c3233c7: Status 404 returned error can't find the container with id 78dd8fb8a3f68721bc6acf6e23a7fbcb569c3bee719690708e929f2c1c3233c7 Jun 10 00:47:35.333129 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:35.333099 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" event={"ID":"25a107ce-708f-491b-af39-0cd73e195a83","Type":"ContainerStarted","Data":"78dd8fb8a3f68721bc6acf6e23a7fbcb569c3bee719690708e929f2c1c3233c7"} Jun 10 00:47:38.076673 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:38.076637 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:47:38.076948 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:38.076712 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:47:38.076948 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:38.076740 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:47:38.352010 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:38.351977 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" event={"ID":"25a107ce-708f-491b-af39-0cd73e195a83","Type":"ContainerStarted","Data":"bfdffe75c8fad2ba03dd1fa830a45a7f97c84bb07a4fbc11f2afdc98ae3d8046"} Jun 10 00:47:38.382185 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:38.382131 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" podStartSLOduration=1.631319239 podStartE2EDuration="4.382115802s" totalImagesPullingTime="2.750796563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:38.38114566 +0000 UTC m=+732.588117547" watchObservedRunningTime="2026-06-10 00:47:38.382115802 +0000 UTC m=+732.589087689" Jun 10 00:47:39.186094 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:39.186054 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:39.190750 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:39.190726 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:39.357216 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:39.357179 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:47:39.358192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:47:39.358170 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bclcg4d" Jun 10 00:48:06.580903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.580866 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:06.592756 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.592726 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:06.597043 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.597013 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8wx8v\"" Jun 10 00:48:06.597313 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.597054 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 00:48:06.597460 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.597072 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 00:48:06.598596 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.598563 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:06.702538 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.702501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgjww\" (UniqueName: \"kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww\") pod \"kuadrant-operator-catalog-n8mz9\" (UID: \"7258f08e-18c1-4005-b0d8-4667d8f680df\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:06.804004 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.803962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgjww\" (UniqueName: \"kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww\") pod \"kuadrant-operator-catalog-n8mz9\" (UID: \"7258f08e-18c1-4005-b0d8-4667d8f680df\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:06.811921 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.811897 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgjww\" (UniqueName: \"kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww\") pod \"kuadrant-operator-catalog-n8mz9\" (UID: \"7258f08e-18c1-4005-b0d8-4667d8f680df\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:06.904441 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.904369 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:06.946492 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:06.946448 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:07.085826 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.085795 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:07.154546 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.154463 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sk2ks"] Jun 10 00:48:07.159439 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.159422 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:07.168367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.168322 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sk2ks"] Jun 10 00:48:07.306974 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.306929 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8hgw\" (UniqueName: \"kubernetes.io/projected/85900d7a-ab69-4cb5-9767-79a4d286989a-kube-api-access-b8hgw\") pod \"kuadrant-operator-catalog-sk2ks\" (UID: \"85900d7a-ab69-4cb5-9767-79a4d286989a\") " pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:07.408289 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.408191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8hgw\" (UniqueName: \"kubernetes.io/projected/85900d7a-ab69-4cb5-9767-79a4d286989a-kube-api-access-b8hgw\") pod \"kuadrant-operator-catalog-sk2ks\" (UID: \"85900d7a-ab69-4cb5-9767-79a4d286989a\") " pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:07.416518 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.416496 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8hgw\" (UniqueName: \"kubernetes.io/projected/85900d7a-ab69-4cb5-9767-79a4d286989a-kube-api-access-b8hgw\") pod \"kuadrant-operator-catalog-sk2ks\" (UID: \"85900d7a-ab69-4cb5-9767-79a4d286989a\") " pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:07.470148 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.470109 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:07.496204 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.496174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" event={"ID":"7258f08e-18c1-4005-b0d8-4667d8f680df","Type":"ContainerStarted","Data":"9f02ef5d86469ce2548539871eebc47d28cd3260b2c0773d7625576e9a050cd6"} Jun 10 00:48:07.610757 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:07.610731 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sk2ks"] Jun 10 00:48:07.612535 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:07.612508 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85900d7a_ab69_4cb5_9767_79a4d286989a.slice/crio-578266b7075d2b7439a20420293b013379da2403c252d0eec755e9cef74a3200 WatchSource:0}: Error finding container 578266b7075d2b7439a20420293b013379da2403c252d0eec755e9cef74a3200: Status 404 returned error can't find the container with id 578266b7075d2b7439a20420293b013379da2403c252d0eec755e9cef74a3200 Jun 10 00:48:08.503170 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:08.503127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" event={"ID":"85900d7a-ab69-4cb5-9767-79a4d286989a","Type":"ContainerStarted","Data":"578266b7075d2b7439a20420293b013379da2403c252d0eec755e9cef74a3200"} Jun 10 00:48:10.516077 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.516037 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" event={"ID":"85900d7a-ab69-4cb5-9767-79a4d286989a","Type":"ContainerStarted","Data":"4c21a2f8015051c11df85038c8a3249e9a60d7e31531d58f9c389f23e9204dd1"} Jun 10 00:48:10.517620 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.517590 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" event={"ID":"7258f08e-18c1-4005-b0d8-4667d8f680df","Type":"ContainerStarted","Data":"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93"} Jun 10 00:48:10.517734 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.517637 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" podUID="7258f08e-18c1-4005-b0d8-4667d8f680df" containerName="registry-server" containerID="cri-o://472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93" gracePeriod=2 Jun 10 00:48:10.531789 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.531742 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" podStartSLOduration=1.494507016 podStartE2EDuration="3.531726192s" totalImagesPullingTime="2.037219176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:10.529558388 +0000 UTC m=+764.736530277" watchObservedRunningTime="2026-06-10 00:48:10.531726192 +0000 UTC m=+764.738698088" Jun 10 00:48:10.543634 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.543594 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" podStartSLOduration=1.9749423350000002 podStartE2EDuration="4.543579537s" totalImagesPullingTime="2.568637202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:10.543175068 +0000 UTC m=+764.750146975" watchObservedRunningTime="2026-06-10 00:48:10.543579537 +0000 UTC m=+764.750551472" Jun 10 00:48:10.766520 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.766456 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:10.944357 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.944325 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgjww\" (UniqueName: \"kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww\") pod \"7258f08e-18c1-4005-b0d8-4667d8f680df\" (UID: \"7258f08e-18c1-4005-b0d8-4667d8f680df\") " Jun 10 00:48:10.946680 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:10.946651 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww" (OuterVolumeSpecName: "kube-api-access-mgjww") pod "7258f08e-18c1-4005-b0d8-4667d8f680df" (UID: "7258f08e-18c1-4005-b0d8-4667d8f680df"). InnerVolumeSpecName "kube-api-access-mgjww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:48:11.046096 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.046017 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgjww\" (UniqueName: \"kubernetes.io/projected/7258f08e-18c1-4005-b0d8-4667d8f680df-kube-api-access-mgjww\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:11.523959 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.523923 2583 generic.go:356] "Generic (PLEG): container finished" podID="7258f08e-18c1-4005-b0d8-4667d8f680df" containerID="472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93" exitCode=0 Jun 10 00:48:11.524383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.523992 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" Jun 10 00:48:11.524383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.524005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" event={"ID":"7258f08e-18c1-4005-b0d8-4667d8f680df","Type":"ContainerDied","Data":"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93"} Jun 10 00:48:11.524383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.524082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mz9" event={"ID":"7258f08e-18c1-4005-b0d8-4667d8f680df","Type":"ContainerDied","Data":"9f02ef5d86469ce2548539871eebc47d28cd3260b2c0773d7625576e9a050cd6"} Jun 10 00:48:11.524383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.524103 2583 scope.go:117] "RemoveContainer" containerID="472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93" Jun 10 00:48:11.534495 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.534478 2583 scope.go:117] "RemoveContainer" containerID="472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93" Jun 10 00:48:11.534760 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:48:11.534743 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93\": container with ID starting with 472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93 not found: ID does not exist" containerID="472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93" Jun 10 00:48:11.534818 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.534768 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93"} err="failed to get container status \"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93\": rpc error: code = NotFound desc = could not find container \"472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93\": container with ID starting with 472dc0202f4ef9d729c25105e9bc7e316428fc4ea47f4b64b5616f954fce0f93 not found: ID does not exist" Jun 10 00:48:11.546812 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.546788 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:11.548745 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:11.548725 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mz9"] Jun 10 00:48:12.211162 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:12.211129 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7258f08e-18c1-4005-b0d8-4667d8f680df" path="/var/lib/kubelet/pods/7258f08e-18c1-4005-b0d8-4667d8f680df/volumes" Jun 10 00:48:17.470382 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:17.470343 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:17.470955 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:17.470450 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:17.492987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:17.492958 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:17.577557 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:17.577529 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sk2ks" Jun 10 00:48:18.585420 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.585372 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4"] Jun 10 00:48:18.585787 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.585736 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258f08e-18c1-4005-b0d8-4667d8f680df" containerName="registry-server" Jun 10 00:48:18.585787 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.585748 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258f08e-18c1-4005-b0d8-4667d8f680df" containerName="registry-server" Jun 10 00:48:18.585856 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.585816 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258f08e-18c1-4005-b0d8-4667d8f680df" containerName="registry-server" Jun 10 00:48:18.589080 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.589064 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.591764 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.591743 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4q82l\"" Jun 10 00:48:18.596722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.596654 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4"] Jun 10 00:48:18.712449 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.712414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599n9\" (UniqueName: \"kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.712634 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.712465 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.712634 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.712568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.813047 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.813009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.813250 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.813080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-599n9\" (UniqueName: \"kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.813250 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.813105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.813469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.813426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.813469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.813465 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.821916 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.821889 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-599n9\" (UniqueName: \"kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:18.898976 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:18.898947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:19.035304 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.035257 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4"] Jun 10 00:48:19.037574 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:19.037521 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8c1444_0cc2_4c74_8bf5_784a89cc2724.slice/crio-8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e WatchSource:0}: Error finding container 8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e: Status 404 returned error can't find the container with id 8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e Jun 10 00:48:19.196133 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.196099 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h"] Jun 10 00:48:19.199604 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.199586 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.207761 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.207735 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h"] Jun 10 00:48:19.319485 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.319443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fr55\" (UniqueName: \"kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.319657 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.319514 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.319657 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.319531 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.420963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.420862 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fr55\" (UniqueName: \"kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.420963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.420924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.420963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.420944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.421279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.421263 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.421367 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.421346 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.429349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.429328 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fr55\" (UniqueName: \"kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.528372 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.528327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:19.570191 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.570154 2583 generic.go:356] "Generic (PLEG): container finished" podID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerID="69196d98aeb30d0a3d78c690e75367af6afd7cb85a30981f1ad9cfea34609897" exitCode=0 Jun 10 00:48:19.570511 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.570242 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" event={"ID":"da8c1444-0cc2-4c74-8bf5-784a89cc2724","Type":"ContainerDied","Data":"69196d98aeb30d0a3d78c690e75367af6afd7cb85a30981f1ad9cfea34609897"} Jun 10 00:48:19.570511 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.570334 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" event={"ID":"da8c1444-0cc2-4c74-8bf5-784a89cc2724","Type":"ContainerStarted","Data":"8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e"} Jun 10 00:48:19.664098 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.664065 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h"] Jun 10 00:48:19.665122 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:19.665100 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc34be2_8f0f_4b3f_98bb_0dde125c2779.slice/crio-809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2 WatchSource:0}: Error finding container 809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2: Status 404 returned error can't find the container with id 809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2 Jun 10 00:48:19.783316 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.783272 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh"] Jun 10 00:48:19.786958 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.786942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:19.795582 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.795547 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh"] Jun 10 00:48:19.924722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.924623 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:19.924722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.924695 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:19.924915 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:19.924740 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kgm\" (UniqueName: \"kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.025156 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.025121 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kgm\" (UniqueName: \"kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.025349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.025170 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.025349 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.025235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.025638 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.025615 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.025705 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.025637 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.035865 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.035844 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kgm\" (UniqueName: \"kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.142713 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.142675 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:20.191117 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.191037 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6"] Jun 10 00:48:20.194842 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.194822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.202965 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.202832 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6"] Jun 10 00:48:20.226401 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.226356 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.226550 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.226431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrqld\" (UniqueName: \"kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.226550 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.226534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.291976 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.291948 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh"] Jun 10 00:48:20.293241 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:20.293219 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832c66ce_7f58_417a_a65c_cbb430d7d57e.slice/crio-d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833 WatchSource:0}: Error finding container d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833: Status 404 returned error can't find the container with id d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833 Jun 10 00:48:20.327331 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.327304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.327472 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.327369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrqld\" (UniqueName: \"kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.327547 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.327470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.327905 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.327885 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.327998 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.327911 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.335815 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.335782 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrqld\" (UniqueName: \"kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.511701 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.511610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:20.579073 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.579040 2583 generic.go:356] "Generic (PLEG): container finished" podID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerID="0d3eb19372ff60dc8bb7737385bb605831c0e92592d8b713b0b374441e99ddb1" exitCode=0 Jun 10 00:48:20.579243 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.579119 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" event={"ID":"832c66ce-7f58-417a-a65c-cbb430d7d57e","Type":"ContainerDied","Data":"0d3eb19372ff60dc8bb7737385bb605831c0e92592d8b713b0b374441e99ddb1"} Jun 10 00:48:20.579243 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.579180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" event={"ID":"832c66ce-7f58-417a-a65c-cbb430d7d57e","Type":"ContainerStarted","Data":"d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833"} Jun 10 00:48:20.581227 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.581204 2583 generic.go:356] "Generic (PLEG): container finished" podID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerID="e5c3903723780acb68ad2585fdb0bb6e8630b412d9449d8aae25a11af02cf505" exitCode=0 Jun 10 00:48:20.581595 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.581230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" event={"ID":"da8c1444-0cc2-4c74-8bf5-784a89cc2724","Type":"ContainerDied","Data":"e5c3903723780acb68ad2585fdb0bb6e8630b412d9449d8aae25a11af02cf505"} Jun 10 00:48:20.583158 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.583138 2583 generic.go:356] "Generic (PLEG): container finished" podID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerID="1926d8550a95969c54fa373d2fcfaa59919ee97ed3ef0844571e9e5b0d06f186" exitCode=0 Jun 10 00:48:20.583253 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.583226 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" event={"ID":"8fc34be2-8f0f-4b3f-98bb-0dde125c2779","Type":"ContainerDied","Data":"1926d8550a95969c54fa373d2fcfaa59919ee97ed3ef0844571e9e5b0d06f186"} Jun 10 00:48:20.583363 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.583274 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" event={"ID":"8fc34be2-8f0f-4b3f-98bb-0dde125c2779","Type":"ContainerStarted","Data":"809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2"} Jun 10 00:48:20.655239 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:20.655218 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6"] Jun 10 00:48:20.656623 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:20.656603 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a293386_176b_4554_99cc_d87b1a27ee81.slice/crio-71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0 WatchSource:0}: Error finding container 71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0: Status 404 returned error can't find the container with id 71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0 Jun 10 00:48:21.595627 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.595590 2583 generic.go:356] "Generic (PLEG): container finished" podID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerID="ae48a5cd9d12e51e97f20ee868408124086d477da659174260699802471a3a69" exitCode=0 Jun 10 00:48:21.596054 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.595679 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" event={"ID":"832c66ce-7f58-417a-a65c-cbb430d7d57e","Type":"ContainerDied","Data":"ae48a5cd9d12e51e97f20ee868408124086d477da659174260699802471a3a69"} Jun 10 00:48:21.598082 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.598059 2583 generic.go:356] "Generic (PLEG): container finished" podID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerID="fe188327d9b7b0d0ea851e4ed38ae6e4b33948879351769d790b3c54bbd546a5" exitCode=0 Jun 10 00:48:21.598158 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.598136 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" event={"ID":"da8c1444-0cc2-4c74-8bf5-784a89cc2724","Type":"ContainerDied","Data":"fe188327d9b7b0d0ea851e4ed38ae6e4b33948879351769d790b3c54bbd546a5"} Jun 10 00:48:21.599965 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.599948 2583 generic.go:356] "Generic (PLEG): container finished" podID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerID="8cf21ae640678004135da2205fdeb3848e1ecff1113476749fb220a1b7be0ab9" exitCode=0 Jun 10 00:48:21.600054 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.600025 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" event={"ID":"8fc34be2-8f0f-4b3f-98bb-0dde125c2779","Type":"ContainerDied","Data":"8cf21ae640678004135da2205fdeb3848e1ecff1113476749fb220a1b7be0ab9"} Jun 10 00:48:21.601895 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.601875 2583 generic.go:356] "Generic (PLEG): container finished" podID="9a293386-176b-4554-99cc-d87b1a27ee81" containerID="41e30c7d8e2cb75932568df91ab8344a014e01fbe8f224b2cbfb7458e687be66" exitCode=0 Jun 10 00:48:21.601999 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.601969 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" event={"ID":"9a293386-176b-4554-99cc-d87b1a27ee81","Type":"ContainerDied","Data":"41e30c7d8e2cb75932568df91ab8344a014e01fbe8f224b2cbfb7458e687be66"} Jun 10 00:48:21.602094 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:21.602005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" event={"ID":"9a293386-176b-4554-99cc-d87b1a27ee81","Type":"ContainerStarted","Data":"71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0"} Jun 10 00:48:22.609171 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.609138 2583 generic.go:356] "Generic (PLEG): container finished" podID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerID="539a79439780f56381303a81c954cf2013e0423cfc3406c54a1f2df65e6e2916" exitCode=0 Jun 10 00:48:22.609631 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.609225 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" event={"ID":"8fc34be2-8f0f-4b3f-98bb-0dde125c2779","Type":"ContainerDied","Data":"539a79439780f56381303a81c954cf2013e0423cfc3406c54a1f2df65e6e2916"} Jun 10 00:48:22.610989 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.610966 2583 generic.go:356] "Generic (PLEG): container finished" podID="9a293386-176b-4554-99cc-d87b1a27ee81" containerID="62c1163211c555416701418a4c80f14a1265307eea5c4864c63aaa579d9f4d12" exitCode=0 Jun 10 00:48:22.611097 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.611032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" event={"ID":"9a293386-176b-4554-99cc-d87b1a27ee81","Type":"ContainerDied","Data":"62c1163211c555416701418a4c80f14a1265307eea5c4864c63aaa579d9f4d12"} Jun 10 00:48:22.613286 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.613264 2583 generic.go:356] "Generic (PLEG): container finished" podID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerID="f9cd75cc0134317ef95d4e07eb753c1a2b119b2e7b7d92b26ac4102ce05410f8" exitCode=0 Jun 10 00:48:22.613366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.613346 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" event={"ID":"832c66ce-7f58-417a-a65c-cbb430d7d57e","Type":"ContainerDied","Data":"f9cd75cc0134317ef95d4e07eb753c1a2b119b2e7b7d92b26ac4102ce05410f8"} Jun 10 00:48:22.747910 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.747881 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:22.851504 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.851463 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle\") pod \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " Jun 10 00:48:22.851651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.851517 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-599n9\" (UniqueName: \"kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9\") pod \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " Jun 10 00:48:22.851651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.851574 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util\") pod \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\" (UID: \"da8c1444-0cc2-4c74-8bf5-784a89cc2724\") " Jun 10 00:48:22.852280 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.852252 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle" (OuterVolumeSpecName: "bundle") pod "da8c1444-0cc2-4c74-8bf5-784a89cc2724" (UID: "da8c1444-0cc2-4c74-8bf5-784a89cc2724"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:22.853723 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.853699 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9" (OuterVolumeSpecName: "kube-api-access-599n9") pod "da8c1444-0cc2-4c74-8bf5-784a89cc2724" (UID: "da8c1444-0cc2-4c74-8bf5-784a89cc2724"). InnerVolumeSpecName "kube-api-access-599n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:48:22.856899 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.856879 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util" (OuterVolumeSpecName: "util") pod "da8c1444-0cc2-4c74-8bf5-784a89cc2724" (UID: "da8c1444-0cc2-4c74-8bf5-784a89cc2724"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:22.952882 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.952809 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:22.952882 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.952836 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-599n9\" (UniqueName: \"kubernetes.io/projected/da8c1444-0cc2-4c74-8bf5-784a89cc2724-kube-api-access-599n9\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:22.952882 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:22.952846 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da8c1444-0cc2-4c74-8bf5-784a89cc2724-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.621281 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.621244 2583 generic.go:356] "Generic (PLEG): container finished" podID="9a293386-176b-4554-99cc-d87b1a27ee81" containerID="b3f00ff02450831820756e4cda9cf95aee460a4ee7ec9f21fb598b6040d5b36a" exitCode=0 Jun 10 00:48:23.621720 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.621334 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" event={"ID":"9a293386-176b-4554-99cc-d87b1a27ee81","Type":"ContainerDied","Data":"b3f00ff02450831820756e4cda9cf95aee460a4ee7ec9f21fb598b6040d5b36a"} Jun 10 00:48:23.623084 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.623061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" event={"ID":"da8c1444-0cc2-4c74-8bf5-784a89cc2724","Type":"ContainerDied","Data":"8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e"} Jun 10 00:48:23.623191 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.623101 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8860c3e3138bf95896dc04b54273e20cbbcd0de24782f13b36ef3b27256d079e" Jun 10 00:48:23.623191 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.623137 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4" Jun 10 00:48:23.763762 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.763731 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:23.796061 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.796031 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:23.861221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861179 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util\") pod \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " Jun 10 00:48:23.861221 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861228 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9kgm\" (UniqueName: \"kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm\") pod \"832c66ce-7f58-417a-a65c-cbb430d7d57e\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " Jun 10 00:48:23.861501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861293 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util\") pod \"832c66ce-7f58-417a-a65c-cbb430d7d57e\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " Jun 10 00:48:23.861501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861313 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle\") pod \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " Jun 10 00:48:23.861501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861329 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle\") pod \"832c66ce-7f58-417a-a65c-cbb430d7d57e\" (UID: \"832c66ce-7f58-417a-a65c-cbb430d7d57e\") " Jun 10 00:48:23.861501 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861353 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fr55\" (UniqueName: \"kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55\") pod \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\" (UID: \"8fc34be2-8f0f-4b3f-98bb-0dde125c2779\") " Jun 10 00:48:23.861940 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861907 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle" (OuterVolumeSpecName: "bundle") pod "832c66ce-7f58-417a-a65c-cbb430d7d57e" (UID: "832c66ce-7f58-417a-a65c-cbb430d7d57e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:23.862023 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.861944 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle" (OuterVolumeSpecName: "bundle") pod "8fc34be2-8f0f-4b3f-98bb-0dde125c2779" (UID: "8fc34be2-8f0f-4b3f-98bb-0dde125c2779"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:23.863713 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.863679 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55" (OuterVolumeSpecName: "kube-api-access-5fr55") pod "8fc34be2-8f0f-4b3f-98bb-0dde125c2779" (UID: "8fc34be2-8f0f-4b3f-98bb-0dde125c2779"). InnerVolumeSpecName "kube-api-access-5fr55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:48:23.864135 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.864114 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm" (OuterVolumeSpecName: "kube-api-access-d9kgm") pod "832c66ce-7f58-417a-a65c-cbb430d7d57e" (UID: "832c66ce-7f58-417a-a65c-cbb430d7d57e"). InnerVolumeSpecName "kube-api-access-d9kgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:48:23.867008 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.866980 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util" (OuterVolumeSpecName: "util") pod "832c66ce-7f58-417a-a65c-cbb430d7d57e" (UID: "832c66ce-7f58-417a-a65c-cbb430d7d57e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:23.868088 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.868063 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util" (OuterVolumeSpecName: "util") pod "8fc34be2-8f0f-4b3f-98bb-0dde125c2779" (UID: "8fc34be2-8f0f-4b3f-98bb-0dde125c2779"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962747 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962791 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9kgm\" (UniqueName: \"kubernetes.io/projected/832c66ce-7f58-417a-a65c-cbb430d7d57e-kube-api-access-d9kgm\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962802 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962811 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962819 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/832c66ce-7f58-417a-a65c-cbb430d7d57e-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:23.962844 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:23.962827 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fr55\" (UniqueName: \"kubernetes.io/projected/8fc34be2-8f0f-4b3f-98bb-0dde125c2779-kube-api-access-5fr55\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:24.630240 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.630210 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" Jun 10 00:48:24.630699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.630238 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh" event={"ID":"832c66ce-7f58-417a-a65c-cbb430d7d57e","Type":"ContainerDied","Data":"d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833"} Jun 10 00:48:24.630699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.630288 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3c752c7325cd9d3f0570c706bfd5788f1bd3645e8333dac3da07c7c3b18a833" Jun 10 00:48:24.633809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.633775 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" Jun 10 00:48:24.633941 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.633818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h" event={"ID":"8fc34be2-8f0f-4b3f-98bb-0dde125c2779","Type":"ContainerDied","Data":"809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2"} Jun 10 00:48:24.633941 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.633863 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="809d8511ec5dd66f6ccff30ac2dcc40162e86690d906c5e101d0ad43e8e934a2" Jun 10 00:48:24.768403 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.768363 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:24.871421 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.871373 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle\") pod \"9a293386-176b-4554-99cc-d87b1a27ee81\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " Jun 10 00:48:24.871421 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.871427 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrqld\" (UniqueName: \"kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld\") pod \"9a293386-176b-4554-99cc-d87b1a27ee81\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " Jun 10 00:48:24.871626 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.871476 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util\") pod \"9a293386-176b-4554-99cc-d87b1a27ee81\" (UID: \"9a293386-176b-4554-99cc-d87b1a27ee81\") " Jun 10 00:48:24.871930 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.871898 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle" (OuterVolumeSpecName: "bundle") pod "9a293386-176b-4554-99cc-d87b1a27ee81" (UID: "9a293386-176b-4554-99cc-d87b1a27ee81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:24.873685 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.873664 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld" (OuterVolumeSpecName: "kube-api-access-zrqld") pod "9a293386-176b-4554-99cc-d87b1a27ee81" (UID: "9a293386-176b-4554-99cc-d87b1a27ee81"). InnerVolumeSpecName "kube-api-access-zrqld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:48:24.879645 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.879617 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util" (OuterVolumeSpecName: "util") pod "9a293386-176b-4554-99cc-d87b1a27ee81" (UID: "9a293386-176b-4554-99cc-d87b1a27ee81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:48:24.973002 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.972954 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:24.973002 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.972998 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrqld\" (UniqueName: \"kubernetes.io/projected/9a293386-176b-4554-99cc-d87b1a27ee81-kube-api-access-zrqld\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:24.973002 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:24.973008 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a293386-176b-4554-99cc-d87b1a27ee81-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:48:25.641229 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:25.641193 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" Jun 10 00:48:25.641229 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:25.641217 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6" event={"ID":"9a293386-176b-4554-99cc-d87b1a27ee81","Type":"ContainerDied","Data":"71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0"} Jun 10 00:48:25.641658 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:25.641264 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71af9cefe20eb2618e2bdf6bd31984a26c03a5d21a3534ae6dd4d81324f30db0" Jun 10 00:48:35.606657 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.606617 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t"] Jun 10 00:48:35.607984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.607954 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="pull" Jun 10 00:48:35.607984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.607980 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="pull" Jun 10 00:48:35.607984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.607989 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="extract" Jun 10 00:48:35.608165 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.607995 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="extract" Jun 10 00:48:35.608165 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608001 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="pull" Jun 10 00:48:35.608165 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608006 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="pull" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608205 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="util" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608214 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="util" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608222 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="pull" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608230 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="pull" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608245 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="util" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608253 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="util" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608261 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="util" Jun 10 00:48:35.608279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608268 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="util" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608288 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608295 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608310 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="util" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608318 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="util" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608326 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="pull" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608333 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="pull" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608364 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608373 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608384 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608415 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608503 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="832c66ce-7f58-417a-a65c-cbb430d7d57e" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608513 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a293386-176b-4554-99cc-d87b1a27ee81" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608523 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8c1444-0cc2-4c74-8bf5-784a89cc2724" containerName="extract" Jun 10 00:48:35.608532 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.608535 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc34be2-8f0f-4b3f-98bb-0dde125c2779" containerName="extract" Jun 10 00:48:35.613434 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.613417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:35.617961 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.617933 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wqgv7\"" Jun 10 00:48:35.620790 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.620747 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t"] Jun 10 00:48:35.664995 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.664954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh2w8\" (UniqueName: \"kubernetes.io/projected/6ad55ecf-9f62-4268-939d-b48567616c6c-kube-api-access-nh2w8\") pod \"authorino-operator-75cc8d5cb7-9nv4t\" (UID: \"6ad55ecf-9f62-4268-939d-b48567616c6c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:35.765578 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.765541 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh2w8\" (UniqueName: \"kubernetes.io/projected/6ad55ecf-9f62-4268-939d-b48567616c6c-kube-api-access-nh2w8\") pod \"authorino-operator-75cc8d5cb7-9nv4t\" (UID: \"6ad55ecf-9f62-4268-939d-b48567616c6c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:35.779975 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.779942 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh2w8\" (UniqueName: \"kubernetes.io/projected/6ad55ecf-9f62-4268-939d-b48567616c6c-kube-api-access-nh2w8\") pod \"authorino-operator-75cc8d5cb7-9nv4t\" (UID: \"6ad55ecf-9f62-4268-939d-b48567616c6c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:35.924759 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:35.924672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:36.057720 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:36.057693 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t"] Jun 10 00:48:36.058725 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:36.058690 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad55ecf_9f62_4268_939d_b48567616c6c.slice/crio-8e9e8ce7e7617a49b7e945fdaee0fa84b97bd4d60925d2f65d99ee7f373cacb1 WatchSource:0}: Error finding container 8e9e8ce7e7617a49b7e945fdaee0fa84b97bd4d60925d2f65d99ee7f373cacb1: Status 404 returned error can't find the container with id 8e9e8ce7e7617a49b7e945fdaee0fa84b97bd4d60925d2f65d99ee7f373cacb1 Jun 10 00:48:36.702638 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:36.702594 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" event={"ID":"6ad55ecf-9f62-4268-939d-b48567616c6c","Type":"ContainerStarted","Data":"8e9e8ce7e7617a49b7e945fdaee0fa84b97bd4d60925d2f65d99ee7f373cacb1"} Jun 10 00:48:38.715722 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.715677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" event={"ID":"6ad55ecf-9f62-4268-939d-b48567616c6c","Type":"ContainerStarted","Data":"f7d81a880fe394603971950243c706f670aa5df4e8d764dd2dc7026b6ea6311f"} Jun 10 00:48:38.716125 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.715734 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:38.737121 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.737059 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" podStartSLOduration=1.579671243 podStartE2EDuration="3.737044053s" totalImagesPullingTime="2.15737281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:38.734581379 +0000 UTC m=+792.941553287" watchObservedRunningTime="2026-06-10 00:48:38.737044053 +0000 UTC m=+792.944016135" Jun 10 00:48:38.867978 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.867945 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h"] Jun 10 00:48:38.873242 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.873220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:38.876272 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.876247 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n8f8f\"" Jun 10 00:48:38.879814 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.879786 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h"] Jun 10 00:48:38.992766 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:38.992680 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p876t\" (UniqueName: \"kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t\") pod \"limitador-operator-controller-manager-859d7b78bd-h548h\" (UID: \"eea249fb-984c-4b5c-82d7-16f4c8939672\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:39.093774 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:39.093737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p876t\" (UniqueName: \"kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t\") pod \"limitador-operator-controller-manager-859d7b78bd-h548h\" (UID: \"eea249fb-984c-4b5c-82d7-16f4c8939672\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:39.109027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:39.108984 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p876t\" (UniqueName: \"kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t\") pod \"limitador-operator-controller-manager-859d7b78bd-h548h\" (UID: \"eea249fb-984c-4b5c-82d7-16f4c8939672\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:39.185039 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:39.185007 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:39.323350 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:39.323320 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h"] Jun 10 00:48:39.324653 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:39.324624 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea249fb_984c_4b5c_82d7_16f4c8939672.slice/crio-14bd8f118b5ef8e9a56710499fa9ad003289fda4d043bf6fced0a1ab9058bd3c WatchSource:0}: Error finding container 14bd8f118b5ef8e9a56710499fa9ad003289fda4d043bf6fced0a1ab9058bd3c: Status 404 returned error can't find the container with id 14bd8f118b5ef8e9a56710499fa9ad003289fda4d043bf6fced0a1ab9058bd3c Jun 10 00:48:39.723332 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:39.723299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" event={"ID":"eea249fb-984c-4b5c-82d7-16f4c8939672","Type":"ContainerStarted","Data":"14bd8f118b5ef8e9a56710499fa9ad003289fda4d043bf6fced0a1ab9058bd3c"} Jun 10 00:48:41.738047 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:41.738011 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" event={"ID":"eea249fb-984c-4b5c-82d7-16f4c8939672","Type":"ContainerStarted","Data":"0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f"} Jun 10 00:48:41.738448 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:41.738162 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:41.754741 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:41.754692 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" podStartSLOduration=2.050551917 podStartE2EDuration="3.754679074s" totalImagesPullingTime="1.704127157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:41.753318546 +0000 UTC m=+795.960290455" watchObservedRunningTime="2026-06-10 00:48:41.754679074 +0000 UTC m=+795.961650962" Jun 10 00:48:49.725888 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:49.725807 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9nv4t" Jun 10 00:48:52.745803 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:52.745776 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:48:58.800950 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.800915 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk"] Jun 10 00:48:58.805920 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.805899 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:58.809982 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.809957 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4q82l\"" Jun 10 00:48:58.811190 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.810210 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 00:48:58.812365 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.810261 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 00:48:58.816371 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.816349 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk"] Jun 10 00:48:58.971166 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.971126 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f91b039d-b3f5-45cc-b30d-a687b09f1235-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:58.971347 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.971180 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm874\" (UniqueName: \"kubernetes.io/projected/f91b039d-b3f5-45cc-b30d-a687b09f1235-kube-api-access-cm874\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:58.971347 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:58.971288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f91b039d-b3f5-45cc-b30d-a687b09f1235-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.071926 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.071837 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f91b039d-b3f5-45cc-b30d-a687b09f1235-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.071926 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.071902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm874\" (UniqueName: \"kubernetes.io/projected/f91b039d-b3f5-45cc-b30d-a687b09f1235-kube-api-access-cm874\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.072116 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.071978 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f91b039d-b3f5-45cc-b30d-a687b09f1235-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.072527 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.072502 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f91b039d-b3f5-45cc-b30d-a687b09f1235-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.074506 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.074483 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f91b039d-b3f5-45cc-b30d-a687b09f1235-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.080121 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.080100 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm874\" (UniqueName: \"kubernetes.io/projected/f91b039d-b3f5-45cc-b30d-a687b09f1235-kube-api-access-cm874\") pod \"kuadrant-console-plugin-66b5774985-4nndk\" (UID: \"f91b039d-b3f5-45cc-b30d-a687b09f1235\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.118535 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.118500 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" Jun 10 00:48:59.270984 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.270958 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk"] Jun 10 00:48:59.273178 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:48:59.273149 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf91b039d_b3f5_45cc_b30d_a687b09f1235.slice/crio-0a42e6723f1d0e1eee686b5e865736e3b244b451ebfa2b436b7c494c9ab97716 WatchSource:0}: Error finding container 0a42e6723f1d0e1eee686b5e865736e3b244b451ebfa2b436b7c494c9ab97716: Status 404 returned error can't find the container with id 0a42e6723f1d0e1eee686b5e865736e3b244b451ebfa2b436b7c494c9ab97716 Jun 10 00:48:59.847923 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:48:59.847869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" event={"ID":"f91b039d-b3f5-45cc-b30d-a687b09f1235","Type":"ContainerStarted","Data":"0a42e6723f1d0e1eee686b5e865736e3b244b451ebfa2b436b7c494c9ab97716"} Jun 10 00:49:09.589700 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.589668 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h"] Jun 10 00:49:09.590157 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.589918 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" containerName="manager" containerID="cri-o://0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f" gracePeriod=2 Jun 10 00:49:09.602049 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.601985 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h"] Jun 10 00:49:09.613531 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.613505 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg"] Jun 10 00:49:09.613884 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.613865 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" containerName="manager" Jun 10 00:49:09.613884 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.613882 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" containerName="manager" Jun 10 00:49:09.614048 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.613993 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" containerName="manager" Jun 10 00:49:09.619751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.619732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:09.627168 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.627143 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg"] Jun 10 00:49:09.638752 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:09.638701 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h548h\" is forbidden: User \"system:node:ip-10-0-141-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-5.ec2.internal' and this object" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:49:09.676074 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.676043 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t88z\" (UniqueName: \"kubernetes.io/projected/589d644f-8a96-49bd-8412-618cd391b0cd-kube-api-access-9t88z\") pod \"limitador-operator-controller-manager-859d7b78bd-7xwlg\" (UID: \"589d644f-8a96-49bd-8412-618cd391b0cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:09.776945 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.776917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t88z\" (UniqueName: \"kubernetes.io/projected/589d644f-8a96-49bd-8412-618cd391b0cd-kube-api-access-9t88z\") pod \"limitador-operator-controller-manager-859d7b78bd-7xwlg\" (UID: \"589d644f-8a96-49bd-8412-618cd391b0cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:09.785629 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.785597 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t88z\" (UniqueName: \"kubernetes.io/projected/589d644f-8a96-49bd-8412-618cd391b0cd-kube-api-access-9t88z\") pod \"limitador-operator-controller-manager-859d7b78bd-7xwlg\" (UID: \"589d644f-8a96-49bd-8412-618cd391b0cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:09.834699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.834674 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:49:09.837869 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:09.837846 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h548h\" is forbidden: User \"system:node:ip-10-0-141-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-5.ec2.internal' and this object" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:49:09.913413 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.913356 2583 generic.go:356] "Generic (PLEG): container finished" podID="eea249fb-984c-4b5c-82d7-16f4c8939672" containerID="0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f" exitCode=0 Jun 10 00:49:09.913568 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.913416 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:49:09.913568 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.913458 2583 scope.go:117] "RemoveContainer" containerID="0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f" Jun 10 00:49:09.916111 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:09.916089 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-h548h\" is forbidden: User \"system:node:ip-10-0-141-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-5.ec2.internal' and this object" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h548h" Jun 10 00:49:09.922195 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.922179 2583 scope.go:117] "RemoveContainer" containerID="0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f" Jun 10 00:49:09.922487 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:09.922469 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f\": container with ID starting with 0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f not found: ID does not exist" containerID="0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f" Jun 10 00:49:09.922556 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.922499 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f"} err="failed to get container status \"0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f\": rpc error: code = NotFound desc = could not find container \"0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f\": container with ID starting with 0d1e2b251ae6347af9edec93dd6d54b04fc8af007fefe5671710dd8cc8553b3f not found: ID does not exist" Jun 10 00:49:09.979016 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.978987 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p876t\" (UniqueName: \"kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t\") pod \"eea249fb-984c-4b5c-82d7-16f4c8939672\" (UID: \"eea249fb-984c-4b5c-82d7-16f4c8939672\") " Jun 10 00:49:09.981064 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.981041 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t" (OuterVolumeSpecName: "kube-api-access-p876t") pod "eea249fb-984c-4b5c-82d7-16f4c8939672" (UID: "eea249fb-984c-4b5c-82d7-16f4c8939672"). InnerVolumeSpecName "kube-api-access-p876t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:09.985115 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:09.985100 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:10.079770 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.079747 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p876t\" (UniqueName: \"kubernetes.io/projected/eea249fb-984c-4b5c-82d7-16f4c8939672-kube-api-access-p876t\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:49:10.138700 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.138665 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg"] Jun 10 00:49:10.139967 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:49:10.139937 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589d644f_8a96_49bd_8412_618cd391b0cd.slice/crio-8ced34162388c547c964a59681c155f845ac3264e10d404839d6675f3728fe9b WatchSource:0}: Error finding container 8ced34162388c547c964a59681c155f845ac3264e10d404839d6675f3728fe9b: Status 404 returned error can't find the container with id 8ced34162388c547c964a59681c155f845ac3264e10d404839d6675f3728fe9b Jun 10 00:49:10.213681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.213654 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" path="/var/lib/kubelet/pods/eea249fb-984c-4b5c-82d7-16f4c8939672/volumes" Jun 10 00:49:10.213806 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:10.213654 2583 kubelet_getters.go:352] "Could not read directory" err="open /var/lib/kubelet/pods/eea249fb-984c-4b5c-82d7-16f4c8939672/volumes: no such file or directory" path="/var/lib/kubelet/pods/eea249fb-984c-4b5c-82d7-16f4c8939672/volumes" Jun 10 00:49:10.213806 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:49:10.213700 2583 kubelet_volumes.go:89] "Pod found, but error occurred during checking mounted volumes from disk" err="open /var/lib/kubelet/pods/eea249fb-984c-4b5c-82d7-16f4c8939672/volumes: no such file or directory" podUID="eea249fb-984c-4b5c-82d7-16f4c8939672" Jun 10 00:49:10.922263 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.922232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" event={"ID":"589d644f-8a96-49bd-8412-618cd391b0cd","Type":"ContainerStarted","Data":"b90b1b63973868e9e4f32900ed3a5064d43a9ffdf9896f86e21adb36fbdaa696"} Jun 10 00:49:10.922712 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.922301 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" event={"ID":"589d644f-8a96-49bd-8412-618cd391b0cd","Type":"ContainerStarted","Data":"8ced34162388c547c964a59681c155f845ac3264e10d404839d6675f3728fe9b"} Jun 10 00:49:10.922712 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.922329 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:10.938467 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:10.938411 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" podStartSLOduration=1.938370925 podStartE2EDuration="1.938370925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:10.937969867 +0000 UTC m=+825.144941756" watchObservedRunningTime="2026-06-10 00:49:10.938370925 +0000 UTC m=+825.145342815" Jun 10 00:49:21.932554 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:21.932521 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7xwlg" Jun 10 00:49:25.023463 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:25.023421 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" event={"ID":"f91b039d-b3f5-45cc-b30d-a687b09f1235","Type":"ContainerStarted","Data":"f58da81c19760de063992bff4da0733c6af02fc99fea1ad96704ebac74644ff2"} Jun 10 00:49:25.041789 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:25.041747 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4nndk" podStartSLOduration=1.8717725920000001 podStartE2EDuration="27.041733827s" totalImagesPullingTime="25.169961235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:25.040344492 +0000 UTC m=+839.247316380" watchObservedRunningTime="2026-06-10 00:49:25.041733827 +0000 UTC m=+839.248705728" Jun 10 00:49:43.455594 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.455561 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8"] Jun 10 00:49:43.603028 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.602988 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8"] Jun 10 00:49:43.603195 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.603094 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.605779 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.605751 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cxgnd\"" Jun 10 00:49:43.692756 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692722 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.692756 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.692963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zstw\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-kube-api-access-7zstw\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.692963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692872 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.692963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.692963 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.693146 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.692965 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.693146 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.693071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.693146 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.693138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c989d18-cd92-4e05-8e65-6f57f07beeed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794684 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794684 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794640 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c989d18-cd92-4e05-8e65-6f57f07beeed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794830 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zstw\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-kube-api-access-7zstw\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.794996 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.794956 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.795478 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.795031 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.795478 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.795225 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.795478 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.795335 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.795478 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.795409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.795863 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.795822 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c989d18-cd92-4e05-8e65-6f57f07beeed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.797250 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.797227 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.797852 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.797825 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.803175 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.803145 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.803471 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.803451 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zstw\" (UniqueName: \"kubernetes.io/projected/1c989d18-cd92-4e05-8e65-6f57f07beeed-kube-api-access-7zstw\") pod \"maas-default-gateway-openshift-default-8559cd5744-mnzd8\" (UID: \"1c989d18-cd92-4e05-8e65-6f57f07beeed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:43.913421 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:43.913355 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:44.125885 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:44.125858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8"] Jun 10 00:49:44.127428 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:49:44.127375 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c989d18_cd92_4e05_8e65_6f57f07beeed.slice/crio-35ba1351600cc6a5f98d486d459db67dfe11c3e18379c85f661cd7b1fe141391 WatchSource:0}: Error finding container 35ba1351600cc6a5f98d486d459db67dfe11c3e18379c85f661cd7b1fe141391: Status 404 returned error can't find the container with id 35ba1351600cc6a5f98d486d459db67dfe11c3e18379c85f661cd7b1fe141391 Jun 10 00:49:44.129681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:44.129640 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:49:44.129804 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:44.129720 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:49:44.129804 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:44.129758 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:49:45.141560 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:45.141518 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" event={"ID":"1c989d18-cd92-4e05-8e65-6f57f07beeed","Type":"ContainerStarted","Data":"6a849f2d276567926d909ba0382672a7409de990358e26138b8e474327469043"} Jun 10 00:49:45.141973 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:45.141589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" event={"ID":"1c989d18-cd92-4e05-8e65-6f57f07beeed","Type":"ContainerStarted","Data":"35ba1351600cc6a5f98d486d459db67dfe11c3e18379c85f661cd7b1fe141391"} Jun 10 00:49:45.162645 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:45.162596 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" podStartSLOduration=2.162578995 podStartE2EDuration="2.162578995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:45.161700492 +0000 UTC m=+859.368672399" watchObservedRunningTime="2026-06-10 00:49:45.162578995 +0000 UTC m=+859.369550944" Jun 10 00:49:45.913973 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:45.913931 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:45.918742 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:45.918717 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:46.147543 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:46.147508 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:49:46.148564 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:49:46.148546 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:50:26.222543 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:26.222470 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:50:26.226229 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:26.226201 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:50:26.231460 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:26.231442 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:50:26.235245 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:26.235226 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:50:33.925711 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.925678 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2"] Jun 10 00:50:33.929670 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.929649 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:33.933781 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.933759 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 00:50:33.934002 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.933986 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 00:50:33.935297 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.935277 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8nj95\"" Jun 10 00:50:33.940375 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:33.940353 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2"] Jun 10 00:50:34.046786 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.046744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.046786 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.046791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.046995 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.046849 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5k5\" (UniqueName: \"kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.148034 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.147995 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.148230 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.148047 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.148230 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.148100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5k5\" (UniqueName: \"kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.148383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.148361 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.148454 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.148411 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.160618 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.160598 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5k5\" (UniqueName: \"kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.239966 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.239872 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:34.376647 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.376611 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2"] Jun 10 00:50:34.377097 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:50:34.377076 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06948dda_bfa5_4dd5_867a_9afa9a400fcd.slice/crio-42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167 WatchSource:0}: Error finding container 42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167: Status 404 returned error can't find the container with id 42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167 Jun 10 00:50:34.418503 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:34.418476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" event={"ID":"06948dda-bfa5-4dd5-867a-9afa9a400fcd","Type":"ContainerStarted","Data":"42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167"} Jun 10 00:50:35.425923 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:35.425835 2583 generic.go:356] "Generic (PLEG): container finished" podID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerID="59544a6f9dee0745357bb320a976884a6ba4a2d7cd1261093df8e479afe404b3" exitCode=0 Jun 10 00:50:35.426256 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:35.425923 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" event={"ID":"06948dda-bfa5-4dd5-867a-9afa9a400fcd","Type":"ContainerDied","Data":"59544a6f9dee0745357bb320a976884a6ba4a2d7cd1261093df8e479afe404b3"} Jun 10 00:50:36.433879 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:36.433850 2583 generic.go:356] "Generic (PLEG): container finished" podID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerID="7b64f36334414a1e031e7bd32b7d50452224315b077e317ad2704c5fc3ffae2a" exitCode=0 Jun 10 00:50:36.434286 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:36.433904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" event={"ID":"06948dda-bfa5-4dd5-867a-9afa9a400fcd","Type":"ContainerDied","Data":"7b64f36334414a1e031e7bd32b7d50452224315b077e317ad2704c5fc3ffae2a"} Jun 10 00:50:37.441155 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:37.441121 2583 generic.go:356] "Generic (PLEG): container finished" podID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerID="d41ec5f38878585c726f5f67994c48e74c70596b1c4244633768ad7b9239a78f" exitCode=0 Jun 10 00:50:37.441549 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:37.441204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" event={"ID":"06948dda-bfa5-4dd5-867a-9afa9a400fcd","Type":"ContainerDied","Data":"d41ec5f38878585c726f5f67994c48e74c70596b1c4244633768ad7b9239a78f"} Jun 10 00:50:38.589216 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.589180 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:50:38.686617 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.686584 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm5k5\" (UniqueName: \"kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5\") pod \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " Jun 10 00:50:38.686809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.686637 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util\") pod \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " Jun 10 00:50:38.686809 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.686653 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle\") pod \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\" (UID: \"06948dda-bfa5-4dd5-867a-9afa9a400fcd\") " Jun 10 00:50:38.687144 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.687115 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle" (OuterVolumeSpecName: "bundle") pod "06948dda-bfa5-4dd5-867a-9afa9a400fcd" (UID: "06948dda-bfa5-4dd5-867a-9afa9a400fcd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:50:38.688867 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.688842 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5" (OuterVolumeSpecName: "kube-api-access-hm5k5") pod "06948dda-bfa5-4dd5-867a-9afa9a400fcd" (UID: "06948dda-bfa5-4dd5-867a-9afa9a400fcd"). InnerVolumeSpecName "kube-api-access-hm5k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:50:38.692946 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.692922 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util" (OuterVolumeSpecName: "util") pod "06948dda-bfa5-4dd5-867a-9afa9a400fcd" (UID: "06948dda-bfa5-4dd5-867a-9afa9a400fcd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:50:38.794112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.788565 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm5k5\" (UniqueName: \"kubernetes.io/projected/06948dda-bfa5-4dd5-867a-9afa9a400fcd-kube-api-access-hm5k5\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:50:38.794112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.788604 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-util\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:50:38.794112 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:38.788618 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06948dda-bfa5-4dd5-867a-9afa9a400fcd-bundle\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:50:39.454651 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:39.454615 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" event={"ID":"06948dda-bfa5-4dd5-867a-9afa9a400fcd","Type":"ContainerDied","Data":"42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167"} Jun 10 00:50:39.454865 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:39.454681 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42f4258ab10ba031c6b96fc7319ce1632743f25aec5c3e1624c47a48e77d6167" Jun 10 00:50:39.454865 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:50:39.454631 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7487hcm2" Jun 10 00:51:02.305707 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.305672 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306035 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="util" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306046 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="util" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306056 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="pull" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306063 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="pull" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306080 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="extract" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306085 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="extract" Jun 10 00:51:02.308308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.306143 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06948dda-bfa5-4dd5-867a-9afa9a400fcd" containerName="extract" Jun 10 00:51:02.309258 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.309241 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:02.313027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.312994 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 00:51:02.313027 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.313017 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tkztk\"" Jun 10 00:51:02.313204 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.312992 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 00:51:02.314236 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.314219 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 00:51:02.319220 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.319187 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:51:02.396085 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.396047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6fh\" (UniqueName: \"kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh\") pod \"maas-keycloak-0\" (UID: \"2459cab4-28b4-4a4b-8e82-6d2b87042062\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:02.496708 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.496664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6fh\" (UniqueName: \"kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh\") pod \"maas-keycloak-0\" (UID: \"2459cab4-28b4-4a4b-8e82-6d2b87042062\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:02.504834 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.504813 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6fh\" (UniqueName: \"kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh\") pod \"maas-keycloak-0\" (UID: \"2459cab4-28b4-4a4b-8e82-6d2b87042062\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:02.619588 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.619564 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:02.759420 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:51:02.759374 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2459cab4_28b4_4a4b_8e82_6d2b87042062.slice/crio-b573667861e877921198f3c1fe4583e5c13df4eeca1187c9668854478c0a72f1 WatchSource:0}: Error finding container b573667861e877921198f3c1fe4583e5c13df4eeca1187c9668854478c0a72f1: Status 404 returned error can't find the container with id b573667861e877921198f3c1fe4583e5c13df4eeca1187c9668854478c0a72f1 Jun 10 00:51:02.759527 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.759413 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:51:02.760774 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:02.760758 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:51:03.590590 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:03.590551 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2459cab4-28b4-4a4b-8e82-6d2b87042062","Type":"ContainerStarted","Data":"b573667861e877921198f3c1fe4583e5c13df4eeca1187c9668854478c0a72f1"} Jun 10 00:51:07.622461 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:07.622422 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2459cab4-28b4-4a4b-8e82-6d2b87042062","Type":"ContainerStarted","Data":"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726"} Jun 10 00:51:07.640907 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:07.640796 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.017642965 podStartE2EDuration="5.640778105s" totalImagesPullingTime="4.62313514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:51:07.639519158 +0000 UTC m=+941.846491047" watchObservedRunningTime="2026-06-10 00:51:07.640778105 +0000 UTC m=+941.847749994" Jun 10 00:51:08.619914 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:08.619875 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:08.621751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:08.621713 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:09.620509 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:09.620455 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:10.620321 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:10.620265 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:11.620058 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:11.620011 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:12.620275 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:12.620223 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:12.621487 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:12.621449 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:13.620383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:13.620334 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:14.620889 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:14.620834 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:15.621024 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:15.620970 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:16.620415 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:16.620346 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:17.620604 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:17.620548 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:18.620015 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:18.619971 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:19.619975 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:19.619926 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 10 00:51:20.742610 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:20.742573 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 00:51:20.761546 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:20.761500 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:51:30.748960 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:51:30.748928 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:12.105311 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.105280 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s6zht"] Jun 10 00:52:12.108909 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.108891 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:12.112180 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.112158 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5b4br\"" Jun 10 00:52:12.112552 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.112536 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 00:52:12.119356 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.119327 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s6zht"] Jun 10 00:52:12.137495 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.137467 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pgqbj"] Jun 10 00:52:12.141062 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.141042 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:12.149954 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.149933 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pgqbj"] Jun 10 00:52:12.265551 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.265510 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4tmm\" (UniqueName: \"kubernetes.io/projected/b1ed217d-6b2d-40bc-82b1-122880b304db-kube-api-access-j4tmm\") pod \"payload-processing-699b6cd6c-pgqbj\" (UID: \"b1ed217d-6b2d-40bc-82b1-122880b304db\") " pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:12.265732 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.265566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9587\" (UniqueName: \"kubernetes.io/projected/3d92c966-14fb-4204-bd2b-b2cedf8efb87-kube-api-access-w9587\") pod \"payload-pre-processing-579785bc64-s6zht\" (UID: \"3d92c966-14fb-4204-bd2b-b2cedf8efb87\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:12.366902 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.366815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4tmm\" (UniqueName: \"kubernetes.io/projected/b1ed217d-6b2d-40bc-82b1-122880b304db-kube-api-access-j4tmm\") pod \"payload-processing-699b6cd6c-pgqbj\" (UID: \"b1ed217d-6b2d-40bc-82b1-122880b304db\") " pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:12.366902 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.366878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9587\" (UniqueName: \"kubernetes.io/projected/3d92c966-14fb-4204-bd2b-b2cedf8efb87-kube-api-access-w9587\") pod \"payload-pre-processing-579785bc64-s6zht\" (UID: \"3d92c966-14fb-4204-bd2b-b2cedf8efb87\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:12.374933 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.374903 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4tmm\" (UniqueName: \"kubernetes.io/projected/b1ed217d-6b2d-40bc-82b1-122880b304db-kube-api-access-j4tmm\") pod \"payload-processing-699b6cd6c-pgqbj\" (UID: \"b1ed217d-6b2d-40bc-82b1-122880b304db\") " pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:12.375103 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.375085 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9587\" (UniqueName: \"kubernetes.io/projected/3d92c966-14fb-4204-bd2b-b2cedf8efb87-kube-api-access-w9587\") pod \"payload-pre-processing-579785bc64-s6zht\" (UID: \"3d92c966-14fb-4204-bd2b-b2cedf8efb87\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:12.419415 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.419351 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:12.452494 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.452463 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:12.580784 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.572302 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s6zht"] Jun 10 00:52:12.610340 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:12.610310 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pgqbj"] Jun 10 00:52:12.611289 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:52:12.611265 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ed217d_6b2d_40bc_82b1_122880b304db.slice/crio-9d6735ff6e3b5360390c1207f7615757161c1eec036e00ea01f273a04efa99ba WatchSource:0}: Error finding container 9d6735ff6e3b5360390c1207f7615757161c1eec036e00ea01f273a04efa99ba: Status 404 returned error can't find the container with id 9d6735ff6e3b5360390c1207f7615757161c1eec036e00ea01f273a04efa99ba Jun 10 00:52:13.055573 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:13.055536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" event={"ID":"3d92c966-14fb-4204-bd2b-b2cedf8efb87","Type":"ContainerStarted","Data":"a746f1584693dde470e3c8448586f3f369f5774084093cf7d2dd239c09046fc5"} Jun 10 00:52:13.056699 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:13.056675 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" event={"ID":"b1ed217d-6b2d-40bc-82b1-122880b304db","Type":"ContainerStarted","Data":"9d6735ff6e3b5360390c1207f7615757161c1eec036e00ea01f273a04efa99ba"} Jun 10 00:52:16.102527 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.102485 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" event={"ID":"3d92c966-14fb-4204-bd2b-b2cedf8efb87","Type":"ContainerStarted","Data":"a5e934fe946f69e80e6a73a871580f1561526f7b3f151af44bd06e5c8ea17470"} Jun 10 00:52:16.102987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.102629 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:16.104225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.104200 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" event={"ID":"b1ed217d-6b2d-40bc-82b1-122880b304db","Type":"ContainerStarted","Data":"1ecb0217e0ca3e2b82f7a818dd267f0d45b03f9e56618b2bd89b10ca2d63c821"} Jun 10 00:52:16.104362 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.104302 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:16.117608 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.117565 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" podStartSLOduration=0.980011851 podStartE2EDuration="4.117551518s" totalImagesPullingTime="3.137539667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:52:16.116818846 +0000 UTC m=+1010.323790734" watchObservedRunningTime="2026-06-10 00:52:16.117551518 +0000 UTC m=+1010.324523400" Jun 10 00:52:16.132038 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:16.131991 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" podStartSLOduration=1.018491263 podStartE2EDuration="4.13197694s" totalImagesPullingTime="3.113485677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:52:16.130616675 +0000 UTC m=+1010.337588590" watchObservedRunningTime="2026-06-10 00:52:16.13197694 +0000 UTC m=+1010.338948828" Jun 10 00:52:20.130808 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.130770 2583 generic.go:356] "Generic (PLEG): container finished" podID="1c989d18-cd92-4e05-8e65-6f57f07beeed" containerID="6a849f2d276567926d909ba0382672a7409de990358e26138b8e474327469043" exitCode=0 Jun 10 00:52:20.131198 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.130848 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" event={"ID":"1c989d18-cd92-4e05-8e65-6f57f07beeed","Type":"ContainerDied","Data":"6a849f2d276567926d909ba0382672a7409de990358e26138b8e474327469043"} Jun 10 00:52:20.131269 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.131255 2583 scope.go:117] "RemoveContainer" containerID="6a849f2d276567926d909ba0382672a7409de990358e26138b8e474327469043" Jun 10 00:52:20.132246 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.132223 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:52:20.132313 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.132288 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:52:20.132350 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:20.132321 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 00:52:21.138341 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.138303 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" event={"ID":"1c989d18-cd92-4e05-8e65-6f57f07beeed","Type":"ContainerStarted","Data":"6c05ac1219284d912adcaa5af2e3dc1ffbc9e7ad7b6edc3b357cf36ed8b465d3"} Jun 10 00:52:21.686460 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.686418 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:21.686741 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.686663 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" containerID="cri-o://88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726" gracePeriod=30 Jun 10 00:52:21.914435 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.914377 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:52:21.914670 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.914647 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mnzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 10 00:52:21.914717 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:21.914697 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" podUID="1c989d18-cd92-4e05-8e65-6f57f07beeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 10 00:52:22.913872 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:22.913831 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mnzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 10 00:52:22.914265 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:22.913909 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" podUID="1c989d18-cd92-4e05-8e65-6f57f07beeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 10 00:52:23.355459 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.355434 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:23.389911 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.389804 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx6fh\" (UniqueName: \"kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh\") pod \"2459cab4-28b4-4a4b-8e82-6d2b87042062\" (UID: \"2459cab4-28b4-4a4b-8e82-6d2b87042062\") " Jun 10 00:52:23.393000 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.392960 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh" (OuterVolumeSpecName: "kube-api-access-hx6fh") pod "2459cab4-28b4-4a4b-8e82-6d2b87042062" (UID: "2459cab4-28b4-4a4b-8e82-6d2b87042062"). InnerVolumeSpecName "kube-api-access-hx6fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:52:23.491046 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.490946 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx6fh\" (UniqueName: \"kubernetes.io/projected/2459cab4-28b4-4a4b-8e82-6d2b87042062-kube-api-access-hx6fh\") on node \"ip-10-0-141-5.ec2.internal\" DevicePath \"\"" Jun 10 00:52:23.914224 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.914187 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-mnzd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jun 10 00:52:23.914612 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:23.914276 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" podUID="1c989d18-cd92-4e05-8e65-6f57f07beeed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jun 10 00:52:24.163208 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.163170 2583 generic.go:356] "Generic (PLEG): container finished" podID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerID="88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726" exitCode=143 Jun 10 00:52:24.163638 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.163607 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2459cab4-28b4-4a4b-8e82-6d2b87042062","Type":"ContainerDied","Data":"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726"} Jun 10 00:52:24.163819 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.163800 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2459cab4-28b4-4a4b-8e82-6d2b87042062","Type":"ContainerDied","Data":"b573667861e877921198f3c1fe4583e5c13df4eeca1187c9668854478c0a72f1"} Jun 10 00:52:24.164046 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.164027 2583 scope.go:117] "RemoveContainer" containerID="88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726" Jun 10 00:52:24.164366 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.164307 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.189575 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.188926 2583 scope.go:117] "RemoveContainer" containerID="88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726" Jun 10 00:52:24.190591 ip-10-0-141-5 kubenswrapper[2583]: E0610 00:52:24.190558 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726\": container with ID starting with 88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726 not found: ID does not exist" containerID="88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726" Jun 10 00:52:24.190697 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.190603 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726"} err="failed to get container status \"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726\": rpc error: code = NotFound desc = could not find container \"88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726\": container with ID starting with 88118b0508b85804dfff692917e92d3c56949d21ba22aeee3e0a835a5a0a4726 not found: ID does not exist" Jun 10 00:52:24.204288 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.204256 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:24.212361 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.212334 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:24.226733 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.226706 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:24.227126 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.227111 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" Jun 10 00:52:24.227126 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.227125 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" Jun 10 00:52:24.227259 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.227189 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" containerName="keycloak" Jun 10 00:52:24.232077 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.232061 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.234860 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.234840 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 00:52:24.234982 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.234840 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 00:52:24.234982 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.234892 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 00:52:24.234982 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.234953 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tkztk\"" Jun 10 00:52:24.235222 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.235206 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 00:52:24.241130 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.241099 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:24.299017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.298977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-test-realms\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.299017 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.299024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2dgd\" (UniqueName: \"kubernetes.io/projected/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-kube-api-access-l2dgd\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.400681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.400644 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-test-realms\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.400681 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.400687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2dgd\" (UniqueName: \"kubernetes.io/projected/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-kube-api-access-l2dgd\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.401371 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.401351 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-test-realms\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.408764 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.408732 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2dgd\" (UniqueName: \"kubernetes.io/projected/19d2f9d6-98b8-48c1-8f53-2c19f2e93123-kube-api-access-l2dgd\") pod \"maas-keycloak-0\" (UID: \"19d2f9d6-98b8-48c1-8f53-2c19f2e93123\") " pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.543212 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.543110 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:24.728085 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.728053 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 00:52:24.729508 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:52:24.729475 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d2f9d6_98b8_48c1_8f53_2c19f2e93123.slice/crio-c4b12eaa5499351e89f848c9cd4dbb4465eb57d06c9615c37ba6d6c8965ef2fe WatchSource:0}: Error finding container c4b12eaa5499351e89f848c9cd4dbb4465eb57d06c9615c37ba6d6c8965ef2fe: Status 404 returned error can't find the container with id c4b12eaa5499351e89f848c9cd4dbb4465eb57d06c9615c37ba6d6c8965ef2fe Jun 10 00:52:24.917258 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.917220 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:52:24.917668 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.917601 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:52:24.918370 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:24.918353 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-mnzd8" Jun 10 00:52:25.172085 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:25.172048 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"19d2f9d6-98b8-48c1-8f53-2c19f2e93123","Type":"ContainerStarted","Data":"c4b12eaa5499351e89f848c9cd4dbb4465eb57d06c9615c37ba6d6c8965ef2fe"} Jun 10 00:52:26.189093 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:26.189059 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"19d2f9d6-98b8-48c1-8f53-2c19f2e93123","Type":"ContainerStarted","Data":"fefcefff5cd6fbda78e349e15aec115bb995f8f462bbd555192f33d97295b2eb"} Jun 10 00:52:26.208817 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:26.208760 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.82332702 podStartE2EDuration="2.208740041s" totalImagesPullingTime="385.413021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:52:26.20728243 +0000 UTC m=+1020.414254310" watchObservedRunningTime="2026-06-10 00:52:26.208740041 +0000 UTC m=+1020.415711929" Jun 10 00:52:26.215045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:26.215015 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2459cab4-28b4-4a4b-8e82-6d2b87042062" path="/var/lib/kubelet/pods/2459cab4-28b4-4a4b-8e82-6d2b87042062/volumes" Jun 10 00:52:26.545192 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:26.543461 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:26.545383 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:26.545232 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:27.113149 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:27.113097 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" podUID="3d92c966-14fb-4204-bd2b-b2cedf8efb87" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.52:9004: connect: connection refused" Jun 10 00:52:27.113571 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:27.113545 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-pgqbj" Jun 10 00:52:27.544137 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:27.544030 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:28.544717 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:28.544670 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:29.543890 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:29.543843 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:30.544019 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:30.543955 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:31.544095 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:31.544036 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:32.544299 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:32.544251 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:33.543983 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:33.543940 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:34.543985 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:34.543947 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:34.544720 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:34.544249 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:35.544024 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:35.543980 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:36.544707 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:36.544654 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:37.111427 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:37.111375 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s6zht" Jun 10 00:52:37.543951 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:37.543839 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 10 00:52:38.665025 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:38.664989 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 00:52:38.679751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:38.679702 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:52:48.670115 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:48.670056 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="19d2f9d6-98b8-48c1-8f53-2c19f2e93123" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:52:58.672244 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:52:58.672207 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 00:53:39.199708 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.199627 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh"] Jun 10 00:53:39.203469 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.203449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.207534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.207514 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 00:53:39.207643 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.207536 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 00:53:39.207643 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.207554 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t8bd2\"" Jun 10 00:53:39.207643 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.207566 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 00:53:39.217680 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.217648 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh"] Jun 10 00:53:39.289314 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.289534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.289534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.289534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289423 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr74w\" (UniqueName: \"kubernetes.io/projected/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kube-api-access-vr74w\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.289534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289448 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.289534 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.289475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390771 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390741 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390812 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390847 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr74w\" (UniqueName: \"kubernetes.io/projected/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kube-api-access-vr74w\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.390952 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.390906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.391320 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.391292 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.391379 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.391306 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.391379 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.391359 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.393254 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.393234 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.393577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.393556 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.398476 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.398458 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr74w\" (UniqueName: \"kubernetes.io/projected/a800d01e-ed01-4aae-b5a2-c060b7fcb4d7-kube-api-access-vr74w\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh\" (UID: \"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.516965 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.516871 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:53:39.654322 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.654291 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh"] Jun 10 00:53:39.654896 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:53:39.654862 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda800d01e_ed01_4aae_b5a2_c060b7fcb4d7.slice/crio-2c3e9a5c88c0693d395010af99e6d6cc80e6a8447789009431a2a989bd1f0d49 WatchSource:0}: Error finding container 2c3e9a5c88c0693d395010af99e6d6cc80e6a8447789009431a2a989bd1f0d49: Status 404 returned error can't find the container with id 2c3e9a5c88c0693d395010af99e6d6cc80e6a8447789009431a2a989bd1f0d49 Jun 10 00:53:39.669465 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:39.669434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" event={"ID":"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7","Type":"ContainerStarted","Data":"2c3e9a5c88c0693d395010af99e6d6cc80e6a8447789009431a2a989bd1f0d49"} Jun 10 00:53:43.706225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:53:43.706191 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" event={"ID":"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7","Type":"ContainerStarted","Data":"656aa3817ffea305f8c1613031ed68d828b1a970fe8298cf8b260898b07c9b64"} Jun 10 00:54:05.271075 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.271038 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8"] Jun 10 00:54:05.274832 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.274811 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.277524 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.277502 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 00:54:05.284888 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.284864 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8"] Jun 10 00:54:05.331939 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.331906 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.332074 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.331947 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b11f74f5-0b64-44a1-8b06-353842320097-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.332074 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.331986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.332074 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.332019 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fgf\" (UniqueName: \"kubernetes.io/projected/b11f74f5-0b64-44a1-8b06-353842320097-kube-api-access-74fgf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.332181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.332075 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.332181 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.332120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432807 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b11f74f5-0b64-44a1-8b06-353842320097-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fgf\" (UniqueName: \"kubernetes.io/projected/b11f74f5-0b64-44a1-8b06-353842320097-kube-api-access-74fgf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432928 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.432987 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.432971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.433348 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.433246 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.433348 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.433313 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.433557 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.433540 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.435813 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.435778 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b11f74f5-0b64-44a1-8b06-353842320097-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.436334 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.436313 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b11f74f5-0b64-44a1-8b06-353842320097-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.440687 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.440658 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fgf\" (UniqueName: \"kubernetes.io/projected/b11f74f5-0b64-44a1-8b06-353842320097-kube-api-access-74fgf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8\" (UID: \"b11f74f5-0b64-44a1-8b06-353842320097\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.586796 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.586705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:54:05.729920 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.729892 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8"] Jun 10 00:54:05.730971 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:54:05.730929 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11f74f5_0b64_44a1_8b06_353842320097.slice/crio-8a3f75143b2a1109710eb9942db9795cf1b0003624d7a683a76180b0d218d826 WatchSource:0}: Error finding container 8a3f75143b2a1109710eb9942db9795cf1b0003624d7a683a76180b0d218d826: Status 404 returned error can't find the container with id 8a3f75143b2a1109710eb9942db9795cf1b0003624d7a683a76180b0d218d826 Jun 10 00:54:05.842577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.842482 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" event={"ID":"b11f74f5-0b64-44a1-8b06-353842320097","Type":"ContainerStarted","Data":"bf222617318f48edcff1a86cd829ed0264cf58801d498bcfff337fdff09e4aed"} Jun 10 00:54:05.842577 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:05.842539 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" event={"ID":"b11f74f5-0b64-44a1-8b06-353842320097","Type":"ContainerStarted","Data":"8a3f75143b2a1109710eb9942db9795cf1b0003624d7a683a76180b0d218d826"} Jun 10 00:54:15.490000 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.489965 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7"] Jun 10 00:54:15.497606 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.497585 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.502058 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.502034 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 00:54:15.504279 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.504251 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7"] Jun 10 00:54:15.631839 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.631803 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.631839 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.631843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cswz4\" (UniqueName: \"kubernetes.io/projected/36948484-3b86-4d59-89af-1d7b7017bcba-kube-api-access-cswz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.632045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.631948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.632045 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.632000 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.632139 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.632064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36948484-3b86-4d59-89af-1d7b7017bcba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.632139 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.632084 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.732802 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.732764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.732988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.732815 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36948484-3b86-4d59-89af-1d7b7017bcba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.732988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.732844 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.732988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.732922 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.732988 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.732948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cswz4\" (UniqueName: \"kubernetes.io/projected/36948484-3b86-4d59-89af-1d7b7017bcba-kube-api-access-cswz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.733225 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.733036 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.733287 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.733245 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.733374 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.733347 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.733458 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.733357 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.735620 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.735587 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36948484-3b86-4d59-89af-1d7b7017bcba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.735738 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.735721 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36948484-3b86-4d59-89af-1d7b7017bcba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.740962 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.740908 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cswz4\" (UniqueName: \"kubernetes.io/projected/36948484-3b86-4d59-89af-1d7b7017bcba-kube-api-access-cswz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7\" (UID: \"36948484-3b86-4d59-89af-1d7b7017bcba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.810163 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.810130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:15.969776 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:15.969744 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7"] Jun 10 00:54:15.971066 ip-10-0-141-5 kubenswrapper[2583]: W0610 00:54:15.971037 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36948484_3b86_4d59_89af_1d7b7017bcba.slice/crio-3c778393ba84cf030e09ba688610a621af7eae48b01c183a12f08f7714884714 WatchSource:0}: Error finding container 3c778393ba84cf030e09ba688610a621af7eae48b01c183a12f08f7714884714: Status 404 returned error can't find the container with id 3c778393ba84cf030e09ba688610a621af7eae48b01c183a12f08f7714884714 Jun 10 00:54:16.908327 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:16.908290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" event={"ID":"36948484-3b86-4d59-89af-1d7b7017bcba","Type":"ContainerStarted","Data":"221438953f06fbb54ce634165d50d6bcd1d43976ee907f4268ed39011f38e721"} Jun 10 00:54:16.908751 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:16.908352 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" event={"ID":"36948484-3b86-4d59-89af-1d7b7017bcba","Type":"ContainerStarted","Data":"3c778393ba84cf030e09ba688610a621af7eae48b01c183a12f08f7714884714"} Jun 10 00:54:17.915885 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:17.915781 2583 generic.go:356] "Generic (PLEG): container finished" podID="36948484-3b86-4d59-89af-1d7b7017bcba" containerID="221438953f06fbb54ce634165d50d6bcd1d43976ee907f4268ed39011f38e721" exitCode=0 Jun 10 00:54:17.915885 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:17.915849 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" event={"ID":"36948484-3b86-4d59-89af-1d7b7017bcba","Type":"ContainerDied","Data":"221438953f06fbb54ce634165d50d6bcd1d43976ee907f4268ed39011f38e721"} Jun 10 00:54:19.929566 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:19.929528 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" event={"ID":"36948484-3b86-4d59-89af-1d7b7017bcba","Type":"ContainerStarted","Data":"10c33bc8bd5953577cae7be62c23b3384cd011961b1e4aa92a712c4fb26400dd"} Jun 10 00:54:19.949500 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:19.949450 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" podStartSLOduration=2.39366851 podStartE2EDuration="4.949433876s" totalImagesPullingTime="1.036026991s" totalInitContainerRuntime="1.519738375s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:54:19.94643687 +0000 UTC m=+1134.153408758" watchObservedRunningTime="2026-06-10 00:54:19.949433876 +0000 UTC m=+1134.156405764" Jun 10 00:54:25.811235 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:25.811192 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:25.811755 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:25.811256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:25.824270 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:25.824238 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:25.976687 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:25.976654 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7" Jun 10 00:54:37.039341 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:37.039306 2583 generic.go:356] "Generic (PLEG): container finished" podID="a800d01e-ed01-4aae-b5a2-c060b7fcb4d7" containerID="656aa3817ffea305f8c1613031ed68d828b1a970fe8298cf8b260898b07c9b64" exitCode=0 Jun 10 00:54:37.039821 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:37.039381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" event={"ID":"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7","Type":"ContainerDied","Data":"656aa3817ffea305f8c1613031ed68d828b1a970fe8298cf8b260898b07c9b64"} Jun 10 00:54:38.048219 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:38.048186 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" event={"ID":"a800d01e-ed01-4aae-b5a2-c060b7fcb4d7","Type":"ContainerStarted","Data":"578b32720f9c3dbd72ead1abf6cd6546b8535738dd43f0aa0a90bee2b77b8f13"} Jun 10 00:54:38.069903 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:38.069850 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" podStartSLOduration=2.555947281 podStartE2EDuration="59.069823241s" totalImagesPullingTime="4.165552997s" totalInitContainerRuntime="52.348322963s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:53:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:54:38.067244907 +0000 UTC m=+1152.274216804" watchObservedRunningTime="2026-06-10 00:54:38.069823241 +0000 UTC m=+1152.276795129" Jun 10 00:54:39.517805 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:39.517769 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:54:39.518208 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:39.517854 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:54:39.530497 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:39.530462 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:54:40.071308 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:54:40.071278 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh" Jun 10 00:55:24.350892 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:24.350858 2583 generic.go:356] "Generic (PLEG): container finished" podID="b11f74f5-0b64-44a1-8b06-353842320097" containerID="bf222617318f48edcff1a86cd829ed0264cf58801d498bcfff337fdff09e4aed" exitCode=0 Jun 10 00:55:24.351307 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:24.350937 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" event={"ID":"b11f74f5-0b64-44a1-8b06-353842320097","Type":"ContainerDied","Data":"bf222617318f48edcff1a86cd829ed0264cf58801d498bcfff337fdff09e4aed"} Jun 10 00:55:25.358917 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:25.358874 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" event={"ID":"b11f74f5-0b64-44a1-8b06-353842320097","Type":"ContainerStarted","Data":"bb201e478037bd28b5f5252f1faf5e53578094397017f14c135afb79c7325ef2"} Jun 10 00:55:25.377325 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:25.377273 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" podStartSLOduration=2.2510331089999998 podStartE2EDuration="1m20.377257878s" totalImagesPullingTime="192.054464ms" totalInitContainerRuntime="1m17.934170305s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:55:25.375296976 +0000 UTC m=+1199.582268884" watchObservedRunningTime="2026-06-10 00:55:25.377257878 +0000 UTC m=+1199.584229766" Jun 10 00:55:25.587227 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:25.587187 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:55:25.587434 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:25.587248 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:55:25.599706 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:25.599680 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 00:55:26.263764 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:26.263737 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:55:26.270433 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:26.270406 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 00:55:26.272506 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:26.272483 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:55:26.278788 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:26.278771 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 00:55:26.375548 ip-10-0-141-5 kubenswrapper[2583]: I0610 00:55:26.375517 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8" Jun 10 01:00:26.310168 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:00:26.310139 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:00:26.318708 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:00:26.318686 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:00:26.319564 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:00:26.319538 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:00:26.327190 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:00:26.327173 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:05:26.355869 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:05:26.355839 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:05:26.364349 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:05:26.364325 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:05:26.365040 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:05:26.365019 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:05:26.373584 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:05:26.373567 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:10:26.398659 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:10:26.398628 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:10:26.407773 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:10:26.407750 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:10:26.409501 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:10:26.409480 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:10:26.417750 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:10:26.417724 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:15:26.448750 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:15:26.448639 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:15:26.455655 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:15:26.455635 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:15:26.456753 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:15:26.456735 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:15:26.463746 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:15:26.463725 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8ps7l_3d3a990c-5e07-4449-97ac-3e231d963168/ovn-acl-logging/0.log" Jun 10 01:19:17.911641 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:17.911586 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8449d75f-jd8v7_b4222632-68fe-4094-bf74-c78ad63d5968/nginx/0.log" Jun 10 01:19:19.092052 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:19.092025 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-fd2x2_adc250ca-6336-4099-abb7-0425f747dc6e/copy-manifests/0.log" Jun 10 01:19:19.099924 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:19.099898 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-fd2x2_adc250ca-6336-4099-abb7-0425f747dc6e/manager/0.log" Jun 10 01:19:20.239819 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.239783 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/util/0.log" Jun 10 01:19:20.246250 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.246204 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/pull/0.log" Jun 10 01:19:20.252152 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.252127 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/extract/0.log" Jun 10 01:19:20.360906 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.360875 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/util/0.log" Jun 10 01:19:20.366881 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.366849 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/pull/0.log" Jun 10 01:19:20.372290 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.372265 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/extract/0.log" Jun 10 01:19:20.481479 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.481438 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/util/0.log" Jun 10 01:19:20.487863 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.487836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/pull/0.log" Jun 10 01:19:20.493903 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.493832 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/extract/0.log" Jun 10 01:19:20.602699 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.602671 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/pull/0.log" Jun 10 01:19:20.609115 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.609061 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/extract/0.log" Jun 10 01:19:20.615026 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.615004 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/util/0.log" Jun 10 01:19:20.864560 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:20.864510 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9nv4t_6ad55ecf-9f62-4268-939d-b48567616c6c/manager/0.log" Jun 10 01:19:21.082092 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:21.082065 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4nndk_f91b039d-b3f5-45cc-b30d-a687b09f1235/kuadrant-console-plugin/0.log" Jun 10 01:19:21.202251 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:21.202145 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sk2ks_85900d7a-ab69-4cb5-9767-79a4d286989a/registry-server/0.log" Jun 10 01:19:21.558976 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:21.558860 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7xwlg_589d644f-8a96-49bd-8412-618cd391b0cd/manager/0.log" Jun 10 01:19:21.911100 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:21.911064 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bclcg4d_25a107ce-708f-491b-af39-0cd73e195a83/istio-proxy/0.log" Jun 10 01:19:22.399702 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:22.399671 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/1.log" Jun 10 01:19:22.520955 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:22.520921 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s6zht_3d92c966-14fb-4204-bd2b-b2cedf8efb87/payload-pre-processing/0.log" Jun 10 01:19:22.639299 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:22.639265 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pgqbj_b1ed217d-6b2d-40bc-82b1-122880b304db/payload-processing/0.log" Jun 10 01:19:23.092618 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.092584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh_a800d01e-ed01-4aae-b5a2-c060b7fcb4d7/storage-initializer/0.log" Jun 10 01:19:23.099950 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.099929 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-b7xwh_a800d01e-ed01-4aae-b5a2-c060b7fcb4d7/main/0.log" Jun 10 01:19:23.332605 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.332571 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8_b11f74f5-0b64-44a1-8b06-353842320097/storage-initializer/0.log" Jun 10 01:19:23.339174 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.339146 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pv9n8_b11f74f5-0b64-44a1-8b06-353842320097/main/0.log" Jun 10 01:19:23.455788 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.455753 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7_36948484-3b86-4d59-89af-1d7b7017bcba/storage-initializer/0.log" Jun 10 01:19:23.462587 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:23.462563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgkf7_36948484-3b86-4d59-89af-1d7b7017bcba/main/0.log" Jun 10 01:19:31.467829 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:31.467793 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8w9cf_76c7076b-a42c-407a-ae30-f057b438529e/global-pull-secret-syncer/0.log" Jun 10 01:19:31.606200 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:31.606164 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mt8fh_607ea609-dc38-43cc-ba39-cb301b759443/konnectivity-agent/0.log" Jun 10 01:19:31.716039 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:31.716006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-5.ec2.internal_d33387642d531998c39a007c9f865a02/haproxy/0.log" Jun 10 01:19:36.421814 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.421782 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/extract/0.log" Jun 10 01:19:36.441709 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.441678 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/util/0.log" Jun 10 01:19:36.461028 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.461001 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zrjp6_9a293386-176b-4554-99cc-d87b1a27ee81/pull/0.log" Jun 10 01:19:36.487779 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.487755 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/extract/0.log" Jun 10 01:19:36.509757 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.509730 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/util/0.log" Jun 10 01:19:36.528359 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.528327 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08lmhh_832c66ce-7f58-417a-a65c-cbb430d7d57e/pull/0.log" Jun 10 01:19:36.562379 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.562356 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/extract/0.log" Jun 10 01:19:36.583382 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.583353 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/util/0.log" Jun 10 01:19:36.606654 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.606628 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wc5f4_da8c1444-0cc2-4c74-8bf5-784a89cc2724/pull/0.log" Jun 10 01:19:36.639226 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.639197 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/extract/0.log" Jun 10 01:19:36.660184 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.660146 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/util/0.log" Jun 10 01:19:36.689025 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.688949 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w7g2h_8fc34be2-8f0f-4b3f-98bb-0dde125c2779/pull/0.log" Jun 10 01:19:36.969346 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:36.969249 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9nv4t_6ad55ecf-9f62-4268-939d-b48567616c6c/manager/0.log" Jun 10 01:19:37.023586 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:37.023561 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4nndk_f91b039d-b3f5-45cc-b30d-a687b09f1235/kuadrant-console-plugin/0.log" Jun 10 01:19:37.090731 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:37.090687 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sk2ks_85900d7a-ab69-4cb5-9767-79a4d286989a/registry-server/0.log" Jun 10 01:19:37.301717 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:37.301619 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7xwlg_589d644f-8a96-49bd-8412-618cd391b0cd/manager/0.log" Jun 10 01:19:38.999966 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:38.999934 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-s9lcw_38fb5233-8ea1-42ba-8520-5cf3409e3154/cluster-monitoring-operator/0.log" Jun 10 01:19:39.085461 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.085433 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b65cfdb59-65v9w_e72c903a-9895-4415-b53b-0bdc75ee43de/metrics-server/0.log" Jun 10 01:19:39.111799 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.111770 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-r4vrw_96b25d3a-e958-4db8-8c78-9c78f9f114e4/monitoring-plugin/0.log" Jun 10 01:19:39.147059 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.147032 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/node-exporter/0.log" Jun 10 01:19:39.166919 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.166893 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/kube-rbac-proxy/0.log" Jun 10 01:19:39.189914 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.189896 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mf75h_2300545e-0688-41ce-b769-3dcdde7ae326/init-textfile/0.log" Jun 10 01:19:39.390180 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.390149 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/kube-rbac-proxy-main/0.log" Jun 10 01:19:39.417101 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.417077 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/kube-rbac-proxy-self/0.log" Jun 10 01:19:39.440445 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.440420 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7spqc_139f447e-2076-4ec8-b7a2-f1e37fe2fd3a/openshift-state-metrics/0.log" Jun 10 01:19:39.883863 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.883834 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/thanos-query/0.log" Jun 10 01:19:39.905597 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.905562 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-web/0.log" Jun 10 01:19:39.927910 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.927873 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy/0.log" Jun 10 01:19:39.947582 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.947564 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/prom-label-proxy/0.log" Jun 10 01:19:39.968367 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.968341 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-rules/0.log" Jun 10 01:19:39.986366 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:39.986345 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7594775456-slsgg_b2d3d8b8-a502-4deb-a081-b316d6118233/kube-rbac-proxy-metrics/0.log" Jun 10 01:19:41.343949 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:41.343905 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-4qn9l_fb78a89d-c309-40fa-872c-30b9981227e4/networking-console-plugin/0.log" Jun 10 01:19:42.013519 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:42.013485 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/1.log" Jun 10 01:19:42.024537 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:42.024512 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4m2xp_606beaeb-d5ac-43cb-b599-02d4cc4f6e36/console-operator/2.log" Jun 10 01:19:42.588385 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:42.588354 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6dbfcff9-9v6vc_df3df779-de86-43a2-9608-f94e19a749a8/console/0.log" Jun 10 01:19:43.313351 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.313315 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-z5hsf_15e0a34c-60b2-4ccc-bda2-7a5109460f06/volume-data-source-validator/0.log" Jun 10 01:19:43.724464 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.724423 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws"] Jun 10 01:19:43.728046 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.728022 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.730438 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.730416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"openshift-service-ca.crt\"" Jun 10 01:19:43.730588 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.730568 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"kube-root-ca.crt\"" Jun 10 01:19:43.732013 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.731995 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f5p9k\"/\"default-dockercfg-98wnl\"" Jun 10 01:19:43.735788 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.735765 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws"] Jun 10 01:19:43.759902 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.759877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-lib-modules\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.760000 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.759912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-podres\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.760063 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.760015 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-sys\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.760063 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.760057 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-proc\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.760144 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.760115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc58x\" (UniqueName: \"kubernetes.io/projected/266b16e8-7d96-41a7-a6ee-f36af2fa6005-kube-api-access-hc58x\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860638 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-proc\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860763 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc58x\" (UniqueName: \"kubernetes.io/projected/266b16e8-7d96-41a7-a6ee-f36af2fa6005-kube-api-access-hc58x\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860763 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-lib-modules\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860763 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860724 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-podres\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860763 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860740 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-proc\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860903 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-sys\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860903 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860862 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-podres\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860970 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860907 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-sys\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.860970 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.860923 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/266b16e8-7d96-41a7-a6ee-f36af2fa6005-lib-modules\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:43.868565 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:43.868546 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc58x\" (UniqueName: \"kubernetes.io/projected/266b16e8-7d96-41a7-a6ee-f36af2fa6005-kube-api-access-hc58x\") pod \"perf-node-gather-daemonset-zjfws\" (UID: \"266b16e8-7d96-41a7-a6ee-f36af2fa6005\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:44.039285 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.039195 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:44.176502 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.176460 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws"] Jun 10 01:19:44.176963 ip-10-0-141-5 kubenswrapper[2583]: W0610 01:19:44.176927 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod266b16e8_7d96_41a7_a6ee_f36af2fa6005.slice/crio-885e553bd13331cbf6ac483efd59c871935385c43a8a63144ba4ff109cc8b14e WatchSource:0}: Error finding container 885e553bd13331cbf6ac483efd59c871935385c43a8a63144ba4ff109cc8b14e: Status 404 returned error can't find the container with id 885e553bd13331cbf6ac483efd59c871935385c43a8a63144ba4ff109cc8b14e Jun 10 01:19:44.215127 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.215098 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" event={"ID":"266b16e8-7d96-41a7-a6ee-f36af2fa6005","Type":"ContainerStarted","Data":"885e553bd13331cbf6ac483efd59c871935385c43a8a63144ba4ff109cc8b14e"} Jun 10 01:19:44.663954 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.663924 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4vww_6706430f-e440-41af-8a79-617fe0897a2f/dns/0.log" Jun 10 01:19:44.682540 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.682510 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4vww_6706430f-e440-41af-8a79-617fe0897a2f/kube-rbac-proxy/0.log" Jun 10 01:19:44.747245 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:44.747221 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h75v9_f94943c1-6986-406d-a1dc-cdb4fe06f609/dns-node-resolver/0.log" Jun 10 01:19:45.223100 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.223060 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" event={"ID":"266b16e8-7d96-41a7-a6ee-f36af2fa6005","Type":"ContainerStarted","Data":"01790c19d0fe97baa50199241298f0892b92aba093d50a1c552c03e06d6e0679"} Jun 10 01:19:45.223269 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.223151 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:45.238296 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.238252 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" podStartSLOduration=2.238237382 podStartE2EDuration="2.238237382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:45.237945905 +0000 UTC m=+2659.444917796" watchObservedRunningTime="2026-06-10 01:19:45.238237382 +0000 UTC m=+2659.445209271" Jun 10 01:19:45.266775 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.266749 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56d59977fc-jg544_e34da380-8e20-4d34-bb92-06d2d3c04260/registry/1.log" Jun 10 01:19:45.284868 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.284847 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56d59977fc-jg544_e34da380-8e20-4d34-bb92-06d2d3c04260/registry/2.log" Jun 10 01:19:45.305181 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:45.305156 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk27l_c6479644-4443-4a98-95f8-fea58335c6e4/node-ca/0.log" Jun 10 01:19:46.353778 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:46.353749 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bclcg4d_25a107ce-708f-491b-af39-0cd73e195a83/istio-proxy/0.log" Jun 10 01:19:46.537992 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:46.537953 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/0.log" Jun 10 01:19:46.601325 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:46.601291 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/1.log" Jun 10 01:19:46.660810 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:46.660736 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s6zht_3d92c966-14fb-4204-bd2b-b2cedf8efb87/payload-pre-processing/0.log" Jun 10 01:19:46.759253 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:46.759221 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pgqbj_b1ed217d-6b2d-40bc-82b1-122880b304db/payload-processing/0.log" Jun 10 01:19:47.430779 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:47.430746 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7k6ln_1fb03565-aff6-42fb-96f8-3c1efa0e87c3/serve-healthcheck-canary/0.log" Jun 10 01:19:48.004638 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:48.004607 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h8s5_de9155b5-a4b7-448d-af3c-5a335d94a70e/kube-rbac-proxy/0.log" Jun 10 01:19:48.024517 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:48.024490 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h8s5_de9155b5-a4b7-448d-af3c-5a335d94a70e/exporter/0.log" Jun 10 01:19:48.046582 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:48.046549 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h8s5_de9155b5-a4b7-448d-af3c-5a335d94a70e/extractor/0.log" Jun 10 01:19:50.364987 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:50.364952 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8449d75f-jd8v7_b4222632-68fe-4094-bf74-c78ad63d5968/nginx/0.log" Jun 10 01:19:50.928857 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:50.928826 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-fd2x2_adc250ca-6336-4099-abb7-0425f747dc6e/manager/0.log" Jun 10 01:19:50.952071 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:50.952048 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-fd2x2_adc250ca-6336-4099-abb7-0425f747dc6e/copy-manifests/0.log" Jun 10 01:19:51.242342 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:51.242265 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-zjfws" Jun 10 01:19:52.772570 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:52.772541 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cc5ccc596-dns45_eae9596d-0cf8-46ac-b1e9-cf3c7f283e25/manager/0.log" Jun 10 01:19:52.830777 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:52.830748 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f5msj_29862b33-7fd0-4989-8dbf-657aa5c48892/openshift-lws-operator/0.log" Jun 10 01:19:57.064062 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:57.064008 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bclcg4d_25a107ce-708f-491b-af39-0cd73e195a83/istio-proxy/0.log" Jun 10 01:19:57.218530 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:57.218497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/0.log" Jun 10 01:19:57.284660 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:57.284620 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/1.log" Jun 10 01:19:57.336071 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:57.335975 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s6zht_3d92c966-14fb-4204-bd2b-b2cedf8efb87/payload-pre-processing/0.log" Jun 10 01:19:57.426460 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:57.426427 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pgqbj_b1ed217d-6b2d-40bc-82b1-122880b304db/payload-processing/0.log" Jun 10 01:19:58.095317 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.095281 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-nh55r_a3c3371c-1a8e-41b8-beb3-252027fed045/migrator/0.log" Jun 10 01:19:58.113585 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.113564 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-nh55r_a3c3371c-1a8e-41b8-beb3-252027fed045/graceful-termination/0.log" Jun 10 01:19:58.511911 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.511815 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7jjnk_bf292f7a-a47f-4600-af2e-5b25423c30dd/kube-storage-version-migrator-operator/1.log" Jun 10 01:19:58.513371 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.513345 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7jjnk_bf292f7a-a47f-4600-af2e-5b25423c30dd/kube-storage-version-migrator-operator/0.log" Jun 10 01:19:58.612512 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.612477 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bclcg4d_25a107ce-708f-491b-af39-0cd73e195a83/istio-proxy/0.log" Jun 10 01:19:58.765540 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.765458 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/0.log" Jun 10 01:19:58.828694 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.828663 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/1.log" Jun 10 01:19:58.886810 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.886776 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s6zht_3d92c966-14fb-4204-bd2b-b2cedf8efb87/payload-pre-processing/0.log" Jun 10 01:19:58.981506 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:58.981471 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pgqbj_b1ed217d-6b2d-40bc-82b1-122880b304db/payload-processing/0.log" Jun 10 01:19:59.746555 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.746523 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/kube-multus-additional-cni-plugins/0.log" Jun 10 01:19:59.767764 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.767733 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/egress-router-binary-copy/0.log" Jun 10 01:19:59.787793 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.787767 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/cni-plugins/0.log" Jun 10 01:19:59.806231 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.806207 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/bond-cni-plugin/0.log" Jun 10 01:19:59.825983 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.825956 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/routeoverride-cni/0.log" Jun 10 01:19:59.847160 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.847129 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/whereabouts-cni-bincopy/0.log" Jun 10 01:19:59.866307 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:19:59.866279 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fs4k5_4e7560d9-7bd3-46ec-a064-823123b6e105/whereabouts-cni/0.log" Jun 10 01:20:00.188841 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.188810 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qsl68_3f6b6758-ed28-484a-99d9-5c35937a3647/kube-multus/0.log" Jun 10 01:20:00.251809 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.251775 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkrmd_149a7194-c82c-4d12-a165-c8dcb4bd8561/network-metrics-daemon/0.log" Jun 10 01:20:00.267739 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.267705 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mkrmd_149a7194-c82c-4d12-a165-c8dcb4bd8561/kube-rbac-proxy/0.log" Jun 10 01:20:00.577749 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.577664 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bclcg4d_25a107ce-708f-491b-af39-0cd73e195a83/istio-proxy/0.log" Jun 10 01:20:00.745150 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.745106 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/0.log" Jun 10 01:20:00.807718 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.807687 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-mnzd8_1c989d18-cd92-4e05-8e65-6f57f07beeed/istio-proxy/1.log" Jun 10 01:20:00.866564 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.866525 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s6zht_3d92c966-14fb-4204-bd2b-b2cedf8efb87/payload-pre-processing/0.log" Jun 10 01:20:00.960002 ip-10-0-141-5 kubenswrapper[2583]: I0610 01:20:00.959966 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pgqbj_b1ed217d-6b2d-40bc-82b1-122880b304db/payload-processing/0.log"