Jun 10 16:44:44.465096 ip-10-0-141-105 systemd[1]: Starting Kubernetes Kubelet... Jun 10 16:44:44.849271 ip-10-0-141-105 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:44.849271 ip-10-0-141-105 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 16:44:44.849271 ip-10-0-141-105 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:44.849271 ip-10-0-141-105 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 16:44:44.849271 ip-10-0-141-105 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:44.850880 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.850773 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 16:44:44.857477 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857463 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.857477 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857477 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857480 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857483 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857486 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857489 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857493 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857496 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857499 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857502 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857505 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857507 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857510 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857512 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857515 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857518 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857522 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857525 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857528 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857534 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857537 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.857539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857540 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857542 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857545 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857548 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857551 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857554 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857556 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857559 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857562 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857564 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857567 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857569 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857573 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857576 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857579 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857582 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857585 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857587 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857590 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.858012 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857592 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857594 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857597 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857599 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857602 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857605 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857608 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857611 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857613 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857616 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857618 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857621 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857623 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857644 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857648 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857652 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857655 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857658 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857661 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857663 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.858450 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857666 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857669 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857671 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857674 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857678 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857681 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857683 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857686 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857689 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857691 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857694 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857696 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857699 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857702 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857704 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857707 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857710 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857713 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857715 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857718 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.858933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857720 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857724 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857726 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857730 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857734 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857736 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857739 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857742 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857745 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857748 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857751 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857754 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857756 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857759 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857761 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857764 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857766 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857769 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.857771 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.859392 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858474 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858481 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858485 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858487 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858491 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858494 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858497 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858500 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858502 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858505 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858508 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858511 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858514 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858516 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858519 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858522 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858524 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858526 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858529 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858532 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.859876 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858534 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858537 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858540 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858542 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858545 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858547 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858550 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858552 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858556 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858560 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858562 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858565 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858568 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858570 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858573 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858576 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858578 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858580 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858583 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.860352 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858586 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858588 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858592 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858595 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858597 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858600 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858602 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858605 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858607 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858610 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858612 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858615 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858617 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858621 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858623 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858626 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858628 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858630 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858633 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858635 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.860835 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858638 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858640 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858643 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858645 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858648 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858651 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858653 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858655 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858658 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858663 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858665 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858668 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858671 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858673 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858676 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858678 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858681 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858683 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858686 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.861305 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858688 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858690 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858693 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858695 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858698 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858700 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858703 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858705 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858708 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858711 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858715 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858718 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858721 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858725 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858728 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858732 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858735 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858738 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858741 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.861775 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.858744 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859103 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859108 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859111 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859114 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859117 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859120 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859122 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859125 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859128 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859130 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859133 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859135 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859138 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859140 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859143 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859145 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859148 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859150 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859153 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.862238 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859156 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859158 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859161 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859164 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859166 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859169 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859172 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859174 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859178 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859181 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859183 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859186 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859190 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859193 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859196 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859199 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859202 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859204 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859207 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.862818 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859210 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859212 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859214 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859217 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859220 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859222 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859225 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859227 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859229 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859232 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859234 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859242 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859245 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859247 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859252 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859255 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859257 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859263 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859265 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.863276 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859268 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859270 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859274 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859277 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859279 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859282 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859284 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859287 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859289 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859291 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859294 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859297 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859299 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859303 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859305 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859308 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859310 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859312 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859314 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.863737 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859317 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859320 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859322 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859325 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859330 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859332 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859335 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859337 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859339 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859342 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859346 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859349 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859351 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859353 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859356 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859360 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859363 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859366 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859369 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859371 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.864253 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.859374 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859442 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859449 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859456 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859462 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859469 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859473 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859479 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859484 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859488 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859491 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859494 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859497 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859500 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859503 2559 flags.go:64] FLAG: --cgroup-root="" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859506 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859510 2559 flags.go:64] FLAG: --client-ca-file="" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859513 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859516 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859520 2559 flags.go:64] FLAG: --cluster-domain="" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859523 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859526 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859529 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859533 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 16:44:44.864728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859536 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859539 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859542 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859545 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859548 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859551 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859553 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859557 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859559 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859568 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859571 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859574 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859576 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859579 2559 flags.go:64] FLAG: --enable-server="true" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859583 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859587 2559 flags.go:64] FLAG: --event-burst="100" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859590 2559 flags.go:64] FLAG: --event-qps="50" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859593 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859596 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859599 2559 flags.go:64] FLAG: --eviction-hard="" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859602 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859605 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859608 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859611 2559 flags.go:64] FLAG: --eviction-soft="" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859616 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 16:44:44.865304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859619 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859622 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859624 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859627 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859630 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859633 2559 flags.go:64] FLAG: --feature-gates="" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859637 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859639 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859642 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859645 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859648 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859651 2559 flags.go:64] FLAG: --help="false" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859654 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-141-105.ec2.internal" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859657 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859660 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859663 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859666 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859669 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859672 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859674 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859677 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859680 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859683 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859686 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 16:44:44.865971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859689 2559 flags.go:64] FLAG: --kube-reserved="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859692 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859694 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859697 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859700 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859702 2559 flags.go:64] FLAG: --lock-file="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859705 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859709 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859712 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859717 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859719 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859722 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859725 2559 flags.go:64] FLAG: --logging-format="text" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859728 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859731 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859734 2559 flags.go:64] FLAG: --manifest-url="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859737 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859741 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859744 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859747 2559 flags.go:64] FLAG: --max-pods="110" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859750 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859753 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859756 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859759 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859762 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 16:44:44.866520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859764 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859767 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859773 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859777 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859779 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859783 2559 flags.go:64] FLAG: --pod-cidr="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859786 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859791 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859794 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859797 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859800 2559 flags.go:64] FLAG: --port="10250" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859803 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859817 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c584c1dcb28f1ae" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859820 2559 flags.go:64] FLAG: --qos-reserved="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859823 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859827 2559 flags.go:64] FLAG: --register-node="true" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859830 2559 flags.go:64] FLAG: --register-with-taints="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859834 2559 flags.go:64] FLAG: --registry-burst="10" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859837 2559 flags.go:64] FLAG: --registry-qps="5" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859839 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859842 2559 flags.go:64] FLAG: --reserved-memory="" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859846 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859848 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859851 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859854 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 16:44:44.867626 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859857 2559 flags.go:64] FLAG: --runonce="false" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859860 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859862 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859865 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859868 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859871 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859874 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859877 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859880 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859882 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859885 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859889 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859891 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859894 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859899 2559 flags.go:64] FLAG: --system-cgroups="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859901 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859906 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859909 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859912 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859915 2559 flags.go:64] FLAG: --tls-min-version="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859918 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859921 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859925 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859928 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859931 2559 flags.go:64] FLAG: --v="2" Jun 10 16:44:44.868244 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859934 2559 flags.go:64] FLAG: --version="false" Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859938 2559 flags.go:64] FLAG: --vmodule="" Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859942 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.859946 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860049 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860053 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860056 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860059 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860062 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860065 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860068 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860070 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860073 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860075 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860079 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860083 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860086 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860089 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860092 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.869109 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860094 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860097 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860100 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860103 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860105 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860108 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860111 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860113 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860115 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860118 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860122 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860125 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860128 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860131 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860133 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860137 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860139 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860142 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860144 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860147 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.869723 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860149 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860152 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860154 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860157 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860159 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860162 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860164 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860167 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860169 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860172 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860174 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860177 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860179 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860182 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860184 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860187 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860190 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860193 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860195 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860198 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.870226 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860200 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860202 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860206 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860209 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860211 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860214 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860216 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860220 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860223 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860225 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860229 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860232 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860235 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860238 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860240 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860243 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860245 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860248 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860251 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860253 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.870698 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860255 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860258 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860260 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860263 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860266 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860270 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860273 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860275 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860278 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860281 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860283 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860286 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860288 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860291 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860295 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860297 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860300 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860302 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860304 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.871194 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860308 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860311 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860313 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860316 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.860318 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.861063 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.866942 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.866956 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.866973 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.866979 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867032 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867036 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867039 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867042 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867045 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.871661 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867047 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867050 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867053 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867055 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867058 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867061 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867063 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867066 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867068 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867072 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867076 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867079 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867082 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867085 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867088 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867091 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867093 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867096 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867099 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867101 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.872070 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867103 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867106 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867109 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867111 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867115 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867118 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867120 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867123 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867125 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867128 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867130 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867133 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867136 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867138 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867140 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867143 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867145 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867148 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867150 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867152 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.872554 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867155 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867158 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867160 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867163 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867165 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867168 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867170 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867173 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867176 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867178 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867181 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867183 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867186 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867189 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867192 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867194 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867198 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867201 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867203 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867206 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.873047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867209 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867211 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867214 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867216 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867219 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867221 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867224 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867226 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867229 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867231 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867234 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867236 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867238 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867241 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867244 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867246 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867249 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867251 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867254 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.873520 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867257 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867260 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867262 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867266 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867269 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867272 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867275 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867278 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867281 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867283 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867286 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867289 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867292 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867295 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.874032 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867299 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.867304 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867409 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867414 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867417 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867420 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867423 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867425 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867428 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867430 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867433 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867435 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867438 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867440 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:44.874374 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867443 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867446 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867448 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867450 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867453 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867457 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867460 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867462 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867465 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867468 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867470 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867472 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867475 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867478 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867480 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867483 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867486 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867488 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867491 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:44.874730 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867493 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867495 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867498 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867500 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867503 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867505 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867507 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867510 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867512 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867515 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867517 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867520 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867522 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867525 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867527 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867530 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867532 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867534 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867537 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867539 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:44.875205 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867542 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867544 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867546 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867549 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867551 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867554 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867557 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867560 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867562 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867565 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867572 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867574 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867578 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867582 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867585 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867588 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867591 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867594 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867597 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867599 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:44.875785 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867602 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867604 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867607 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867609 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867612 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867614 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867617 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867619 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867622 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867626 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867629 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867632 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867635 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867638 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867640 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867643 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867646 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867648 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867651 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:44.876292 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867653 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867655 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867658 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867660 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867663 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867665 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867670 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867673 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:44.867675 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.867680 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.867768 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.870907 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.871962 2559 server.go:1019] "Starting client certificate rotation" Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.872056 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:44.876743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.872086 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:44.877102 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.874575 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:44.877102 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.875633 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:44.884839 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.884826 2559 log.go:25] "Validated CRI v1 runtime API" Jun 10 16:44:44.886891 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.886876 2559 log.go:25] "Validated CRI v1 image API" Jun 10 16:44:44.888233 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.888220 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 16:44:44.890443 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.890428 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cc03975e-f87e-4388-adac-5f028900d0bc:/dev/nvme0n1p4 d0b1fbda-04d4-4739-903a-3ab0b4dae91f:/dev/nvme0n1p3] Jun 10 16:44:44.890493 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.890443 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 16:44:44.895680 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.895571 2559 manager.go:216] Machine: {Timestamp:2026-06-10 16:44:44.894271483 +0000 UTC m=+0.313233012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199304 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe01577281d277113e7ea3f206754 SystemUUID:ec2fe015-7728-1d27-7113-e7ea3f206754 BootID:d7056045-f0fe-4089-8acb-94e98128532b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:64:e8:d2:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:64:e8:d2:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:81:5d:24:ac:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 16:44:44.895680 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.895676 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 16:44:44.895781 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.895744 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 16:44:44.899015 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.898994 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 16:44:44.899138 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.899020 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 16:44:44.899670 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.899661 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 16:44:44.899701 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.899672 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 16:44:44.899701 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.899680 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:44.900267 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.900257 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:44.900960 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.900951 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 16:44:44.902901 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.902888 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:44.903656 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903646 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:44.903756 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903748 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 16:44:44.903791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903774 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 10 16:44:44.903791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903783 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 16:44:44.903871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903795 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 16:44:44.903871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903817 2559 kubelet.go:398] "Adding apiserver pod source" Jun 10 16:44:44.903871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.903826 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 16:44:44.904128 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.904113 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:44.904128 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.904131 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:44.908592 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.908571 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 16:44:44.910001 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.909988 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 16:44:44.910057 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910017 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 16:44:44.910908 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910887 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910911 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910917 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910922 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910931 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910937 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910945 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 16:44:44.910951 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910950 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 16:44:44.911122 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910956 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 16:44:44.911122 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910962 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 16:44:44.911122 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910969 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 16:44:44.911122 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.910976 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 16:44:44.911857 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.911842 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 16:44:44.911892 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.911862 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 16:44:44.914013 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.913994 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 16:44:44.914075 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.914006 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 16:44:44.914075 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.914058 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 16:44:44.914981 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.914969 2559 server.go:1268] "Started kubelet" Jun 10 16:44:44.915061 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.915038 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 16:44:44.915109 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.915051 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 16:44:44.915151 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.915119 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 16:44:44.915722 ip-10-0-141-105 systemd[1]: Started Kubernetes Kubelet. Jun 10 16:44:44.916841 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.916800 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 16:44:44.917555 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.917538 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 10 16:44:44.921295 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.921274 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 16:44:44.921295 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.921283 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:44.921431 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.921395 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:44.922104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.921973 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 16:44:44.922104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.921975 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 16:44:44.922104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.922008 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 16:44:44.923161 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.923136 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 16:44:44.923391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.923368 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 10 16:44:44.923391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.923388 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 10 16:44:44.923702 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.923685 2559 factory.go:55] Registering systemd factory Jun 10 16:44:44.923778 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.923706 2559 factory.go:223] Registration of the systemd container factory successfully Jun 10 16:44:44.924188 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924168 2559 factory.go:153] Registering CRI-O factory Jun 10 16:44:44.924188 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924185 2559 factory.go:223] Registration of the crio container factory successfully Jun 10 16:44:44.924300 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924240 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 16:44:44.924300 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924262 2559 factory.go:103] Registering Raw factory Jun 10 16:44:44.924300 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924273 2559 manager.go:1196] Started watching for new ooms in manager Jun 10 16:44:44.924456 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.924302 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4jwm" Jun 10 16:44:44.925059 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.925043 2559 manager.go:349] Starting recovery of all containers Jun 10 16:44:44.925838 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.925796 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 16:44:44.925981 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.925945 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 16:44:44.926869 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.925779 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18b7c600ec4ac049 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-06-10 16:44:44.914942025 +0000 UTC m=+0.333903554,LastTimestamp:2026-06-10 16:44:44.914942025 +0000 UTC m=+0.333903554,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}" Jun 10 16:44:44.932517 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.932493 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p4jwm" Jun 10 16:44:44.935612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.935598 2559 manager.go:354] Recovery completed Jun 10 16:44:44.939620 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.939608 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:44.942677 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.942662 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:44.942733 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.942686 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:44.942733 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.942695 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:44.943225 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.943209 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 16:44:44.943225 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.943219 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:44.943307 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.943223 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 16:44:44.943335 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.943318 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:44.944018 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944003 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:44.944073 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944030 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:44.944073 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944043 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:44.944464 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944447 2559 policy_none.go:49] "None policy: Start" Jun 10 16:44:44.944464 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944465 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 16:44:44.944567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.944475 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 16:44:44.944840 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.944743 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18b7c600edf1ec4b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-06-10 16:44:44.942675019 +0000 UTC m=+0.361636548,LastTimestamp:2026-06-10 16:44:44.942675019 +0000 UTC m=+0.361636548,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}" Jun 10 16:44:44.945351 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.945337 2559 policy_none.go:47] "Start" Jun 10 16:44:44.983349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983335 2559 manager.go:337] "Starting Device Plugin manager" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.983370 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983379 2559 server.go:87] "Starting device plugin registration server" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983587 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983600 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983687 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983796 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.983822 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.984076 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.984278 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.984357 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.985408 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.985456 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.985478 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 16:44:44.985607 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:44.985551 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 16:44:44.987342 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:44.987327 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:45.084243 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.084226 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:45.085028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.085015 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:45.085085 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.085044 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:45.085085 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.085058 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:45.085085 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.085082 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.086093 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.086070 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"] Jun 10 16:44:45.086183 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.086125 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:45.087378 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.087364 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:45.087456 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.087393 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:45.087456 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.087409 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:45.088469 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.088454 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:45.088567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.088553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.088622 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.088580 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:45.089157 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089142 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:45.089157 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089154 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:45.089292 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089169 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:45.089292 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089185 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:45.089292 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089172 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:45.089292 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.089250 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:45.090497 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.090480 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.090562 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.090513 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:45.090644 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.090632 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.090687 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.090651 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-105.ec2.internal\": node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.091166 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.091152 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:45.091229 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.091178 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:45.091229 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.091191 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:45.102949 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.102912 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.117271 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.117248 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.121389 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.121375 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.124543 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.124523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.124599 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.124552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.124599 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.124567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/628f415a9f2c3046f7d08d14bd680499-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"628f415a9f2c3046f7d08d14bd680499\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.203190 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.203172 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.225210 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.225288 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.225288 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.225288 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/628f415a9f2c3046f7d08d14bd680499-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"628f415a9f2c3046f7d08d14bd680499\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.225288 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/628f415a9f2c3046f7d08d14bd680499-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"628f415a9f2c3046f7d08d14bd680499\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.225404 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.225294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1836c767f1e758e9ec44735afefdab4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"1836c767f1e758e9ec44735afefdab4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.304209 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.304182 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.404788 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.404743 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.420928 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.420903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.425251 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.425236 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:45.505549 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.505527 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.606077 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.606055 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.706542 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.706496 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.807176 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.807067 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.848182 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.848163 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:45.872045 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.872025 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 16:44:45.872688 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.872152 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 16:44:45.872688 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.872176 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 16:44:45.892720 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:45.892692 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1836c767f1e758e9ec44735afefdab4b.slice/crio-4711c283dee0010c577b6616ec6b050b26ed697cadd2b3644fa25e71a76a1d93 WatchSource:0}: Error finding container 4711c283dee0010c577b6616ec6b050b26ed697cadd2b3644fa25e71a76a1d93: Status 404 returned error can't find the container with id 4711c283dee0010c577b6616ec6b050b26ed697cadd2b3644fa25e71a76a1d93 Jun 10 16:44:45.893424 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:45.893405 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628f415a9f2c3046f7d08d14bd680499.slice/crio-0aa800d5bc19f17f367bab1ccb229e86d605324e156e8c481d04f1f6a3fb707e WatchSource:0}: Error finding container 0aa800d5bc19f17f367bab1ccb229e86d605324e156e8c481d04f1f6a3fb707e: Status 404 returned error can't find the container with id 0aa800d5bc19f17f367bab1ccb229e86d605324e156e8c481d04f1f6a3fb707e Jun 10 16:44:45.897212 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.897197 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:44:45.908168 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:45.908149 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:45.935277 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.935235 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 16:39:44 +0000 UTC" deadline="2028-02-16 05:57:06.236291354 +0000 UTC" Jun 10 16:44:45.935277 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.935273 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14773h12m20.301021518s" Jun 10 16:44:45.956518 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.956494 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:45.990215 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.990090 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"1836c767f1e758e9ec44735afefdab4b","Type":"ContainerStarted","Data":"4711c283dee0010c577b6616ec6b050b26ed697cadd2b3644fa25e71a76a1d93"} Jun 10 16:44:45.991044 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:45.991025 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"628f415a9f2c3046f7d08d14bd680499","Type":"ContainerStarted","Data":"0aa800d5bc19f17f367bab1ccb229e86d605324e156e8c481d04f1f6a3fb707e"} Jun 10 16:44:46.008213 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:46.008189 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jun 10 16:44:46.027617 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.027597 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:46.121824 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.121780 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jun 10 16:44:46.134233 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.134212 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:46.135086 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.135073 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jun 10 16:44:46.141909 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.141892 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:46.696726 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.696698 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:46.905649 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.905578 2559 apiserver.go:52] "Watching apiserver" Jun 10 16:44:46.911978 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.911957 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 16:44:46.912413 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.912385 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-s4fqs","kube-system/konnectivity-agent-4hpmv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr","openshift-cluster-node-tuning-operator/tuned-js5lk","openshift-image-registry/node-ca-b7htg","openshift-multus/multus-additional-cni-plugins-68z29","openshift-multus/network-metrics-daemon-gmcfv","openshift-ovn-kubernetes/ovnkube-node-frfnp","kube-system/global-pull-secret-syncer-tg948","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal","openshift-dns/node-resolver-ksg46","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","openshift-multus/multus-f9k8w","openshift-network-diagnostics/network-check-target-wt2lf"] Jun 10 16:44:46.913944 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.913886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:46.914052 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:46.913973 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:46.915076 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.915054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.916509 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.916488 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.917283 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917253 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 16:44:46.917389 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917283 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zt86\"" Jun 10 16:44:46.917389 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917290 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 16:44:46.917389 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917305 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.917389 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917349 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.917744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.917729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.918468 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.918374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 16:44:46.918468 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.918443 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n2ntb\"" Jun 10 16:44:46.918603 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.918488 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.918971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.918957 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:46.919056 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.919028 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.919518 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.919501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4fjd7\"" Jun 10 16:44:46.919820 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.919792 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.920012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.919997 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.920390 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.920371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.920891 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.920832 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.921036 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.921016 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-762t9\"" Jun 10 16:44:46.921123 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.921074 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 16:44:46.921123 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.921113 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.921765 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.921746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:46.921946 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:46.921828 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:46.921946 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.921925 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:46.922447 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.922425 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 16:44:46.922552 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.922453 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 16:44:46.922552 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.922527 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bvjv2\"" Jun 10 16:44:46.923528 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.923478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:46.924553 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.924522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:46.925364 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.925330 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.925465 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.925445 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.925750 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.925590 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 16:44:46.925750 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.925663 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kzbsn\"" Jun 10 16:44:46.925903 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.925840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:46.925960 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:46.925900 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:46.926846 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.926824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 16:44:46.926846 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.926839 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 16:44:46.927830 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.927602 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9tsm\"" Jun 10 16:44:46.927830 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.927682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:46.930439 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.930418 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.930617 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.930598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:46.930685 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.930652 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ktsxs\"" Jun 10 16:44:46.930785 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.930762 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.932551 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.932528 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 16:44:46.932758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.932740 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 16:44:46.932758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.932751 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 16:44:46.932904 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.932843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 16:44:46.932904 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.932874 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q566h\"" Jun 10 16:44:46.933121 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 16:44:46.933314 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-kubelet\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.933411 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfm7n\" (UniqueName: \"kubernetes.io/projected/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-kube-api-access-lfm7n\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.933411 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fd25bb5-4e25-4580-a811-3663d62756df-iptables-alerter-script\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:46.933411 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-conf\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.933603 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-sys\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.933663 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 16:44:46.933716 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-lib-modules\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.933758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933718 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:46.933758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-netns\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.933871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd25bb5-4e25-4580-a811-3663d62756df-host-slash\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:46.933871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-etc-tuned\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.933871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.933871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-sys-fs\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cd0a680-3a66-442b-8d8b-3980a1a11c19-host\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-bin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-multus-certs\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-kubelet-config\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-dbus\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:46.933988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.933967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-hostroot\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-modprobe-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-binary-copy\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.934223 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-multus\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-os-release\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-etc-kubernetes\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-conf-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-host\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf5gr\" (UniqueName: \"kubernetes.io/projected/8df449cd-4e23-4786-8d05-b1685fef960c-kube-api-access-tf5gr\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-system-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-os-release\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-registration-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-device-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-kubernetes\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-cnibin\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.934550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-daemon-config\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbq4t\" (UniqueName: \"kubernetes.io/projected/7cd0a680-3a66-442b-8d8b-3980a1a11c19-kube-api-access-wbq4t\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cni-binary-copy\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkd5x\" (UniqueName: \"kubernetes.io/projected/b081f2c5-6532-4993-8d4c-5c489eaad0de-kube-api-access-rkd5x\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysconfig\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-systemd\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-tmp\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-socket-dir-parent\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-socket-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-var-lib-kubelet\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-system-cni-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bnkb\" (UniqueName: \"kubernetes.io/projected/ecdfe914-0186-429c-a2ef-d681c40d1f57-kube-api-access-9bnkb\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2f4s\" (UniqueName: \"kubernetes.io/projected/3fd25bb5-4e25-4580-a811-3663d62756df-kube-api-access-w2f4s\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbg5z\" (UniqueName: \"kubernetes.io/projected/e5e24daa-95c3-4683-9f56-ca23645dd144-kube-api-access-nbg5z\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:46.935090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-run\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:46.935717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cd0a680-3a66-442b-8d8b-3980a1a11c19-serviceca\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:46.935717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cnibin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.935717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.934972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-k8s-cni-cncf-io\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:46.962651 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.962632 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ww9tp" Jun 10 16:44:46.968072 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:46.968052 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ww9tp" Jun 10 16:44:47.023316 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.023301 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 16:44:47.035405 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-device-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.035491 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-kubernetes\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.035491 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-cnibin\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.035491 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b2fa-118f-4781-b732-560f49f1ab62-hosts-file\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-bin\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-kubernetes\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-etc-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035516 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-cnibin\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-device-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035584 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-config\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-script-lib\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-daemon-config\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq4t\" (UniqueName: \"kubernetes.io/projected/7cd0a680-3a66-442b-8d8b-3980a1a11c19-kube-api-access-wbq4t\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-var-lib-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-node-log\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovn-node-metrics-cert\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.035995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.035962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cni-binary-copy\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkd5x\" (UniqueName: \"kubernetes.io/projected/b081f2c5-6532-4993-8d4c-5c489eaad0de-kube-api-access-rkd5x\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysconfig\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-systemd\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-tmp\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-socket-dir-parent\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-socket-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-var-lib-kubelet\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-daemon-config\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-system-cni-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bnkb\" (UniqueName: \"kubernetes.io/projected/ecdfe914-0186-429c-a2ef-d681c40d1f57-kube-api-access-9bnkb\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysconfig\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2f4s\" (UniqueName: \"kubernetes.io/projected/3fd25bb5-4e25-4580-a811-3663d62756df-kube-api-access-w2f4s\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036351 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-var-lib-kubelet\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-systemd\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036405 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cni-binary-copy\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbg5z\" (UniqueName: \"kubernetes.io/projected/e5e24daa-95c3-4683-9f56-ca23645dd144-kube-api-access-nbg5z\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-system-cni-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-run\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cd0a680-3a66-442b-8d8b-3980a1a11c19-serviceca\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cnibin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-k8s-cni-cncf-io\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.036542 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:47.036642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-run\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-k8s-cni-cncf-io\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-socket-dir-parent\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-kubelet\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.036675 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:44:47.536651296 +0000 UTC m=+2.955612874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfm7n\" (UniqueName: \"kubernetes.io/projected/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-kube-api-access-lfm7n\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fd25bb5-4e25-4580-a811-3663d62756df-iptables-alerter-script\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-conf\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-sys\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-lib-modules\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-netns\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd25bb5-4e25-4580-a811-3663d62756df-host-slash\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037010 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-socket-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-lib-modules\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-etc-tuned\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.037454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f86ded2c-daa8-41d1-b7ef-d853114e66f4-konnectivity-ca\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-slash\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-sys-fs\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cd0a680-3a66-442b-8d8b-3980a1a11c19-host\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.036888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-kubelet\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-systemd-units\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-bin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-sys\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-multus-certs\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-kubelet-config\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-dbus\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-cnibin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-conf\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037525 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037535 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7cd0a680-3a66-442b-8d8b-3980a1a11c19-serviceca\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.038255 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-sys-fs\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-netns\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.037599 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fd25bb5-4e25-4580-a811-3663d62756df-host-slash\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cd0a680-3a66-442b-8d8b-3980a1a11c19-host\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-dbus\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb0f6760-63fb-41b8-81d5-854853a9b4ba-kubelet-config\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-kubelet\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.037654 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:44:47.537637168 +0000 UTC m=+2.956598698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-run-multus-certs\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-systemd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-env-overrides\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-sysctl-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.039082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-hostroot\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-hostroot\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037837 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-modprobe-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037873 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fd25bb5-4e25-4580-a811-3663d62756df-iptables-alerter-script\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-bin\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-binary-copy\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.037978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-etc-modprobe-d\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-netns\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-ovn\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-multus\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-os-release\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-log-socket\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecdfe914-0186-429c-a2ef-d681c40d1f57-os-release\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.039735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbkb\" (UniqueName: \"kubernetes.io/projected/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-kube-api-access-6kbkb\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-host-var-lib-cni-multus\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-etc-kubernetes\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxjj\" (UniqueName: \"kubernetes.io/projected/7331b2fa-118f-4781-b732-560f49f1ab62-kube-api-access-5zxjj\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-netd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-binary-copy\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-etc-kubernetes\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-conf-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-host\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-multus-conf-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf5gr\" (UniqueName: \"kubernetes.io/projected/8df449cd-4e23-4786-8d05-b1685fef960c-kube-api-access-tf5gr\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8df449cd-4e23-4786-8d05-b1685fef960c-host\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f86ded2c-daa8-41d1-b7ef-d853114e66f4-agent-certs\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b2fa-118f-4781-b732-560f49f1ab62-tmp-dir\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-system-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.040475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-os-release\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.041194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-registration-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.041194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-os-release\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.041194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e5e24daa-95c3-4683-9f56-ca23645dd144-registration-dir\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.041194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.038933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-system-cni-dir\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.041194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.039006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecdfe914-0186-429c-a2ef-d681c40d1f57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.043505 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.043302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-etc-tuned\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.043728 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.043591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8df449cd-4e23-4786-8d05-b1685fef960c-tmp\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.045984 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.045931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbg5z\" (UniqueName: \"kubernetes.io/projected/e5e24daa-95c3-4683-9f56-ca23645dd144-kube-api-access-nbg5z\") pod \"aws-ebs-csi-driver-node-wzkgr\" (UID: \"e5e24daa-95c3-4683-9f56-ca23645dd144\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.046253 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.046227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbq4t\" (UniqueName: \"kubernetes.io/projected/7cd0a680-3a66-442b-8d8b-3980a1a11c19-kube-api-access-wbq4t\") pod \"node-ca-b7htg\" (UID: \"7cd0a680-3a66-442b-8d8b-3980a1a11c19\") " pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.047537 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.047437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfm7n\" (UniqueName: \"kubernetes.io/projected/7ff1ab10-1518-40b3-a4c7-af352b0cadbc-kube-api-access-lfm7n\") pod \"multus-f9k8w\" (UID: \"7ff1ab10-1518-40b3-a4c7-af352b0cadbc\") " pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.047732 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.047715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkd5x\" (UniqueName: \"kubernetes.io/projected/b081f2c5-6532-4993-8d4c-5c489eaad0de-kube-api-access-rkd5x\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:47.047966 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.047943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2f4s\" (UniqueName: \"kubernetes.io/projected/3fd25bb5-4e25-4580-a811-3663d62756df-kube-api-access-w2f4s\") pod \"iptables-alerter-s4fqs\" (UID: \"3fd25bb5-4e25-4580-a811-3663d62756df\") " pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.048332 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.048312 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bnkb\" (UniqueName: \"kubernetes.io/projected/ecdfe914-0186-429c-a2ef-d681c40d1f57-kube-api-access-9bnkb\") pod \"multus-additional-cni-plugins-68z29\" (UID: \"ecdfe914-0186-429c-a2ef-d681c40d1f57\") " pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.049118 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.049101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf5gr\" (UniqueName: \"kubernetes.io/projected/8df449cd-4e23-4786-8d05-b1685fef960c-kube-api-access-tf5gr\") pod \"tuned-js5lk\" (UID: \"8df449cd-4e23-4786-8d05-b1685fef960c\") " pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.139250 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f86ded2c-daa8-41d1-b7ef-d853114e66f4-agent-certs\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.139367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b2fa-118f-4781-b732-560f49f1ab62-tmp-dir\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.139367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b2fa-118f-4781-b732-560f49f1ab62-hosts-file\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.139367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-bin\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7331b2fa-118f-4781-b732-560f49f1ab62-hosts-file\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.139564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-bin\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-etc-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-config\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-etc-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-script-lib\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-var-lib-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-node-log\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovn-node-metrics-cert\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-var-lib-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7331b2fa-118f-4781-b732-560f49f1ab62-tmp-dir\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f86ded2c-daa8-41d1-b7ef-d853114e66f4-konnectivity-ca\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-node-log\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-slash\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.139793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-systemd-units\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-kubelet\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-systemd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-env-overrides\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-netns\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.139980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-ovn\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-config\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-log-socket\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-log-socket\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-slash\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbkb\" (UniqueName: \"kubernetes.io/projected/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-kube-api-access-6kbkb\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxjj\" (UniqueName: \"kubernetes.io/projected/7331b2fa-118f-4781-b732-560f49f1ab62-kube-api-access-5zxjj\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-systemd-units\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-netd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.140271 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-kubelet\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-systemd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140205 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-cni-netd\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f86ded2c-daa8-41d1-b7ef-d853114e66f4-konnectivity-ca\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-ovn-kubernetes\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-host-run-netns\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-env-overrides\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-openvswitch\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-run-ovn\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.140640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovnkube-script-lib\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.141963 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.141940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f86ded2c-daa8-41d1-b7ef-d853114e66f4-agent-certs\") pod \"konnectivity-agent-4hpmv\" (UID: \"f86ded2c-daa8-41d1-b7ef-d853114e66f4\") " pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.142695 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.142675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-ovn-node-metrics-cert\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.146667 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.146643 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:47.146667 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.146668 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:47.146846 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.146682 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:47.146846 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.146744 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:47.646732297 +0000 UTC m=+3.065693826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:47.148858 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.148839 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxjj\" (UniqueName: \"kubernetes.io/projected/7331b2fa-118f-4781-b732-560f49f1ab62-kube-api-access-5zxjj\") pod \"node-resolver-ksg46\" (UID: \"7331b2fa-118f-4781-b732-560f49f1ab62\") " pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.148937 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.148885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbkb\" (UniqueName: \"kubernetes.io/projected/ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1-kube-api-access-6kbkb\") pod \"ovnkube-node-frfnp\" (UID: \"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1\") " pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.227096 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.227041 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9k8w" Jun 10 16:44:47.234862 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.234844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" Jun 10 16:44:47.243441 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.243419 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-js5lk" Jun 10 16:44:47.247876 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.247842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b7htg" Jun 10 16:44:47.254303 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.254286 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-68z29" Jun 10 16:44:47.260684 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.260665 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s4fqs" Jun 10 16:44:47.267009 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.266993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:44:47.273530 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.273512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ksg46" Jun 10 16:44:47.278853 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.278838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:44:47.543055 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.542986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:47.543055 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.543040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:47.543244 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.543148 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:47.543244 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.543158 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:47.543244 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.543217 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:44:48.543197534 +0000 UTC m=+3.962159056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:47.543244 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.543237 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:44:48.543227411 +0000 UTC m=+3.962188930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:47.591603 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.591416 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdfe914_0186_429c_a2ef_d681c40d1f57.slice/crio-fb0ff7db7611d2bee9d4a8f6a1ee93492ab9e4467ca456f466865b87c17ecb32 WatchSource:0}: Error finding container fb0ff7db7611d2bee9d4a8f6a1ee93492ab9e4467ca456f466865b87c17ecb32: Status 404 returned error can't find the container with id fb0ff7db7611d2bee9d4a8f6a1ee93492ab9e4467ca456f466865b87c17ecb32 Jun 10 16:44:47.596190 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.596170 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff1ab10_1518_40b3_a4c7_af352b0cadbc.slice/crio-52bbec0646c53be9fb0f2b914905a5bf32d167f351b4044404e85b6ef400798f WatchSource:0}: Error finding container 52bbec0646c53be9fb0f2b914905a5bf32d167f351b4044404e85b6ef400798f: Status 404 returned error can't find the container with id 52bbec0646c53be9fb0f2b914905a5bf32d167f351b4044404e85b6ef400798f Jun 10 16:44:47.596572 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.596554 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd0a680_3a66_442b_8d8b_3980a1a11c19.slice/crio-696c4fae8b48a7c5f7a41c10e590042aa026201e58818343061ae4c2bf9339cb WatchSource:0}: Error finding container 696c4fae8b48a7c5f7a41c10e590042aa026201e58818343061ae4c2bf9339cb: Status 404 returned error can't find the container with id 696c4fae8b48a7c5f7a41c10e590042aa026201e58818343061ae4c2bf9339cb Jun 10 16:44:47.598664 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.598644 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e24daa_95c3_4683_9f56_ca23645dd144.slice/crio-1ad02ef1456e65c7ad5806b3869f9771df29b3c25c76e3e93fa8048235e25bea WatchSource:0}: Error finding container 1ad02ef1456e65c7ad5806b3869f9771df29b3c25c76e3e93fa8048235e25bea: Status 404 returned error can't find the container with id 1ad02ef1456e65c7ad5806b3869f9771df29b3c25c76e3e93fa8048235e25bea Jun 10 16:44:47.599336 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.599211 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7fd6d5_277e_4ba8_8661_7e4806fa4ba1.slice/crio-83bd4c30cf519f375a48ab93111ad9305bd80496592cda5f7875a388b7fc1079 WatchSource:0}: Error finding container 83bd4c30cf519f375a48ab93111ad9305bd80496592cda5f7875a388b7fc1079: Status 404 returned error can't find the container with id 83bd4c30cf519f375a48ab93111ad9305bd80496592cda5f7875a388b7fc1079 Jun 10 16:44:47.600335 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.600164 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df449cd_4e23_4786_8d05_b1685fef960c.slice/crio-af7003821e4605c50435a12ba318f0b37152188498dae42f927782b50e109b91 WatchSource:0}: Error finding container af7003821e4605c50435a12ba318f0b37152188498dae42f927782b50e109b91: Status 404 returned error can't find the container with id af7003821e4605c50435a12ba318f0b37152188498dae42f927782b50e109b91 Jun 10 16:44:47.601148 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.601040 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd25bb5_4e25_4580_a811_3663d62756df.slice/crio-80c049dff670a01bfe8e1923dbb52e7c47abafe8d378a00a91a0e410a1085abc WatchSource:0}: Error finding container 80c049dff670a01bfe8e1923dbb52e7c47abafe8d378a00a91a0e410a1085abc: Status 404 returned error can't find the container with id 80c049dff670a01bfe8e1923dbb52e7c47abafe8d378a00a91a0e410a1085abc Jun 10 16:44:47.601711 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.601669 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7331b2fa_118f_4781_b732_560f49f1ab62.slice/crio-a15890be88888510d743bc6a3a12396de2031494e013d6f8d7f9e70e1ea890dd WatchSource:0}: Error finding container a15890be88888510d743bc6a3a12396de2031494e013d6f8d7f9e70e1ea890dd: Status 404 returned error can't find the container with id a15890be88888510d743bc6a3a12396de2031494e013d6f8d7f9e70e1ea890dd Jun 10 16:44:47.603200 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:44:47.603171 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86ded2c_daa8_41d1_b7ef_d853114e66f4.slice/crio-89e23edf996b2525f81e757b7604e11e1b21d65d30117bd7cd0fa09d590b481c WatchSource:0}: Error finding container 89e23edf996b2525f81e757b7604e11e1b21d65d30117bd7cd0fa09d590b481c: Status 404 returned error can't find the container with id 89e23edf996b2525f81e757b7604e11e1b21d65d30117bd7cd0fa09d590b481c Jun 10 16:44:47.744924 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.744900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:47.745050 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.745036 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:47.745094 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.745055 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:47.745094 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.745063 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:47.745188 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:47.745103 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:48.745090401 +0000 UTC m=+4.164051917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:47.970211 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.970081 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:46 +0000 UTC" deadline="2027-11-18 15:00:33.352893496 +0000 UTC" Jun 10 16:44:47.970211 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.970155 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12622h15m45.382744622s" Jun 10 16:44:47.999476 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:47.999255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s4fqs" event={"ID":"3fd25bb5-4e25-4580-a811-3663d62756df","Type":"ContainerStarted","Data":"80c049dff670a01bfe8e1923dbb52e7c47abafe8d378a00a91a0e410a1085abc"} Jun 10 16:44:48.002700 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.002674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"83bd4c30cf519f375a48ab93111ad9305bd80496592cda5f7875a388b7fc1079"} Jun 10 16:44:48.004652 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.004591 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9k8w" event={"ID":"7ff1ab10-1518-40b3-a4c7-af352b0cadbc","Type":"ContainerStarted","Data":"52bbec0646c53be9fb0f2b914905a5bf32d167f351b4044404e85b6ef400798f"} Jun 10 16:44:48.005960 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.005892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerStarted","Data":"fb0ff7db7611d2bee9d4a8f6a1ee93492ab9e4467ca456f466865b87c17ecb32"} Jun 10 16:44:48.011134 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.010534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"628f415a9f2c3046f7d08d14bd680499","Type":"ContainerStarted","Data":"6891fdd01ee4ed0bb1767478d4acaa59e011edd44405d8b16720ace760c59256"} Jun 10 16:44:48.025671 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.025648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"1836c767f1e758e9ec44735afefdab4b","Type":"ContainerDied","Data":"fa3bab3d8821077be08f91028a1b63d43cd13a7d73d64a91c1747c85a8878567"} Jun 10 16:44:48.025819 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.025630 2559 generic.go:356] "Generic (PLEG): container finished" podID="1836c767f1e758e9ec44735afefdab4b" containerID="fa3bab3d8821077be08f91028a1b63d43cd13a7d73d64a91c1747c85a8878567" exitCode=0 Jun 10 16:44:48.027131 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.026729 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" podStartSLOduration=2.026711978 podStartE2EDuration="2.026711978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:48.026229385 +0000 UTC m=+3.445190924" watchObservedRunningTime="2026-06-10 16:44:48.026711978 +0000 UTC m=+3.445673517" Jun 10 16:44:48.048038 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.044262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hpmv" event={"ID":"f86ded2c-daa8-41d1-b7ef-d853114e66f4","Type":"ContainerStarted","Data":"89e23edf996b2525f81e757b7604e11e1b21d65d30117bd7cd0fa09d590b481c"} Jun 10 16:44:48.048038 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.047376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ksg46" event={"ID":"7331b2fa-118f-4781-b732-560f49f1ab62","Type":"ContainerStarted","Data":"a15890be88888510d743bc6a3a12396de2031494e013d6f8d7f9e70e1ea890dd"} Jun 10 16:44:48.061939 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.061542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-js5lk" event={"ID":"8df449cd-4e23-4786-8d05-b1685fef960c","Type":"ContainerStarted","Data":"af7003821e4605c50435a12ba318f0b37152188498dae42f927782b50e109b91"} Jun 10 16:44:48.074146 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.074081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7htg" event={"ID":"7cd0a680-3a66-442b-8d8b-3980a1a11c19","Type":"ContainerStarted","Data":"696c4fae8b48a7c5f7a41c10e590042aa026201e58818343061ae4c2bf9339cb"} Jun 10 16:44:48.077217 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.077152 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" event={"ID":"e5e24daa-95c3-4683-9f56-ca23645dd144","Type":"ContainerStarted","Data":"1ad02ef1456e65c7ad5806b3869f9771df29b3c25c76e3e93fa8048235e25bea"} Jun 10 16:44:48.081222 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.080943 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.551896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.551952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.552063 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.552124 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.552105977 +0000 UTC m=+5.971067493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.552478 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:48.552610 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.552524 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.552509138 +0000 UTC m=+5.971470685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:48.753342 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.752744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:48.753342 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.752950 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:48.753342 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.752969 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:48.753342 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.752981 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:48.753342 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.753032 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.753015722 +0000 UTC m=+6.171977252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:48.971557 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.971474 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:46 +0000 UTC" deadline="2027-12-25 03:05:22.669356997 +0000 UTC" Jun 10 16:44:48.971557 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.971513 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13498h20m33.697848815s" Jun 10 16:44:48.991835 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.991650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:48.991835 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.991751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:48.991835 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.991789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:48.992254 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.991875 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:48.992254 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:48.991915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:48.992254 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:48.992210 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:49.098754 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:49.098662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"1836c767f1e758e9ec44735afefdab4b","Type":"ContainerStarted","Data":"c1c498f9ca3e9d16336ac54142cf263584504fde14f6472e1816b7d2e1958741"} Jun 10 16:44:50.567403 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.567369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:50.567861 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.567429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:50.567861 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.567521 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.567861 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.567542 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:50.567861 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.567591 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:44:54.567573335 +0000 UTC m=+9.986534863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.567861 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.567611 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:44:54.567602051 +0000 UTC m=+9.986563567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:50.768675 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.768628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:50.768882 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.768800 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:50.768882 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.768836 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:50.768882 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.768849 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.769062 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.768904 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:54.768887201 +0000 UTC m=+10.187848733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.986756 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.986688 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:50.986928 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.986801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:50.986928 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.986864 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:50.987044 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.986994 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:50.987044 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:50.987037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:50.987126 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:50.987109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:52.986547 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:52.986517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:52.986981 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:52.986565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:52.986981 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:52.986649 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:52.986981 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:52.986729 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:52.986981 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:52.986791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:52.986981 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:52.986903 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:54.596615 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.596586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:54.597070 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.596644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:54.597070 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.596760 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:54.597070 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.596846 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:45:02.596824232 +0000 UTC m=+18.015785767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:54.597070 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.596851 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:54.597070 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.596893 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:45:02.596880979 +0000 UTC m=+18.015842495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:54.798549 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.798515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:54.798712 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.798654 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:54.798712 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.798668 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:54.798712 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.798676 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:54.798891 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.798724 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:02.798709455 +0000 UTC m=+18.217670971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.986741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.986884 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.986909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.987021 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:54.987064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:54.987768 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:54.987142 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:56.985735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:56.985705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:56.985735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:56.985709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:56.985735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:56.985735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:56.986368 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:56.985849 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:56.986368 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:56.985941 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:44:56.986368 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:56.986042 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:58.985920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:58.985888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:44:58.985920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:58.985919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:44:58.986476 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:44:58.985889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:44:58.986476 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:58.986005 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:44:58.986476 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:58.986082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:44:58.986476 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:44:58.986164 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:00.986101 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:00.986066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:00.986531 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:00.986066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:00.986531 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:00.986186 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:00.986531 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:00.986205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:00.986531 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:00.986277 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:00.986531 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:00.986348 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:02.656348 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.656318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:02.656845 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.656364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:02.656845 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.656447 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:02.656845 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.656490 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:02.656845 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.656521 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:45:18.656501051 +0000 UTC m=+34.075462573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:02.656845 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.656549 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:45:18.65653038 +0000 UTC m=+34.075491904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:02.858574 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.858537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:02.858766 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.858728 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:45:02.858766 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.858757 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:45:02.858766 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.858772 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:02.859010 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.858848 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:18.858829878 +0000 UTC m=+34.277791407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:02.986177 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.986079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:02.986177 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.986079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:02.986367 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.986199 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:02.986367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:02.986079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:02.986367 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.986279 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:02.986367 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:02.986332 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:04.986532 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:04.986500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:04.987080 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:04.986579 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:04.987080 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:04.986596 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:04.987080 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:04.986687 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:04.987080 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:04.986720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:04.987080 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:04.986842 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:06.129935 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.129666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" event={"ID":"e5e24daa-95c3-4683-9f56-ca23645dd144","Type":"ContainerStarted","Data":"8082d025c86b5f5bf4f7d81038cfef2ae8d0b2d97a8f3f4d2dac558ae638336b"} Jun 10 16:45:06.132322 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.132207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hpmv" event={"ID":"f86ded2c-daa8-41d1-b7ef-d853114e66f4","Type":"ContainerStarted","Data":"06a1b660f7518a69cb56bda2e4b94a71b0f5f4b5ae2637c71c7bda97b2c4d3c7"} Jun 10 16:45:06.133893 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.133853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ksg46" event={"ID":"7331b2fa-118f-4781-b732-560f49f1ab62","Type":"ContainerStarted","Data":"1dd492f38a25eefecbba0f50e9467698af50065ff6291e80009ceb5f8ec9d15a"} Jun 10 16:45:06.146143 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.146105 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" podStartSLOduration=20.146091952 podStartE2EDuration="20.146091952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:49.115325116 +0000 UTC m=+4.534286655" watchObservedRunningTime="2026-06-10 16:45:06.146091952 +0000 UTC m=+21.565053491" Jun 10 16:45:06.146298 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.146281 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4hpmv" podStartSLOduration=7.431352286 podStartE2EDuration="21.146275546s" totalImagesPullingTime="13.71492326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:06.145776369 +0000 UTC m=+21.564737903" watchObservedRunningTime="2026-06-10 16:45:06.146275546 +0000 UTC m=+21.565237084" Jun 10 16:45:06.986847 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.986659 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:06.987012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.986673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:06.987012 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:06.986908 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:06.987012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:06.986769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:06.987134 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:06.987032 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:06.987134 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:06.987084 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:07.140846 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.140822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-js5lk" event={"ID":"8df449cd-4e23-4786-8d05-b1685fef960c","Type":"ContainerStarted","Data":"f40541d3c27506d74351faf2b92664b3a5080df4e5de82257a9294ce1283e446"} Jun 10 16:45:07.142254 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.142215 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b7htg" event={"ID":"7cd0a680-3a66-442b-8d8b-3980a1a11c19","Type":"ContainerStarted","Data":"257bb5c55982f06b6f8be5c6c44087aa22dc33e04674133a94f156572b2aa3ed"} Jun 10 16:45:07.144680 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.144663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:45:07.144977 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.144957 2559 generic.go:356] "Generic (PLEG): container finished" podID="ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1" containerID="4b811c1c4fe022c690491030e40bf2d63641e141b4e3e53756e8f7c444184aba" exitCode=1 Jun 10 16:45:07.145041 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"4142953945a03010a904a95e23a26222c06337f5ddef63101d847fdfb8aee9b8"} Jun 10 16:45:07.145089 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"92c6b8a1ceb155c37f7fcc0e2f06a1f801e8be5b78558ea2258a72e255f6f31f"} Jun 10 16:45:07.145129 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"0f8c83cbee22cb14cfd9bce00523cf9309dfb3eff51c876291124375ea7e62cc"} Jun 10 16:45:07.145168 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"552ecb4a89d7ad867642b361f01164aee4cbaecd99ffddc64427484b468a2550"} Jun 10 16:45:07.145205 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerDied","Data":"4b811c1c4fe022c690491030e40bf2d63641e141b4e3e53756e8f7c444184aba"} Jun 10 16:45:07.145205 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.145199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"b1556c8cef1d7698a179492366cdea1f2e827e1d90cd777f4a0207905bd5cc79"} Jun 10 16:45:07.146406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.146388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9k8w" event={"ID":"7ff1ab10-1518-40b3-a4c7-af352b0cadbc","Type":"ContainerStarted","Data":"005a5d3e40912a59fe38c9eeabc6d4e45f038c788fa18a8e4bd2bf221bb7997b"} Jun 10 16:45:07.147840 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.147822 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="a77391c1d69e8200f90048d650aeed8c959fd98d5206d2d0cddab9e76e2ed732" exitCode=0 Jun 10 16:45:07.147933 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.147895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"a77391c1d69e8200f90048d650aeed8c959fd98d5206d2d0cddab9e76e2ed732"} Jun 10 16:45:07.155516 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.155485 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-js5lk" podStartSLOduration=3.832643944 podStartE2EDuration="22.155474422s" totalImagesPullingTime="18.322830478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.155157623 +0000 UTC m=+22.574119160" watchObservedRunningTime="2026-06-10 16:45:07.155474422 +0000 UTC m=+22.574435959" Jun 10 16:45:07.170009 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.169974 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f9k8w" podStartSLOduration=3.351584854 podStartE2EDuration="22.169963123s" totalImagesPullingTime="18.818378269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.169523437 +0000 UTC m=+22.588484974" watchObservedRunningTime="2026-06-10 16:45:07.169963123 +0000 UTC m=+22.588924661" Jun 10 16:45:07.182071 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.182037 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ksg46" podStartSLOduration=3.862726738 podStartE2EDuration="22.182026135s" totalImagesPullingTime="18.319299397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.181616656 +0000 UTC m=+22.600578193" watchObservedRunningTime="2026-06-10 16:45:07.182026135 +0000 UTC m=+22.600987670" Jun 10 16:45:07.192712 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.192683 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b7htg" podStartSLOduration=3.866675365 podStartE2EDuration="22.192673112s" totalImagesPullingTime="18.325997747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.192571444 +0000 UTC m=+22.611532995" watchObservedRunningTime="2026-06-10 16:45:07.192673112 +0000 UTC m=+22.611634640" Jun 10 16:45:07.316824 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:07.316782 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 16:45:08.003043 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.002936 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T16:45:07.316798923Z","UUID":"f7e3a9b7-5e70-4b60-8a8c-f50a3d8768d4","Handler":null,"Name":"","Endpoint":""} Jun 10 16:45:08.004501 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.004477 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 16:45:08.004646 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.004529 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 16:45:08.152032 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.151929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s4fqs" event={"ID":"3fd25bb5-4e25-4580-a811-3663d62756df","Type":"ContainerStarted","Data":"c7894508f2d29297c755f890bfdc8488cd4dbcbcf5c8a52dc260d42c6c2904fb"} Jun 10 16:45:08.154384 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.154282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" event={"ID":"e5e24daa-95c3-4683-9f56-ca23645dd144","Type":"ContainerStarted","Data":"0fabe6560ccef494be81e9a327a5b99119c394d0c8c1a4d5868f726d10301a29"} Jun 10 16:45:08.220664 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.220634 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:45:08.221340 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.221317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:45:08.236191 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.236152 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s4fqs" podStartSLOduration=4.959194253 podStartE2EDuration="23.236137642s" totalImagesPullingTime="18.276943389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:08.165350563 +0000 UTC m=+23.584312105" watchObservedRunningTime="2026-06-10 16:45:08.236137642 +0000 UTC m=+23.655099247" Jun 10 16:45:08.986741 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.986670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:08.986741 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.986708 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:08.986956 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:08.986670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:08.986956 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:08.986782 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:08.986956 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:08.986859 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:08.987086 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:08.986978 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:09.157849 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.157820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" event={"ID":"e5e24daa-95c3-4683-9f56-ca23645dd144","Type":"ContainerStarted","Data":"1702645dff7b50b24acda2446040c5975a9f0125e921bbe77042c3989d47adfc"} Jun 10 16:45:09.160523 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.160500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:45:09.160852 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.160833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"a6a0d5dc3e26b81cc6c0765e709a0e6ae41526d1b24521dabedbeff9738ecf74"} Jun 10 16:45:09.161052 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.161019 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:45:09.161449 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.161435 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4hpmv" Jun 10 16:45:09.174322 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:09.174275 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzkgr" podStartSLOduration=3.591728121 podStartE2EDuration="24.174259147s" totalImagesPullingTime="20.582531026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:09.173753518 +0000 UTC m=+24.592715056" watchObservedRunningTime="2026-06-10 16:45:09.174259147 +0000 UTC m=+24.593220687" Jun 10 16:45:10.986546 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:10.986428 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:10.986965 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:10.986439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:10.986965 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:10.986642 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:10.986965 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:10.986439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:10.986965 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:10.986680 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:10.986965 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:10.986747 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:11.167476 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:11.167455 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:45:11.167792 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:11.167765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"0e893bf876b55a473676154211f1cdfd9e73e06a67eac481b48c11140f0e8f5b"} Jun 10 16:45:11.168203 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:11.168191 2559 scope.go:117] "RemoveContainer" containerID="4b811c1c4fe022c690491030e40bf2d63641e141b4e3e53756e8f7c444184aba" Jun 10 16:45:12.177997 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.177973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:45:12.178382 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.178334 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" event={"ID":"ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1","Type":"ContainerStarted","Data":"01653ea07df92c18c6f29578853941be5cdd4a95358b438acfc732c35371844a"} Jun 10 16:45:12.178706 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.178684 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:12.178822 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.178760 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:12.178881 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.178823 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:12.195005 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.194986 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:12.195370 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.195357 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:12.204757 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.204721 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" podStartSLOduration=8.840814213 podStartE2EDuration="27.204708646s" totalImagesPullingTime="18.363894433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:12.2034313 +0000 UTC m=+27.622392837" watchObservedRunningTime="2026-06-10 16:45:12.204708646 +0000 UTC m=+27.623670183" Jun 10 16:45:12.831059 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.830856 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tg948"] Jun 10 16:45:12.831323 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.831210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:12.831410 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:12.831349 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:12.832404 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.832351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt2lf"] Jun 10 16:45:12.832548 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.832472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:12.832619 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:12.832569 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:12.833121 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.833099 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gmcfv"] Jun 10 16:45:12.833219 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:12.833194 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:12.833302 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:12.833279 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:13.986001 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:13.985979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:13.986438 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:13.986098 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:14.184732 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:14.184705 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="de0e283290bb973c1ab2d0c3c059d29f7d95f547e290c06b48c39469bf8e4ff8" exitCode=0 Jun 10 16:45:14.184856 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:14.184792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"de0e283290bb973c1ab2d0c3c059d29f7d95f547e290c06b48c39469bf8e4ff8"} Jun 10 16:45:14.986711 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:14.986653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:14.987119 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:14.986738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:14.987119 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:14.986775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:14.987119 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:14.986935 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:15.188473 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:15.188450 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="e5b9eba64c80f66aaf0e970c3f96115d442c97939e46602379eff4d430a4c035" exitCode=0 Jun 10 16:45:15.188576 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:15.188497 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"e5b9eba64c80f66aaf0e970c3f96115d442c97939e46602379eff4d430a4c035"} Jun 10 16:45:15.986869 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:15.986647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:15.987270 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:15.986902 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:16.192541 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:16.192514 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="e7800a38454d344a2cd7f8e64a49eac54a04b90673dcc54efd4c044e994eb360" exitCode=0 Jun 10 16:45:16.192673 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:16.192549 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"e7800a38454d344a2cd7f8e64a49eac54a04b90673dcc54efd4c044e994eb360"} Jun 10 16:45:16.989633 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:16.989604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:16.990054 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:16.989725 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:45:16.990054 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:16.989782 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:16.990054 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:16.989889 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tg948" podUID="bb0f6760-63fb-41b8-81d5-854853a9b4ba" Jun 10 16:45:17.985887 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:17.985862 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:17.986117 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:17.985950 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt2lf" podUID="c084070e-0a32-43ef-93a8-e6e9938e43e9" Jun 10 16:45:18.686991 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.686960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:18.687435 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.687021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:18.687435 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.687102 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:18.687435 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.687143 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:18.687435 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.687176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:45:50.687155512 +0000 UTC m=+66.106117032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:18.687435 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.687203 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret podName:bb0f6760-63fb-41b8-81d5-854853a9b4ba nodeName:}" failed. No retries permitted until 2026-06-10 16:45:50.687187536 +0000 UTC m=+66.106149069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret") pod "global-pull-secret-syncer-tg948" (UID: "bb0f6760-63fb-41b8-81d5-854853a9b4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:18.884370 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.884342 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeReady" Jun 10 16:45:18.884519 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.884506 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 16:45:18.889972 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.889944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:18.890102 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.890077 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:45:18.890102 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.890095 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:45:18.890185 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.890106 2559 projected.go:196] Error preparing data for projected volume kube-api-access-nl54c for pod openshift-network-diagnostics/network-check-target-wt2lf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:18.890185 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:18.890157 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c podName:c084070e-0a32-43ef-93a8-e6e9938e43e9 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:50.890142581 +0000 UTC m=+66.309104100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl54c" (UniqueName: "kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c") pod "network-check-target-wt2lf" (UID: "c084070e-0a32-43ef-93a8-e6e9938e43e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:18.928034 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.927994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z72fb"] Jun 10 16:45:18.930677 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.930426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:18.930677 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.930636 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zknq8"] Jun 10 16:45:18.932634 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.932573 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 16:45:18.932755 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.932644 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:45:18.932755 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.932650 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 16:45:18.933308 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.933290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:18.935493 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.935473 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 16:45:18.935602 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.935559 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 16:45:18.935602 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.935559 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 16:45:18.935741 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.935663 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lxlw\"" Jun 10 16:45:18.941134 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.941111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z72fb"] Jun 10 16:45:18.943612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.943592 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zknq8"] Jun 10 16:45:18.986203 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.986174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:18.986342 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.986175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:18.989090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.989069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:18.989371 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.989349 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:18.989743 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:18.989724 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:45:19.091353 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.091496 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716d615a-3a84-4647-9d52-1fd0ad695bfb-cert\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.091496 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt44r\" (UniqueName: \"kubernetes.io/projected/716d615a-3a84-4647-9d52-1fd0ad695bfb-kube-api-access-kt44r\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.091496 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f61e0b1-d9da-4505-ad15-204dfea8723e-tmp-dir\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.091665 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f61e0b1-d9da-4505-ad15-204dfea8723e-config-volume\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.091665 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.091589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4qr\" (UniqueName: \"kubernetes.io/projected/9f61e0b1-d9da-4505-ad15-204dfea8723e-kube-api-access-dp4qr\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.192739 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716d615a-3a84-4647-9d52-1fd0ad695bfb-cert\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.192739 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt44r\" (UniqueName: \"kubernetes.io/projected/716d615a-3a84-4647-9d52-1fd0ad695bfb-kube-api-access-kt44r\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.192739 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f61e0b1-d9da-4505-ad15-204dfea8723e-tmp-dir\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.193028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192771 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f61e0b1-d9da-4505-ad15-204dfea8723e-config-volume\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.193028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4qr\" (UniqueName: \"kubernetes.io/projected/9f61e0b1-d9da-4505-ad15-204dfea8723e-kube-api-access-dp4qr\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.193028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.192872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.193028 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:19.192994 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:19.193219 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:19.193049 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:19.693031195 +0000 UTC m=+35.111992713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:19.193278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.193257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f61e0b1-d9da-4505-ad15-204dfea8723e-tmp-dir\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.193457 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.193436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f61e0b1-d9da-4505-ad15-204dfea8723e-config-volume\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.197126 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.197105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716d615a-3a84-4647-9d52-1fd0ad695bfb-cert\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.201254 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.201222 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4qr\" (UniqueName: \"kubernetes.io/projected/9f61e0b1-d9da-4505-ad15-204dfea8723e-kube-api-access-dp4qr\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.201782 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.201764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt44r\" (UniqueName: \"kubernetes.io/projected/716d615a-3a84-4647-9d52-1fd0ad695bfb-kube-api-access-kt44r\") pod \"ingress-canary-zknq8\" (UID: \"716d615a-3a84-4647-9d52-1fd0ad695bfb\") " pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.248848 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.248802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zknq8" Jun 10 16:45:19.277402 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.277377 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:19.366969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.366941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:19.695419 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.695383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:19.695903 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:19.695547 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:19.695903 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:19.695617 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:20.69559721 +0000 UTC m=+36.114558745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:19.986576 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.986547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:19.989184 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.989161 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:19.989301 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.989210 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:19.989301 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:19.989240 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:20.084768 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:20.084741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zknq8"] Jun 10 16:45:20.088881 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:45:20.088854 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716d615a_3a84_4647_9d52_1fd0ad695bfb.slice/crio-a552c1f354d68babe7df551a807608b09b40c1781402ea0e73b3b12d9b6c0601 WatchSource:0}: Error finding container a552c1f354d68babe7df551a807608b09b40c1781402ea0e73b3b12d9b6c0601: Status 404 returned error can't find the container with id a552c1f354d68babe7df551a807608b09b40c1781402ea0e73b3b12d9b6c0601 Jun 10 16:45:20.203266 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:20.203190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zknq8" event={"ID":"716d615a-3a84-4647-9d52-1fd0ad695bfb","Type":"ContainerStarted","Data":"a552c1f354d68babe7df551a807608b09b40c1781402ea0e73b3b12d9b6c0601"} Jun 10 16:45:20.716053 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:20.715830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:20.716370 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:20.715988 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:20.716370 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:20.716195 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:22.716176591 +0000 UTC m=+38.135138128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:20.761744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:20.761683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:20.874354 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:20.874317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:21.208780 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:21.208750 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="7464e2eac84c2e49fc3574444e213c88d412cca79aeb794d0cdadd7c49e029ff" exitCode=0 Jun 10 16:45:21.208985 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:21.208794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"7464e2eac84c2e49fc3574444e213c88d412cca79aeb794d0cdadd7c49e029ff"} Jun 10 16:45:22.214374 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.214340 2559 generic.go:356] "Generic (PLEG): container finished" podID="ecdfe914-0186-429c-a2ef-d681c40d1f57" containerID="5138edf09ea088861e12ec0dff1159eefe060fb3d2009ade85933e4d0e8278a0" exitCode=0 Jun 10 16:45:22.215012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.214422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerDied","Data":"5138edf09ea088861e12ec0dff1159eefe060fb3d2009ade85933e4d0e8278a0"} Jun 10 16:45:22.215883 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.215862 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zknq8" event={"ID":"716d615a-3a84-4647-9d52-1fd0ad695bfb","Type":"ContainerStarted","Data":"f49620d416b6d63e58851886e38ae4282b98a3ea906e156f3351bb2073d6e871"} Jun 10 16:45:22.253210 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.253154 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zknq8" podStartSLOduration=2.289192695 podStartE2EDuration="4.253133448s" totalImagesPullingTime="1.963940753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:22.252372839 +0000 UTC m=+37.671334379" watchObservedRunningTime="2026-06-10 16:45:22.253133448 +0000 UTC m=+37.672094988" Jun 10 16:45:22.515656 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.515629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:22.572941 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.572915 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:22.729667 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:22.729644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:22.729776 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:22.729752 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:22.729841 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:22.729799 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:26.729786293 +0000 UTC m=+42.148747810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:23.221146 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.221116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-68z29" event={"ID":"ecdfe914-0186-429c-a2ef-d681c40d1f57","Type":"ContainerStarted","Data":"7c9a902847763648ca3f83cb471eb4c73ac2172de4b2625ad9a5b8f70882ee1a"} Jun 10 16:45:23.250430 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.250385 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-68z29" podStartSLOduration=8.26383412 podStartE2EDuration="38.25037106s" totalImagesPullingTime="29.98653694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:23.248957984 +0000 UTC m=+38.667919523" watchObservedRunningTime="2026-06-10 16:45:23.25037106 +0000 UTC m=+38.669332629" Jun 10 16:45:23.374545 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.374523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:23.440028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.440007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:23.492535 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.492469 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:23.802568 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.802507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:23.866075 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.866053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:23.933159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:23.933137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:24.085587 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:24.085498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:24.140424 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:24.140400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:25.687107 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:25.687061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:25.738694 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:25.738674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:26.758206 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:26.758181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:26.758519 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:26.758335 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:26.758519 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:26.758397 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:34.758383737 +0000 UTC m=+50.177345257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:34.814349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:34.814313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:34.814773 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:34.814432 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:34.814773 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:34.814480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:45:50.814466799 +0000 UTC m=+66.233428316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:41.245325 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:41.245294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:41.346262 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:41.346235 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:44.199584 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:44.199556 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-frfnp" Jun 10 16:45:44.354747 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:44.354719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:44.410503 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:44.410481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:45.732980 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:45.732944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:45.788459 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:45.788436 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:50.722884 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.722847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:45:50.723251 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.722894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:50.725310 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.725288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:50.725379 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.725310 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:50.733056 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:50.733029 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:45:50.733174 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:50.733105 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:46:54.733084863 +0000 UTC m=+130.152046386 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : secret "metrics-daemon-secret" not found Jun 10 16:45:50.735846 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.735828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb0f6760-63fb-41b8-81d5-854853a9b4ba-original-pull-secret\") pod \"global-pull-secret-syncer-tg948\" (UID: \"bb0f6760-63fb-41b8-81d5-854853a9b4ba\") " pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:50.797147 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.797127 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tg948" Jun 10 16:45:50.823487 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.823465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:45:50.823624 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:50.823607 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:50.823692 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:45:50.823668 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:46:22.823651213 +0000 UTC m=+98.242612744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:45:50.924001 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.923976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:50.926256 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.926237 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:50.937316 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.937297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:50.937524 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.937508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tg948"] Jun 10 16:45:50.940611 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:45:50.940592 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0f6760_63fb_41b8_81d5_854853a9b4ba.slice/crio-d121dda8f05291ece7d283cdb65dcc37b77f8ca434dbe7def08577d5fd09b5c2 WatchSource:0}: Error finding container d121dda8f05291ece7d283cdb65dcc37b77f8ca434dbe7def08577d5fd09b5c2: Status 404 returned error can't find the container with id d121dda8f05291ece7d283cdb65dcc37b77f8ca434dbe7def08577d5fd09b5c2 Jun 10 16:45:50.947910 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:50.947893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl54c\" (UniqueName: \"kubernetes.io/projected/c084070e-0a32-43ef-93a8-e6e9938e43e9-kube-api-access-nl54c\") pod \"network-check-target-wt2lf\" (UID: \"c084070e-0a32-43ef-93a8-e6e9938e43e9\") " pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:51.197046 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:51.197029 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:51.205012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:51.204997 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:51.279048 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:51.279015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tg948" event={"ID":"bb0f6760-63fb-41b8-81d5-854853a9b4ba","Type":"ContainerStarted","Data":"d121dda8f05291ece7d283cdb65dcc37b77f8ca434dbe7def08577d5fd09b5c2"} Jun 10 16:45:51.342946 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:51.342924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt2lf"] Jun 10 16:45:51.344820 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:45:51.344784 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc084070e_0a32_43ef_93a8_e6e9938e43e9.slice/crio-2f5fb184e7df2322040a97fe929ff7d319aaa53948d4dc4bccdb1241849baa89 WatchSource:0}: Error finding container 2f5fb184e7df2322040a97fe929ff7d319aaa53948d4dc4bccdb1241849baa89: Status 404 returned error can't find the container with id 2f5fb184e7df2322040a97fe929ff7d319aaa53948d4dc4bccdb1241849baa89 Jun 10 16:45:52.283150 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:52.283106 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt2lf" event={"ID":"c084070e-0a32-43ef-93a8-e6e9938e43e9","Type":"ContainerStarted","Data":"2f5fb184e7df2322040a97fe929ff7d319aaa53948d4dc4bccdb1241849baa89"} Jun 10 16:45:55.952765 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:55.952734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:56.004340 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.004317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:45:56.295439 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.295388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tg948" event={"ID":"bb0f6760-63fb-41b8-81d5-854853a9b4ba","Type":"ContainerStarted","Data":"1fd059cc15b9f8c8e8ca082b1739d5b27144684027c53ab6869c2ca419a38b14"} Jun 10 16:45:56.296717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.296695 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt2lf" event={"ID":"c084070e-0a32-43ef-93a8-e6e9938e43e9","Type":"ContainerStarted","Data":"4b785dad4e696d7845ef6538040f65dbe078ba3084de894cdef80e888c59e846"} Jun 10 16:45:56.296834 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.296823 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:45:56.310033 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.309995 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tg948" podStartSLOduration=66.828605616 podStartE2EDuration="1m11.309984039s" totalImagesPullingTime="4.481378423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:56.3096595 +0000 UTC m=+71.728621051" watchObservedRunningTime="2026-06-10 16:45:56.309984039 +0000 UTC m=+71.728945576" Jun 10 16:45:56.324744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:45:56.324711 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wt2lf" podStartSLOduration=67.251549323 podStartE2EDuration="1m11.324701482s" totalImagesPullingTime="4.073152159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:56.324136493 +0000 UTC m=+71.743098033" watchObservedRunningTime="2026-06-10 16:45:56.324701482 +0000 UTC m=+71.743663021" Jun 10 16:46:22.834986 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:46:22.834942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:46:22.835417 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:46:22.835061 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:46:22.835417 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:46:22.835124 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:47:26.8351097 +0000 UTC m=+162.254071216 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:46:27.301369 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:46:27.301336 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wt2lf" Jun 10 16:46:54.736113 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:46:54.736065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:46:54.736603 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:46:54.736210 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:46:54.736603 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:46:54.736279 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs podName:b081f2c5-6532-4993-8d4c-5c489eaad0de nodeName:}" failed. No retries permitted until 2026-06-10 16:48:56.73626123 +0000 UTC m=+252.155222748 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs") pod "network-metrics-daemon-gmcfv" (UID: "b081f2c5-6532-4993-8d4c-5c489eaad0de") : secret "metrics-daemon-secret" not found Jun 10 16:47:21.941853 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:21.941759 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z72fb" podUID="9f61e0b1-d9da-4505-ad15-204dfea8723e" Jun 10 16:47:22.003527 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:22.003488 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gmcfv" podUID="b081f2c5-6532-4993-8d4c-5c489eaad0de" Jun 10 16:47:22.497847 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:22.497799 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72fb" Jun 10 16:47:26.850140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:26.850095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:47:26.850588 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:26.850244 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:47:26.850588 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:26.850328 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls podName:9f61e0b1-d9da-4505-ad15-204dfea8723e nodeName:}" failed. No retries permitted until 2026-06-10 16:49:28.850310463 +0000 UTC m=+284.269271980 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls") pod "dns-default-z72fb" (UID: "9f61e0b1-d9da-4505-ad15-204dfea8723e") : secret "dns-default-metrics-tls" not found Jun 10 16:47:33.986333 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:33.986232 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:47:52.550782 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.550750 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr"] Jun 10 16:47:52.552479 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.552463 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.554789 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.554756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 16:47:52.554950 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.554799 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 16:47:52.559645 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.555337 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m9mj9\"" Jun 10 16:47:52.562107 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.562078 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t"] Jun 10 16:47:52.564034 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.564013 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8"] Jun 10 16:47:52.564146 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.564129 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.565888 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.565867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.566654 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.566633 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.566753 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.566633 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 16:47:52.566832 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.566756 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr"] Jun 10 16:47:52.566832 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.566763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.566953 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.566895 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 16:47:52.570247 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.569562 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 16:47:52.570247 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.569878 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 16:47:52.570247 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.569920 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 16:47:52.570247 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.570163 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 16:47:52.577782 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.577760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t"] Jun 10 16:47:52.579000 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.578981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8"] Jun 10 16:47:52.643543 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.643766 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64ee021-20df-4079-8912-ddbadaa35a25-tmp\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.643766 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4d8\" (UniqueName: \"kubernetes.io/projected/f9ce4458-8bc3-4568-8d70-fa215a598780-kube-api-access-rk4d8\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.643766 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c64ee021-20df-4079-8912-ddbadaa35a25-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.643766 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ce4458-8bc3-4568-8d70-fa215a598780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.643766 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f4c6d36-0207-4be5-b10b-979b0a642148-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.644132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.644132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.644132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.644132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6mbj\" (UniqueName: \"kubernetes.io/projected/c64ee021-20df-4079-8912-ddbadaa35a25-kube-api-access-c6mbj\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.644132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.643947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744443 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744635 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744635 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.744635 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:52.744564 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:47:52.744635 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6mbj\" (UniqueName: \"kubernetes.io/projected/c64ee021-20df-4079-8912-ddbadaa35a25-kube-api-access-c6mbj\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.744635 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:52.744629 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.244613716 +0000 UTC m=+188.663575233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:47:52.744911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64ee021-20df-4079-8912-ddbadaa35a25-tmp\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.744911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4d8\" (UniqueName: \"kubernetes.io/projected/f9ce4458-8bc3-4568-8d70-fa215a598780-kube-api-access-rk4d8\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.744911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c64ee021-20df-4079-8912-ddbadaa35a25-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.745158 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ce4458-8bc3-4568-8d70-fa215a598780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.745158 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.744988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f4c6d36-0207-4be5-b10b-979b0a642148-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.745256 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.745213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64ee021-20df-4079-8912-ddbadaa35a25-tmp\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.745777 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.745751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f4c6d36-0207-4be5-b10b-979b0a642148-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:52.745929 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.745797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9ce4458-8bc3-4568-8d70-fa215a598780-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.747225 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.747193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-ca\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.747486 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.747463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.747605 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.747589 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.747789 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.747767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9ce4458-8bc3-4568-8d70-fa215a598780-hub\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.747860 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.747798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c64ee021-20df-4079-8912-ddbadaa35a25-klusterlet-config\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.763703 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.763678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4d8\" (UniqueName: \"kubernetes.io/projected/f9ce4458-8bc3-4568-8d70-fa215a598780-kube-api-access-rk4d8\") pod \"cluster-proxy-proxy-agent-db74d589c-9x2k8\" (UID: \"f9ce4458-8bc3-4568-8d70-fa215a598780\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.777172 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.777144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6mbj\" (UniqueName: \"kubernetes.io/projected/c64ee021-20df-4079-8912-ddbadaa35a25-kube-api-access-c6mbj\") pod \"klusterlet-addon-workmgr-99f68bdc5-pvp4t\" (UID: \"c64ee021-20df-4079-8912-ddbadaa35a25\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.875227 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.875136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:47:52.892444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.892417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:47:52.959299 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:52.959237 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:53.008959 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.008870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t"] Jun 10 16:47:53.013539 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:47:53.013511 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64ee021_20df_4079_8912_ddbadaa35a25.slice/crio-4b52b08ff73ee9b3fb560b326f8b179433ffa1cf5d7e137a50bf43c76a92a2db WatchSource:0}: Error finding container 4b52b08ff73ee9b3fb560b326f8b179433ffa1cf5d7e137a50bf43c76a92a2db: Status 404 returned error can't find the container with id 4b52b08ff73ee9b3fb560b326f8b179433ffa1cf5d7e137a50bf43c76a92a2db Jun 10 16:47:53.027875 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.027849 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8"] Jun 10 16:47:53.030660 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.030632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:53.031514 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:47:53.031491 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9ce4458_8bc3_4568_8d70_fa215a598780.slice/crio-a052214d1f181536ab103cff4505e4e2a348ae268e2706ec24d519ad7ba80367 WatchSource:0}: Error finding container a052214d1f181536ab103cff4505e4e2a348ae268e2706ec24d519ad7ba80367: Status 404 returned error can't find the container with id a052214d1f181536ab103cff4505e4e2a348ae268e2706ec24d519ad7ba80367 Jun 10 16:47:53.249591 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.249551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:53.249787 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:53.249717 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:47:53.249855 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:53.249788 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.24976986 +0000 UTC m=+189.668731376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:47:53.575969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.575868 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerStarted","Data":"a052214d1f181536ab103cff4505e4e2a348ae268e2706ec24d519ad7ba80367"} Jun 10 16:47:53.576997 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:53.576974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" event={"ID":"c64ee021-20df-4079-8912-ddbadaa35a25","Type":"ContainerStarted","Data":"4b52b08ff73ee9b3fb560b326f8b179433ffa1cf5d7e137a50bf43c76a92a2db"} Jun 10 16:47:54.257096 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:54.257054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:54.257324 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:54.257240 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:47:54.257394 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:54.257331 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.257306348 +0000 UTC m=+191.676267880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:47:55.111841 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:55.111772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:55.164710 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:55.164598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:55.924028 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:55.923990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:56.274515 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:56.274418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:47:56.275013 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:56.274580 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:47:56.275013 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:47:56.274716 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.274650554 +0000 UTC m=+195.693612078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:47:56.374962 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:56.374919 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:56.477487 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:56.477430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:56.631384 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:56.631295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:56.730988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:56.730938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:57.209234 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:57.209177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:57.309691 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:57.309621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:57.409364 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:57.409330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:57.509525 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:57.509431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:58.258562 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:58.258525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:58.309573 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:58.309514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:58.928785 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:58.928752 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:59.028791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:59.028686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:47:59.124027 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:47:59.123994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:00.231925 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:00.231901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksg46_7331b2fa-118f-4781-b732-560f49f1ab62/dns-node-resolver/0.log" Jun 10 16:48:00.306606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:00.306566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:48:00.306833 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:48:00.306702 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:48:00.306833 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:48:00.306795 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.30677872 +0000 UTC m=+203.725740237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:48:01.232791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.232755 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7htg_7cd0a680-3a66-442b-8d8b-3980a1a11c19/node-ca/0.log" Jun 10 16:48:01.495791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.495702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:01.601600 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.601560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerStarted","Data":"b554e712f5da41e389dcabb6353e2baa9894ab64c503ffc7367f512b643fd249"} Jun 10 16:48:01.601600 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.601615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerStarted","Data":"2ebbdf74b0bb6462cbc0e7a783b9d050fd3e0040c4411da0813f6af0d0b43cdf"} Jun 10 16:48:01.601901 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.601634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerStarted","Data":"350bd07a204f09e1ef8ce158386b605af4b0c97b73e49b8c7021877788fb5d15"} Jun 10 16:48:01.619684 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:01.619635 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" podStartSLOduration=1.806205589 podStartE2EDuration="9.619620636s" totalImagesPullingTime="7.813415047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:01.618501751 +0000 UTC m=+197.037463303" watchObservedRunningTime="2026-06-10 16:48:01.619620636 +0000 UTC m=+197.038582152" Jun 10 16:48:02.232437 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:02.232401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknq8_716d615a-3a84-4647-9d52-1fd0ad695bfb/serve-healthcheck-canary/0.log" Jun 10 16:48:02.907452 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:02.907416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.117395 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.117374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.268415 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.268382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.368711 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.368678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.428659 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.428632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.576063 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.575986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:03.609642 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.609609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" event={"ID":"c64ee021-20df-4079-8912-ddbadaa35a25","Type":"ContainerStarted","Data":"f923cb67879c4d2bafc590e61acfb5317c2c04a277df4a805f0e94a13d73a2ab"} Jun 10 16:48:03.609827 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.609776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:48:03.611326 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.611308 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" Jun 10 16:48:03.623969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:03.623931 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-99f68bdc5-pvp4t" podStartSLOduration=1.5612013500000002 podStartE2EDuration="11.623917045s" totalImagesPullingTime="10.062715695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:03.623167779 +0000 UTC m=+199.042129323" watchObservedRunningTime="2026-06-10 16:48:03.623917045 +0000 UTC m=+199.042878583" Jun 10 16:48:04.375235 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:04.375204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:04.974914 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:04.974871 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:05.173148 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:05.173118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:05.378702 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:05.378640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:05.772679 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:05.772648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:06.377233 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:06.377203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:06.441664 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:06.441642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:06.568591 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:06.568563 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:06.976952 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:06.976923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:07.174689 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:07.174661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:07.375672 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:07.375607 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:07.577083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:07.577058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:08.365862 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:08.365830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:48:08.365999 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:48:08.365946 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 16:48:08.366052 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:48:08.366017 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert podName:7f4c6d36-0207-4be5-b10b-979b0a642148 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:24.36599999 +0000 UTC m=+219.784961527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kmhdr" (UID: "7f4c6d36-0207-4be5-b10b-979b0a642148") : secret "networking-console-plugin-cert" not found Jun 10 16:48:08.573986 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:08.573959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:08.980390 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:08.980363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:09.175452 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:09.175421 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:09.277224 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:09.277152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:09.383066 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:09.383037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:09.491739 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:09.491713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:09.590524 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:09.590461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:10.397923 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:10.397897 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:10.908433 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:10.908392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:11.009568 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:11.009544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:11.170245 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:11.170222 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:11.580290 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:11.580229 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:11.775412 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:11.775385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:11.974803 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:11.974774 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:12.778396 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:12.778362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:13.176854 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:13.176786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:13.376290 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:13.376261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:13.570305 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:13.570241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:20.246238 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.246201 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lp4pf"] Jun 10 16:48:20.297079 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.297054 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75fb6474df-vjnv9"] Jun 10 16:48:20.297215 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.297179 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.299378 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.299355 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 16:48:20.299510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.299358 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 16:48:20.299510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.299458 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 16:48:20.299510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.299475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q9s5x\"" Jun 10 16:48:20.299510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.299484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 16:48:20.316615 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.316597 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lp4pf"] Jun 10 16:48:20.316714 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.316638 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75fb6474df-vjnv9"] Jun 10 16:48:20.316714 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.316705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.319095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.319079 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 16:48:20.319562 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.319547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 16:48:20.319934 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.319916 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 16:48:20.320533 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.320516 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4p9m8\"" Jun 10 16:48:20.324592 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.324573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 16:48:20.345174 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.345154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:20.446265 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.446238 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:20.451165 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451148 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-trusted-ca\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451236 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c4b710f-e872-41fb-bb3b-58e79b48256f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.451236 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4b710f-e872-41fb-bb3b-58e79b48256f-data-volume\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.451236 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-ca-trust-extracted\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-certificates\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxhrj\" (UniqueName: \"kubernetes.io/projected/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-api-access-kxhrj\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.451349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b710f-e872-41fb-bb3b-58e79b48256f-crio-socket\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-installation-pull-secrets\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgkzx\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-kube-api-access-xgkzx\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-tls\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-image-registry-private-configuration\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.451466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.451465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-bound-sa-token\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.551842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4b710f-e872-41fb-bb3b-58e79b48256f-data-volume\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.551842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-ca-trust-extracted\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.551842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-certificates\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxhrj\" (UniqueName: \"kubernetes.io/projected/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-api-access-kxhrj\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b710f-e872-41fb-bb3b-58e79b48256f-crio-socket\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551889 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-installation-pull-secrets\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgkzx\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-kube-api-access-xgkzx\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-tls\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.551990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b710f-e872-41fb-bb3b-58e79b48256f-crio-socket\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.552029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-image-registry-private-configuration\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-bound-sa-token\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-trusted-ca\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c4b710f-e872-41fb-bb3b-58e79b48256f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.552406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-ca-trust-extracted\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552754 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552729 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-certificates\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.552942 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.552828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.553305 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.553279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4b710f-e872-41fb-bb3b-58e79b48256f-data-volume\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.553483 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.553458 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-trusted-ca\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.554839 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.554800 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-installation-pull-secrets\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.555039 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.555013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-image-registry-private-configuration\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.555094 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.555020 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1c4b710f-e872-41fb-bb3b-58e79b48256f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.555145 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.555131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-registry-tls\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.559320 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.559292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-bound-sa-token\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.559410 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.559393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxhrj\" (UniqueName: \"kubernetes.io/projected/1c4b710f-e872-41fb-bb3b-58e79b48256f-kube-api-access-kxhrj\") pod \"insights-runtime-extractor-lp4pf\" (UID: \"1c4b710f-e872-41fb-bb3b-58e79b48256f\") " pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.560057 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.560034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgkzx\" (UniqueName: \"kubernetes.io/projected/112db6fa-3a90-4fa0-9dcb-9db7162cd1b2-kube-api-access-xgkzx\") pod \"image-registry-75fb6474df-vjnv9\" (UID: \"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2\") " pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.607072 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.607035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lp4pf" Jun 10 16:48:20.625156 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.625128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:20.771906 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.771864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lp4pf"] Jun 10 16:48:20.775001 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:20.774968 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4b710f_e872_41fb_bb3b_58e79b48256f.slice/crio-1b4be6e895f23a561620a0acab8411e43e713be7bd6c317f937296fcace1c27d WatchSource:0}: Error finding container 1b4be6e895f23a561620a0acab8411e43e713be7bd6c317f937296fcace1c27d: Status 404 returned error can't find the container with id 1b4be6e895f23a561620a0acab8411e43e713be7bd6c317f937296fcace1c27d Jun 10 16:48:20.792008 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:20.791984 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75fb6474df-vjnv9"] Jun 10 16:48:20.795772 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:20.795748 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112db6fa_3a90_4fa0_9dcb_9db7162cd1b2.slice/crio-02d443da4a8f348a4314bd216b26f4a4c7ef31c0579e39498ec7d6b3aae0e753 WatchSource:0}: Error finding container 02d443da4a8f348a4314bd216b26f4a4c7ef31c0579e39498ec7d6b3aae0e753: Status 404 returned error can't find the container with id 02d443da4a8f348a4314bd216b26f4a4c7ef31c0579e39498ec7d6b3aae0e753 Jun 10 16:48:21.659963 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.659925 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" event={"ID":"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2","Type":"ContainerStarted","Data":"fa604f4ad2d0d60352df058ef3c082254366ce6edfa10660e04912e003ff2a7d"} Jun 10 16:48:21.660355 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.659982 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:48:21.660355 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.660002 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" event={"ID":"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2","Type":"ContainerStarted","Data":"02d443da4a8f348a4314bd216b26f4a4c7ef31c0579e39498ec7d6b3aae0e753"} Jun 10 16:48:21.661356 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.661327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lp4pf" event={"ID":"1c4b710f-e872-41fb-bb3b-58e79b48256f","Type":"ContainerStarted","Data":"7aa4416b3165c6bba7e19b8635bd468dcdf0e3ea866fe743e123f5dea3d8eb84"} Jun 10 16:48:21.661461 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.661368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lp4pf" event={"ID":"1c4b710f-e872-41fb-bb3b-58e79b48256f","Type":"ContainerStarted","Data":"1b4be6e895f23a561620a0acab8411e43e713be7bd6c317f937296fcace1c27d"} Jun 10 16:48:21.678980 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:21.678938 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podStartSLOduration=1.678924488 podStartE2EDuration="1.678924488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:21.677443535 +0000 UTC m=+217.096405075" watchObservedRunningTime="2026-06-10 16:48:21.678924488 +0000 UTC m=+217.097886033" Jun 10 16:48:22.518261 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:22.518224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:22.571204 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:22.571171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:22.666352 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:22.666324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lp4pf" event={"ID":"1c4b710f-e872-41fb-bb3b-58e79b48256f","Type":"ContainerStarted","Data":"ba3554aa5a1e23ab3de26086ec0a8e9d5507c3d4c91fd0ec329b922724cf3044"} Jun 10 16:48:23.671956 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:23.671926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lp4pf" event={"ID":"1c4b710f-e872-41fb-bb3b-58e79b48256f","Type":"ContainerStarted","Data":"a08b826fcc0c636848b33bfde89e2765957ec6ed18d8f03ad1ee21802cb6a446"} Jun 10 16:48:23.687942 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:23.687896 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lp4pf" podStartSLOduration=1.324709696 podStartE2EDuration="3.687879876s" totalImagesPullingTime="2.36317018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:23.68778293 +0000 UTC m=+219.106744471" watchObservedRunningTime="2026-06-10 16:48:23.687879876 +0000 UTC m=+219.106841433" Jun 10 16:48:24.379412 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:24.379380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:48:24.382049 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:24.382014 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f4c6d36-0207-4be5-b10b-979b0a642148-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kmhdr\" (UID: \"7f4c6d36-0207-4be5-b10b-979b0a642148\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:48:24.664979 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:24.664956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" Jun 10 16:48:24.789988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:24.789960 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr"] Jun 10 16:48:24.792713 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:24.792691 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4c6d36_0207_4be5_b10b_979b0a642148.slice/crio-234e9460e986ddd0e7c8271384d35773622491c8bd3572d334a1d38b6333d4d5 WatchSource:0}: Error finding container 234e9460e986ddd0e7c8271384d35773622491c8bd3572d334a1d38b6333d4d5: Status 404 returned error can't find the container with id 234e9460e986ddd0e7c8271384d35773622491c8bd3572d334a1d38b6333d4d5 Jun 10 16:48:25.680600 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:25.680565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" event={"ID":"7f4c6d36-0207-4be5-b10b-979b0a642148","Type":"ContainerStarted","Data":"234e9460e986ddd0e7c8271384d35773622491c8bd3572d334a1d38b6333d4d5"} Jun 10 16:48:26.685995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:26.685959 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" event={"ID":"7f4c6d36-0207-4be5-b10b-979b0a642148","Type":"ContainerStarted","Data":"f95a9e288c15cb68d269f3932606ee875e0bb66bcf0f5a538aab5f58e0b194ff"} Jun 10 16:48:26.703710 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:26.703658 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kmhdr" podStartSLOduration=33.58886739 podStartE2EDuration="34.703642212s" totalImagesPullingTime="1.114774822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:26.702930536 +0000 UTC m=+222.121892075" watchObservedRunningTime="2026-06-10 16:48:26.703642212 +0000 UTC m=+222.122603843" Jun 10 16:48:26.798678 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:26.798656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:26.896966 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:26.896944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:26.997574 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:26.997504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:27.072802 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:27.072772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:27.659395 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:27.659366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:31.093637 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:31.093611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:31.193977 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:31.193953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:31.289456 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:31.289428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:33.098234 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:33.098190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.247345 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.247301 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.363141 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.363115 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.473086 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.473056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.501670 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.501608 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xw5nf"] Jun 10 16:48:35.503526 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.503513 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.505723 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.505682 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 16:48:35.505855 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.505766 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pzk5s\"" Jun 10 16:48:35.505926 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.505911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 16:48:35.506074 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.506061 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 16:48:35.506124 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.506062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 16:48:35.506160 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.506150 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 16:48:35.506505 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.506492 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 16:48:35.565131 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.565106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.656091 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656198 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-accelerators-collector-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656198 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-tls\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656198 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-wtmp\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656198 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-sys\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-textfile\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-root\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmqj\" (UniqueName: \"kubernetes.io/projected/6e8f1d4f-5365-4470-a390-92e2691b7d89-kube-api-access-bqmqj\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.656324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.656314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-metrics-client-ca\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.662822 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.662791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.757263 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-sys\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757263 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-textfile\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757263 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-root\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmqj\" (UniqueName: \"kubernetes.io/projected/6e8f1d4f-5365-4470-a390-92e2691b7d89-kube-api-access-bqmqj\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-sys\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-root\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-metrics-client-ca\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-accelerators-collector-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-tls\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-wtmp\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757759 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-textfile\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757759 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-wtmp\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.757923 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.757903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-metrics-client-ca\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.758088 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.758068 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-accelerators-collector-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.759754 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.759734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-tls\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.759823 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.759746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e8f1d4f-5365-4470-a390-92e2691b7d89-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.765114 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.765092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmqj\" (UniqueName: \"kubernetes.io/projected/6e8f1d4f-5365-4470-a390-92e2691b7d89-kube-api-access-bqmqj\") pod \"node-exporter-xw5nf\" (UID: \"6e8f1d4f-5365-4470-a390-92e2691b7d89\") " pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.812206 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.812186 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xw5nf" Jun 10 16:48:35.822033 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:35.822011 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8f1d4f_5365_4470_a390_92e2691b7d89.slice/crio-7f3bad6dff4309a285f103d979df70dde5fb996b2c40ee151bf9b665b8e044c1 WatchSource:0}: Error finding container 7f3bad6dff4309a285f103d979df70dde5fb996b2c40ee151bf9b665b8e044c1: Status 404 returned error can't find the container with id 7f3bad6dff4309a285f103d979df70dde5fb996b2c40ee151bf9b665b8e044c1 Jun 10 16:48:35.861409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.861388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:35.980087 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:35.980065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:36.461286 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.461249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:36.536998 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.536971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:36.660777 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.660745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:36.718464 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.718413 2559 generic.go:356] "Generic (PLEG): container finished" podID="6e8f1d4f-5365-4470-a390-92e2691b7d89" containerID="d1b31b4286b76fe86a0e47bff581836242689ec71ddef38049ba28fb607258fb" exitCode=0 Jun 10 16:48:36.718547 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.718489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xw5nf" event={"ID":"6e8f1d4f-5365-4470-a390-92e2691b7d89","Type":"ContainerDied","Data":"d1b31b4286b76fe86a0e47bff581836242689ec71ddef38049ba28fb607258fb"} Jun 10 16:48:36.718585 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:36.718571 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xw5nf" event={"ID":"6e8f1d4f-5365-4470-a390-92e2691b7d89","Type":"ContainerStarted","Data":"7f3bad6dff4309a285f103d979df70dde5fb996b2c40ee151bf9b665b8e044c1"} Jun 10 16:48:37.095126 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:37.095054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:37.724120 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:37.724087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xw5nf" event={"ID":"6e8f1d4f-5365-4470-a390-92e2691b7d89","Type":"ContainerStarted","Data":"0d7952bd85370f3c1b03908c6ff8a639ee3f9cb9440f0dbbfacc766aea553984"} Jun 10 16:48:37.724471 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:37.724156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xw5nf" event={"ID":"6e8f1d4f-5365-4470-a390-92e2691b7d89","Type":"ContainerStarted","Data":"fecb7d3e5a625bc0a4aef07f564dbe0db3300a9c98d7761346d093f27774ff5b"} Jun 10 16:48:37.743943 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:37.743898 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xw5nf" podStartSLOduration=1.9388707840000001 podStartE2EDuration="2.743882062s" totalImagesPullingTime="741.758166ms" totalInitContainerRuntime="63.253112ms" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:37.742234411 +0000 UTC m=+233.161195951" watchObservedRunningTime="2026-06-10 16:48:37.743882062 +0000 UTC m=+233.162843655" Jun 10 16:48:38.414212 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:38.414185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:38.496227 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:38.496193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:38.606079 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:38.606047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:38.703620 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:38.703553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:38.766139 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:38.766117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:39.964905 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:39.964872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.079333 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.079302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.256904 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.256827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.317793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.317766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.496932 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.496907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.599857 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.599735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:40.630291 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.630254 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:40.630382 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:40.630310 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:41.699268 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:41.699230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:41.959348 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:41.959263 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:42.670744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:42.670713 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:42.670910 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:42.670764 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:49.901052 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:49.901008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:49.957388 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:49.957355 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:50.630586 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:50.630556 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:50.630749 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:50.630604 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:52.109865 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.109832 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:48:52.114056 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.114036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.117323 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117214 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 16:48:52.117323 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 16:48:52.117534 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 16:48:52.117619 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117596 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 16:48:52.117723 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 16:48:52.117825 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117790 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lcnrc\"" Jun 10 16:48:52.117870 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117845 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 16:48:52.117960 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.117942 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 16:48:52.122194 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.122175 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 16:48:52.124556 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.124531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:48:52.173182 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvbw\" (UniqueName: \"kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173309 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173309 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173309 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173473 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173473 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.173473 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.173383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274275 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274400 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274400 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274400 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274400 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274400 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvbw\" (UniqueName: \"kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.274667 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.274422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.275106 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.275080 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.275206 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.275115 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.275206 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.275140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.275575 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.275553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.276774 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.276760 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.276934 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.276917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.281999 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.281978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvbw\" (UniqueName: \"kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw\") pod \"console-74f4675bd-69v5p\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.424573 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.424550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:48:52.525521 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.525491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:52.571418 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.571390 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:48:52.574047 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:52.574024 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bb9b35_4835_42d6_a903_63e076f53f87.slice/crio-c453f8c85fd2582707fa540e6bed109c659507479e33dc058d39f52cef6477ba WatchSource:0}: Error finding container c453f8c85fd2582707fa540e6bed109c659507479e33dc058d39f52cef6477ba: Status 404 returned error can't find the container with id c453f8c85fd2582707fa540e6bed109c659507479e33dc058d39f52cef6477ba Jun 10 16:48:52.625858 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.625827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:52.670141 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.670118 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:52.670231 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.670161 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:52.775306 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.775251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f4675bd-69v5p" event={"ID":"31bb9b35-4835-42d6-a903-63e076f53f87","Type":"ContainerStarted","Data":"c453f8c85fd2582707fa540e6bed109c659507479e33dc058d39f52cef6477ba"} Jun 10 16:48:52.905775 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.905745 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:52.965005 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:52.964981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:55.990362 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:55.990326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:56.090564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.090495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:56.190784 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.190760 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:56.790072 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.790044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f4675bd-69v5p" event={"ID":"31bb9b35-4835-42d6-a903-63e076f53f87","Type":"ContainerStarted","Data":"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5"} Jun 10 16:48:56.807338 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.807292 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f4675bd-69v5p" podStartSLOduration=1.5592805250000001 podStartE2EDuration="4.807278066s" totalImagesPullingTime="3.247997541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:56.806434131 +0000 UTC m=+252.225395670" watchObservedRunningTime="2026-06-10 16:48:56.807278066 +0000 UTC m=+252.226239604" Jun 10 16:48:56.821330 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.821302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:48:56.823702 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:56.823677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b081f2c5-6532-4993-8d4c-5c489eaad0de-metrics-certs\") pod \"network-metrics-daemon-gmcfv\" (UID: \"b081f2c5-6532-4993-8d4c-5c489eaad0de\") " pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:48:57.089127 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:57.089041 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:48:57.097161 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:57.097142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmcfv" Jun 10 16:48:57.213317 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:57.213297 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gmcfv"] Jun 10 16:48:57.215928 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:48:57.215902 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb081f2c5_6532_4993_8d4c_5c489eaad0de.slice/crio-b03c6059830089ca5fe24e9c7c3c0bf598f55d7890f9f098db252eaf1c52481f WatchSource:0}: Error finding container b03c6059830089ca5fe24e9c7c3c0bf598f55d7890f9f098db252eaf1c52481f: Status 404 returned error can't find the container with id b03c6059830089ca5fe24e9c7c3c0bf598f55d7890f9f098db252eaf1c52481f Jun 10 16:48:57.797990 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:57.797956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmcfv" event={"ID":"b081f2c5-6532-4993-8d4c-5c489eaad0de","Type":"ContainerStarted","Data":"b03c6059830089ca5fe24e9c7c3c0bf598f55d7890f9f098db252eaf1c52481f"} Jun 10 16:48:58.802952 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:58.802922 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmcfv" event={"ID":"b081f2c5-6532-4993-8d4c-5c489eaad0de","Type":"ContainerStarted","Data":"eb4dfd5cde034699a7aa7c27f90051f5acb1e9b789487e3ec9c8b11b0c856d72"} Jun 10 16:48:58.803303 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:58.803000 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmcfv" event={"ID":"b081f2c5-6532-4993-8d4c-5c489eaad0de","Type":"ContainerStarted","Data":"bab6622b870bf2d11c1afa63b10ceb83993568fd15cdecf9fc0acbeff4b962b4"} Jun 10 16:48:58.819674 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:58.819623 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gmcfv" podStartSLOduration=252.912774645 podStartE2EDuration="4m13.819609675s" totalImagesPullingTime="906.83503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:58.818173055 +0000 UTC m=+254.237134594" watchObservedRunningTime="2026-06-10 16:48:58.819609675 +0000 UTC m=+254.238571214" Jun 10 16:48:58.907541 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:58.907513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:48:58.970399 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:48:58.970369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:00.379647 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.379618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:00.482865 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.482843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:00.629708 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.629635 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:00.629708 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.629679 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:00.629917 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.629714 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:49:00.630232 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.630190 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"fa604f4ad2d0d60352df058ef3c082254366ce6edfa10660e04912e003ff2a7d"} pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 16:49:00.633702 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.633672 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:00.633818 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.633717 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:00.941691 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:00.941668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:01.042827 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:01.042784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:01.142438 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:01.142403 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:01.307352 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:01.307295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:01.358661 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:01.358636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:02.425067 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:02.425039 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:49:02.425442 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:02.425116 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:49:02.426521 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:02.426498 2559 patch_prober.go:28] interesting pod/console-74f4675bd-69v5p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 10 16:49:02.426616 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:02.426553 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74f4675bd-69v5p" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 10 16:49:03.304531 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:03.304488 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:03.360034 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:03.360009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:10.635427 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:10.635389 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:10.635825 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:10.635450 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:12.425040 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:12.425007 2559 patch_prober.go:28] interesting pod/console-74f4675bd-69v5p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 10 16:49:12.425404 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:12.425056 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74f4675bd-69v5p" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 10 16:49:13.004277 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:13.004246 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:13.061107 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:13.061073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:14.583586 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:14.583557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/init-textfile/0.log" Jun 10 16:49:14.784655 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:14.784623 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/node-exporter/0.log" Jun 10 16:49:14.984533 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:14.984493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/kube-rbac-proxy/0.log" Jun 10 16:49:16.792087 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:16.792018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:19.584711 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:19.584680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-kmhdr_7f4c6d36-0207-4be5-b10b-979b0a642148/networking-console-plugin/0.log" Jun 10 16:49:20.184269 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:20.184239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f4675bd-69v5p_31bb9b35-4835-42d6-a903-63e076f53f87/console/0.log" Jun 10 16:49:20.634931 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:20.634840 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:20.634931 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:20.634900 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:22.184282 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.184250 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksg46_7331b2fa-118f-4781-b732-560f49f1ab62/dns-node-resolver/0.log" Jun 10 16:49:22.425569 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.425536 2559 patch_prober.go:28] interesting pod/console-74f4675bd-69v5p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 10 16:49:22.425703 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.425593 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74f4675bd-69v5p" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 10 16:49:22.520015 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.519918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:22.575706 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.575674 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:22.785234 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:22.785151 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75fb6474df-vjnv9_112db6fa-3a90-4fa0-9dcb-9db7162cd1b2/registry/0.log" Jun 10 16:49:23.184419 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:23.184393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7htg_7cd0a680-3a66-442b-8d8b-3980a1a11c19/node-ca/0.log" Jun 10 16:49:24.183539 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:24.183506 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknq8_716d615a-3a84-4647-9d52-1fd0ad695bfb/serve-healthcheck-canary/0.log" Jun 10 16:49:25.498360 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:49:25.498323 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z72fb" podUID="9f61e0b1-d9da-4505-ad15-204dfea8723e" Jun 10 16:49:25.648606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:25.648562 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" containerID="cri-o://fa604f4ad2d0d60352df058ef3c082254366ce6edfa10660e04912e003ff2a7d" gracePeriod=30 Jun 10 16:49:25.893160 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:25.893057 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:26.899468 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:26.899433 2559 generic.go:356] "Generic (PLEG): container finished" podID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerID="fa604f4ad2d0d60352df058ef3c082254366ce6edfa10660e04912e003ff2a7d" exitCode=0 Jun 10 16:49:26.899867 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:26.899470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" event={"ID":"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2","Type":"ContainerDied","Data":"fa604f4ad2d0d60352df058ef3c082254366ce6edfa10660e04912e003ff2a7d"} Jun 10 16:49:26.899867 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:26.899542 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" event={"ID":"112db6fa-3a90-4fa0-9dcb-9db7162cd1b2","Type":"ContainerStarted","Data":"c025c6bc76786387f4e3f9a3a89ea1daf27f8120c086c99fd9b49e1b74ee12c1"} Jun 10 16:49:26.899867 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:26.899732 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:49:28.863992 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:28.863956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:28.866361 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:28.866340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f61e0b1-d9da-4505-ad15-204dfea8723e-metrics-tls\") pod \"dns-default-z72fb\" (UID: \"9f61e0b1-d9da-4505-ad15-204dfea8723e\") " pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:28.896833 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:28.896785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:49:28.904672 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:28.904653 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:29.035620 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:29.035584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z72fb"] Jun 10 16:49:29.038708 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:49:29.038673 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f61e0b1_d9da_4505_ad15_204dfea8723e.slice/crio-aff158b3a171a4b26daf487f56ea9c5b4413c788fac37eb6412d6d5ad2e6819e WatchSource:0}: Error finding container aff158b3a171a4b26daf487f56ea9c5b4413c788fac37eb6412d6d5ad2e6819e: Status 404 returned error can't find the container with id aff158b3a171a4b26daf487f56ea9c5b4413c788fac37eb6412d6d5ad2e6819e Jun 10 16:49:29.911868 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:29.911822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72fb" event={"ID":"9f61e0b1-d9da-4505-ad15-204dfea8723e","Type":"ContainerStarted","Data":"aff158b3a171a4b26daf487f56ea9c5b4413c788fac37eb6412d6d5ad2e6819e"} Jun 10 16:49:30.916861 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:30.916804 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72fb" event={"ID":"9f61e0b1-d9da-4505-ad15-204dfea8723e","Type":"ContainerStarted","Data":"1a109b21df01cda267a361e1af00dbfc1255d9ec6a83e34a75701db2084c6284"} Jun 10 16:49:30.917270 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:30.916889 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72fb" event={"ID":"9f61e0b1-d9da-4505-ad15-204dfea8723e","Type":"ContainerStarted","Data":"61469a3b4a31a8d5a9c641f795de7f83d135e38b2b84d14fd6e49b3b8104ec4f"} Jun 10 16:49:30.917270 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:30.916983 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:30.933167 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:30.933117 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z72fb" podStartSLOduration=251.425327556 podStartE2EDuration="4m12.933101267s" totalImagesPullingTime="1.507773711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:30.931971482 +0000 UTC m=+286.350933020" watchObservedRunningTime="2026-06-10 16:49:30.933101267 +0000 UTC m=+286.352062806" Jun 10 16:49:32.044919 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:32.044886 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:32.144960 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:32.144926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:32.425578 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:32.425549 2559 patch_prober.go:28] interesting pod/console-74f4675bd-69v5p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 10 16:49:32.425747 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:32.425602 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74f4675bd-69v5p" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 10 16:49:32.894064 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:32.893970 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" podUID="f9ce4458-8bc3-4568-8d70-fa215a598780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 16:49:40.632235 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:40.632199 2559 patch_prober.go:28] interesting pod/image-registry-75fb6474df-vjnv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:49:40.632729 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:40.632253 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" podUID="112db6fa-3a90-4fa0-9dcb-9db7162cd1b2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:49:40.922865 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:40.922836 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z72fb" Jun 10 16:49:41.745095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:41.745055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:41.798778 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:41.798741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:42.290032 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.289990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:42.429095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.429067 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:49:42.432764 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.432742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:49:42.587606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.587515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:42.638372 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.638343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:42.698535 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.698505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:42.894300 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.894213 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" podUID="f9ce4458-8bc3-4568-8d70-fa215a598780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 16:49:42.951788 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:42.951750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:43.003063 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:43.003019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:43.768053 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:43.768015 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:43.868795 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:43.868754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:43.921450 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:43.921419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:44.943674 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:44.943647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:49:44.944373 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:44.944353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:49:44.948859 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:44.948838 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 16:49:47.908261 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:47.908232 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75fb6474df-vjnv9" Jun 10 16:49:48.058536 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:48.058499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:48.158781 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:48.158690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:48.258596 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:48.258565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:48.314082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:48.314055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:51.600901 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:51.600865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:51.679300 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:51.679261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:52.894410 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:52.894373 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" podUID="f9ce4458-8bc3-4568-8d70-fa215a598780" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 16:49:52.894826 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:52.894444 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" Jun 10 16:49:52.895030 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:52.895012 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b554e712f5da41e389dcabb6353e2baa9894ab64c503ffc7367f512b643fd249"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 16:49:52.895078 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:52.895056 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" podUID="f9ce4458-8bc3-4568-8d70-fa215a598780" containerName="service-proxy" containerID="cri-o://b554e712f5da41e389dcabb6353e2baa9894ab64c503ffc7367f512b643fd249" gracePeriod=30 Jun 10 16:49:53.471920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.471885 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:49:53.475192 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.475169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.485647 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.485622 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:49:53.511145 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.511112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:53.546273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s78h\" (UniqueName: \"kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.546606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.546477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.608340 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.608308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:53.647465 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647731 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s78h\" (UniqueName: \"kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647731 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647944 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.647944 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.647870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.648313 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.648279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.648476 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.648453 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.648557 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.648476 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.648617 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.648591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.650391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.650358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.650489 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.650391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.655539 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.655517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s78h\" (UniqueName: \"kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h\") pod \"console-65c78d4594-6rc92\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.665534 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.665507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:53.784899 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.784801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:49:53.916170 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.916139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:49:53.919095 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:49:53.919067 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90298a36_180b_45f1_8a5a_3eda69f85f1e.slice/crio-1bf36858bf06f8e4f129b3a51a204adcbe998f6e1bc13a4f97e4c18b3052bb2c WatchSource:0}: Error finding container 1bf36858bf06f8e4f129b3a51a204adcbe998f6e1bc13a4f97e4c18b3052bb2c: Status 404 returned error can't find the container with id 1bf36858bf06f8e4f129b3a51a204adcbe998f6e1bc13a4f97e4c18b3052bb2c Jun 10 16:49:53.995432 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.995386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c78d4594-6rc92" event={"ID":"90298a36-180b-45f1-8a5a-3eda69f85f1e","Type":"ContainerStarted","Data":"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2"} Jun 10 16:49:53.995593 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.995445 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c78d4594-6rc92" event={"ID":"90298a36-180b-45f1-8a5a-3eda69f85f1e","Type":"ContainerStarted","Data":"1bf36858bf06f8e4f129b3a51a204adcbe998f6e1bc13a4f97e4c18b3052bb2c"} Jun 10 16:49:53.997967 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.997942 2559 generic.go:356] "Generic (PLEG): container finished" podID="f9ce4458-8bc3-4568-8d70-fa215a598780" containerID="b554e712f5da41e389dcabb6353e2baa9894ab64c503ffc7367f512b643fd249" exitCode=2 Jun 10 16:49:53.997967 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.997975 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerDied","Data":"b554e712f5da41e389dcabb6353e2baa9894ab64c503ffc7367f512b643fd249"} Jun 10 16:49:53.998165 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:53.998001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db74d589c-9x2k8" event={"ID":"f9ce4458-8bc3-4568-8d70-fa215a598780","Type":"ContainerStarted","Data":"a5ca7b12462d2fd62116183f3bc8bc7131eae270a13a17f55370aca5f4bf05a0"} Jun 10 16:49:54.013394 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:54.013347 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65c78d4594-6rc92" podStartSLOduration=1.013332429 podStartE2EDuration="1.013332429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:54.012167791 +0000 UTC m=+309.431129329" watchObservedRunningTime="2026-06-10 16:49:54.013332429 +0000 UTC m=+309.432293967" Jun 10 16:49:54.694094 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:54.694056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:54.795186 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:54.795150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:57.130863 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:57.130828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:49:57.231588 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:49:57.231557 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:02.600574 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:02.600540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:02.662327 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:02.662300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:03.785328 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:03.785291 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:50:03.785749 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:03.785360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:50:03.790395 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:03.790371 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:50:04.034800 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:04.034777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:50:04.082253 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:04.082189 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:50:04.193749 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:04.193718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:04.294638 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:04.294607 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:04.350526 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:04.350467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:07.547871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:07.547831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:07.647627 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:07.647594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:22.535062 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:22.535024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:22.633377 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:22.633344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:29.107998 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.107961 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74f4675bd-69v5p" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" containerID="cri-o://4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5" gracePeriod=15 Jun 10 16:50:29.351386 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.351359 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:50:29.385647 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385590 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385647 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385625 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctvbw\" (UniqueName: \"kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385649 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385674 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385713 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385751 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385989 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385829 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert\") pod \"31bb9b35-4835-42d6-a903-63e076f53f87\" (UID: \"31bb9b35-4835-42d6-a903-63e076f53f87\") " Jun 10 16:50:29.385989 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.385941 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config" (OuterVolumeSpecName: "console-config") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:29.386093 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.386053 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.386243 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.386171 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:29.386243 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.386183 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:29.386357 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.386271 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca" (OuterVolumeSpecName: "service-ca") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:29.387842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.387799 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw" (OuterVolumeSpecName: "kube-api-access-ctvbw") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "kube-api-access-ctvbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:29.387842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.387834 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:29.387983 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.387802 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31bb9b35-4835-42d6-a903-63e076f53f87" (UID: "31bb9b35-4835-42d6-a903-63e076f53f87"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:29.487015 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.486987 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctvbw\" (UniqueName: \"kubernetes.io/projected/31bb9b35-4835-42d6-a903-63e076f53f87-kube-api-access-ctvbw\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.487015 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.487010 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.487140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.487020 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-trusted-ca-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.487140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.487029 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.487140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.487038 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31bb9b35-4835-42d6-a903-63e076f53f87-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:29.487140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:29.487046 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31bb9b35-4835-42d6-a903-63e076f53f87-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:50:30.114454 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.114423 2559 generic.go:356] "Generic (PLEG): container finished" podID="31bb9b35-4835-42d6-a903-63e076f53f87" containerID="4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5" exitCode=0 Jun 10 16:50:30.114871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.114468 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f4675bd-69v5p" Jun 10 16:50:30.114871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.114470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f4675bd-69v5p" event={"ID":"31bb9b35-4835-42d6-a903-63e076f53f87","Type":"ContainerDied","Data":"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5"} Jun 10 16:50:30.114871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.114516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f4675bd-69v5p" event={"ID":"31bb9b35-4835-42d6-a903-63e076f53f87","Type":"ContainerDied","Data":"c453f8c85fd2582707fa540e6bed109c659507479e33dc058d39f52cef6477ba"} Jun 10 16:50:30.114871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.114546 2559 scope.go:117] "RemoveContainer" containerID="4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5" Jun 10 16:50:30.130113 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.130093 2559 scope.go:117] "RemoveContainer" containerID="4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5" Jun 10 16:50:30.130385 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:50:30.130365 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5\": container with ID starting with 4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5 not found: ID does not exist" containerID="4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5" Jun 10 16:50:30.130449 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.130400 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5"} err="failed to get container status \"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5\": rpc error: code = NotFound desc = could not find container \"4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5\": container with ID starting with 4c556faa907d22ad0b7f21816c18e7904f803763ba78ec387600a6235aed56f5 not found: ID does not exist" Jun 10 16:50:30.138462 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.138440 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:50:30.145453 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.145429 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f4675bd-69v5p"] Jun 10 16:50:30.991014 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:30.990982 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" path="/var/lib/kubelet/pods/31bb9b35-4835-42d6-a903-63e076f53f87/volumes" Jun 10 16:50:38.809703 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:38.809601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:38.878105 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:38.878061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:42.915466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:42.915431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:50:58.203330 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:50:58.203294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:51:23.727441 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:23.727408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:51:43.857241 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:43.857200 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:51:43.955938 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:43.955907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:51:44.527258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.523704 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56"] Jun 10 16:51:44.527258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.524286 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" Jun 10 16:51:44.527258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.524306 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" Jun 10 16:51:44.527258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.524452 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31bb9b35-4835-42d6-a903-63e076f53f87" containerName="console" Jun 10 16:51:44.528421 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.528385 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.531217 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.531195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:51:44.531342 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.531220 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:51:44.531952 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.531933 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:51:44.534944 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.534902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56"] Jun 10 16:51:44.660413 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.660388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.660543 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.660449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.660543 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.660477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm64j\" (UniqueName: \"kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.760773 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.760736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.760773 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.760777 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm64j\" (UniqueName: \"kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.760988 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.760829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.761220 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.761197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.761292 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.761220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.769083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.769060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm64j\" (UniqueName: \"kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.839005 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.838935 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:51:44.969137 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.969018 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56"] Jun 10 16:51:44.971634 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:51:44.971608 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda539d797_5fe4_4713_8123_8d56e7713c43.slice/crio-a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051 WatchSource:0}: Error finding container a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051: Status 404 returned error can't find the container with id a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051 Jun 10 16:51:44.973510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:44.973490 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:51:45.377771 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:45.377738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" event={"ID":"a539d797-5fe4-4713-8123-8d56e7713c43","Type":"ContainerStarted","Data":"a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051"} Jun 10 16:51:50.397776 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:50.397700 2559 generic.go:356] "Generic (PLEG): container finished" podID="a539d797-5fe4-4713-8123-8d56e7713c43" containerID="4ec429afe0ba17a498b9090bade92aeb5874a1555bf8998eeebf6e3c3bf5acfd" exitCode=0 Jun 10 16:51:50.398174 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:50.397780 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" event={"ID":"a539d797-5fe4-4713-8123-8d56e7713c43","Type":"ContainerDied","Data":"4ec429afe0ba17a498b9090bade92aeb5874a1555bf8998eeebf6e3c3bf5acfd"} Jun 10 16:51:53.410073 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:53.410032 2559 generic.go:356] "Generic (PLEG): container finished" podID="a539d797-5fe4-4713-8123-8d56e7713c43" containerID="4c3dbde901df75458cddd4efe52e29c6df393eeb8750afa09fc0adf1005f9f5e" exitCode=0 Jun 10 16:51:53.410578 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:51:53.410099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" event={"ID":"a539d797-5fe4-4713-8123-8d56e7713c43","Type":"ContainerDied","Data":"4c3dbde901df75458cddd4efe52e29c6df393eeb8750afa09fc0adf1005f9f5e"} Jun 10 16:52:01.442746 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:01.442719 2559 generic.go:356] "Generic (PLEG): container finished" podID="a539d797-5fe4-4713-8123-8d56e7713c43" containerID="c807d2a4e5a665b0cc7b9f2335f33e4645bfc80edb7fb9d2c767b1648873954c" exitCode=0 Jun 10 16:52:01.443054 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:01.442803 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" event={"ID":"a539d797-5fe4-4713-8123-8d56e7713c43","Type":"ContainerDied","Data":"c807d2a4e5a665b0cc7b9f2335f33e4645bfc80edb7fb9d2c767b1648873954c"} Jun 10 16:52:02.568604 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.568582 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:52:02.682984 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.682955 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm64j\" (UniqueName: \"kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j\") pod \"a539d797-5fe4-4713-8123-8d56e7713c43\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " Jun 10 16:52:02.683125 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.683015 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util\") pod \"a539d797-5fe4-4713-8123-8d56e7713c43\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " Jun 10 16:52:02.683125 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.683063 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle\") pod \"a539d797-5fe4-4713-8123-8d56e7713c43\" (UID: \"a539d797-5fe4-4713-8123-8d56e7713c43\") " Jun 10 16:52:02.683721 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.683692 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle" (OuterVolumeSpecName: "bundle") pod "a539d797-5fe4-4713-8123-8d56e7713c43" (UID: "a539d797-5fe4-4713-8123-8d56e7713c43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:02.685062 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.685029 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j" (OuterVolumeSpecName: "kube-api-access-zm64j") pod "a539d797-5fe4-4713-8123-8d56e7713c43" (UID: "a539d797-5fe4-4713-8123-8d56e7713c43"). InnerVolumeSpecName "kube-api-access-zm64j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:52:02.686955 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.686934 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util" (OuterVolumeSpecName: "util") pod "a539d797-5fe4-4713-8123-8d56e7713c43" (UID: "a539d797-5fe4-4713-8123-8d56e7713c43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:02.783724 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.783668 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:02.783724 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.783699 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm64j\" (UniqueName: \"kubernetes.io/projected/a539d797-5fe4-4713-8123-8d56e7713c43-kube-api-access-zm64j\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:02.783724 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:02.783713 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a539d797-5fe4-4713-8123-8d56e7713c43-util\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:03.451541 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:03.451520 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" Jun 10 16:52:03.451541 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:03.451533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dqfw56" event={"ID":"a539d797-5fe4-4713-8123-8d56e7713c43","Type":"ContainerDied","Data":"a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051"} Jun 10 16:52:03.451719 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:03.451577 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4f49e2cad243ef68f917ea30e8d087556324b4a42e388b16c1627ec41a8c051" Jun 10 16:52:05.499139 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:05.499105 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:06.484719 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:06.484683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:09.121590 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:09.121558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:09.224490 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:09.224457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:10.467864 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:10.467821 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:10.583534 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:10.583483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:10.743690 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:10.743617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:13.994817 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:13.994763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:14.210521 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:14.210493 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:15.704706 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:15.704663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:15.771074 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:15.771038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:21.401735 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:21.401678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:22.504390 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:22.504360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:22.565293 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:22.565264 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:23.258956 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.258923 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2mmt4"] Jun 10 16:52:23.259182 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259168 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="extract" Jun 10 16:52:23.259226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259184 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="extract" Jun 10 16:52:23.259226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259194 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="util" Jun 10 16:52:23.259226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259200 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="util" Jun 10 16:52:23.259226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259206 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="pull" Jun 10 16:52:23.259226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259212 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="pull" Jun 10 16:52:23.259451 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.259275 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a539d797-5fe4-4713-8123-8d56e7713c43" containerName="extract" Jun 10 16:52:23.263200 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.263181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.265407 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.265386 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 16:52:23.265504 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.265425 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 16:52:23.265504 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.265460 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6qm25\"" Jun 10 16:52:23.269542 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.269521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2mmt4"] Jun 10 16:52:23.412849 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.412826 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-bound-sa-token\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.412938 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.412866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq8vr\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-kube-api-access-wq8vr\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.513934 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.513881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq8vr\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-kube-api-access-wq8vr\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.513934 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.513931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-bound-sa-token\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.522675 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.522654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-bound-sa-token\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.523098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.523076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq8vr\" (UniqueName: \"kubernetes.io/projected/cc25560c-1f51-438b-bc80-f18ad4be87aa-kube-api-access-wq8vr\") pod \"cert-manager-59c77684cc-2mmt4\" (UID: \"cc25560c-1f51-438b-bc80-f18ad4be87aa\") " pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.572717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.572697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2mmt4" Jun 10 16:52:23.693533 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:23.693435 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2mmt4"] Jun 10 16:52:23.695933 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:52:23.695911 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc25560c_1f51_438b_bc80_f18ad4be87aa.slice/crio-c48ac6a7597a4e730c8029a30e6396acc9216173d68c94636a936164eddebc41 WatchSource:0}: Error finding container c48ac6a7597a4e730c8029a30e6396acc9216173d68c94636a936164eddebc41: Status 404 returned error can't find the container with id c48ac6a7597a4e730c8029a30e6396acc9216173d68c94636a936164eddebc41 Jun 10 16:52:24.525971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:24.525938 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2mmt4" event={"ID":"cc25560c-1f51-438b-bc80-f18ad4be87aa","Type":"ContainerStarted","Data":"c48ac6a7597a4e730c8029a30e6396acc9216173d68c94636a936164eddebc41"} Jun 10 16:52:26.534851 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:26.534822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2mmt4" event={"ID":"cc25560c-1f51-438b-bc80-f18ad4be87aa","Type":"ContainerStarted","Data":"e413692ae979ec6e8ba9536ef8973225779256d695330263c5f93ab8ac06367b"} Jun 10 16:52:26.557298 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:26.557260 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2mmt4" podStartSLOduration=1.322239202 podStartE2EDuration="3.557241053s" totalImagesPullingTime="2.235001851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:26.556727048 +0000 UTC m=+461.975688588" watchObservedRunningTime="2026-06-10 16:52:26.557241053 +0000 UTC m=+461.976202591" Jun 10 16:52:34.039580 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:34.039537 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:34.137417 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:34.137381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:39.832196 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:39.832155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:39.932562 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:39.932534 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:41.735015 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.734984 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs"] Jun 10 16:52:41.737233 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.737212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.739611 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.739587 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:52:41.739688 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.739624 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:52:41.740481 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.740464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:52:41.748531 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.748502 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs"] Jun 10 16:52:41.828436 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.828408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.828554 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.828457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.828554 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.828525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csjnn\" (UniqueName: \"kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.929352 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.929328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.929441 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.929361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csjnn\" (UniqueName: \"kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.929441 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.929394 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.929680 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.929665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.929745 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.929705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:41.939554 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:41.937884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csjnn\" (UniqueName: \"kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:42.042472 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.042396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:42.045861 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.045844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:42.167659 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.167631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs"] Jun 10 16:52:42.170975 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:52:42.170948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05db59b6_ff35_4c53_b4b7_3a215db11132.slice/crio-6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e WatchSource:0}: Error finding container 6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e: Status 404 returned error can't find the container with id 6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e Jun 10 16:52:42.595525 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.595490 2559 generic.go:356] "Generic (PLEG): container finished" podID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerID="9acd19de8f14f61d5e842d0deed1645df7d07ab134f3150d91ad3505c3ad0bff" exitCode=0 Jun 10 16:52:42.595656 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.595568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" event={"ID":"05db59b6-ff35-4c53-b4b7-3a215db11132","Type":"ContainerDied","Data":"9acd19de8f14f61d5e842d0deed1645df7d07ab134f3150d91ad3505c3ad0bff"} Jun 10 16:52:42.595656 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:42.595608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" event={"ID":"05db59b6-ff35-4c53-b4b7-3a215db11132","Type":"ContainerStarted","Data":"6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e"} Jun 10 16:52:43.601195 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:43.601115 2559 generic.go:356] "Generic (PLEG): container finished" podID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerID="fd3869629f998304b19de099c36212520ae5993769bfe2fbb8e47cdb79be5f30" exitCode=0 Jun 10 16:52:43.601577 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:43.601208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" event={"ID":"05db59b6-ff35-4c53-b4b7-3a215db11132","Type":"ContainerDied","Data":"fd3869629f998304b19de099c36212520ae5993769bfe2fbb8e47cdb79be5f30"} Jun 10 16:52:44.606987 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:44.606950 2559 generic.go:356] "Generic (PLEG): container finished" podID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerID="4438dd94faa51b0eeb00ec464c6afadadce067d88f1bb617302457b5cbf384bf" exitCode=0 Jun 10 16:52:44.607370 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:44.607003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" event={"ID":"05db59b6-ff35-4c53-b4b7-3a215db11132","Type":"ContainerDied","Data":"4438dd94faa51b0eeb00ec464c6afadadce067d88f1bb617302457b5cbf384bf"} Jun 10 16:52:45.734817 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.734784 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:45.756860 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.756839 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util\") pod \"05db59b6-ff35-4c53-b4b7-3a215db11132\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " Jun 10 16:52:45.756958 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.756867 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle\") pod \"05db59b6-ff35-4c53-b4b7-3a215db11132\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " Jun 10 16:52:45.756958 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.756916 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csjnn\" (UniqueName: \"kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn\") pod \"05db59b6-ff35-4c53-b4b7-3a215db11132\" (UID: \"05db59b6-ff35-4c53-b4b7-3a215db11132\") " Jun 10 16:52:45.757561 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.757535 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle" (OuterVolumeSpecName: "bundle") pod "05db59b6-ff35-4c53-b4b7-3a215db11132" (UID: "05db59b6-ff35-4c53-b4b7-3a215db11132"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:45.758844 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.758820 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn" (OuterVolumeSpecName: "kube-api-access-csjnn") pod "05db59b6-ff35-4c53-b4b7-3a215db11132" (UID: "05db59b6-ff35-4c53-b4b7-3a215db11132"). InnerVolumeSpecName "kube-api-access-csjnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:52:45.765804 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.765778 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util" (OuterVolumeSpecName: "util") pod "05db59b6-ff35-4c53-b4b7-3a215db11132" (UID: "05db59b6-ff35-4c53-b4b7-3a215db11132"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:45.858045 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.858023 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-util\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:45.858045 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.858042 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05db59b6-ff35-4c53-b4b7-3a215db11132-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:45.858154 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:45.858052 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csjnn\" (UniqueName: \"kubernetes.io/projected/05db59b6-ff35-4c53-b4b7-3a215db11132-kube-api-access-csjnn\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:52:46.615817 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:46.615778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" event={"ID":"05db59b6-ff35-4c53-b4b7-3a215db11132","Type":"ContainerDied","Data":"6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e"} Jun 10 16:52:46.615997 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:46.615850 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c7a4fbca22f25b1ced9cacae239da55a1124d8fe1c391d9ebafaefe72d6742e" Jun 10 16:52:46.615997 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:46.615858 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdmcnbs" Jun 10 16:52:52.894602 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:52.894567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:52.989713 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:52.989681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:54.387349 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:54.387319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:54.529768 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:54.529733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:54.940305 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:54.940273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:55.040763 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:55.040728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:55.208709 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:55.208632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:55.346306 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:55.346276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:55.871837 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:55.871787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.211566 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.211524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.315537 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.315514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.375126 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375104 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-fht26"] Jun 10 16:52:56.375347 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="util" Jun 10 16:52:56.375391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375349 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="util" Jun 10 16:52:56.375391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375356 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="pull" Jun 10 16:52:56.375391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375362 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="pull" Jun 10 16:52:56.375391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375367 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="extract" Jun 10 16:52:56.375391 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375373 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="extract" Jun 10 16:52:56.375624 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.375414 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05db59b6-ff35-4c53-b4b7-3a215db11132" containerName="extract" Jun 10 16:52:56.377905 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.377890 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.383209 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.383189 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 16:52:56.383374 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.383353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 16:52:56.383475 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.383450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 16:52:56.383623 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.383607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 16:52:56.385519 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.385501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dr7hr\"" Jun 10 16:52:56.400260 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.400242 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-fht26"] Jun 10 16:52:56.424425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.424400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.424510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.424438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.424510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.424474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.424602 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.424507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4pq\" (UniqueName: \"kubernetes.io/projected/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-kube-api-access-st4pq\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.424602 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.424542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.524959 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.524898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.524959 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.524950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.525104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.524998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.525104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.525037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.525104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.525065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4pq\" (UniqueName: \"kubernetes.io/projected/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-kube-api-access-st4pq\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.525413 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.525392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.527436 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.527409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.527510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.527483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.527510 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.527493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.532513 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.532489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.533100 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.533082 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4pq\" (UniqueName: \"kubernetes.io/projected/7e57c342-3a3d-4c25-aeab-aab5a8bf6820-kube-api-access-st4pq\") pod \"opendatahub-operator-controller-manager-696f888447-fht26\" (UID: \"7e57c342-3a3d-4c25-aeab-aab5a8bf6820\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.653185 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.653159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.687095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.687056 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:52:56.743263 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.743231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.817000 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.816976 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-fht26"] Jun 10 16:52:56.819747 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:52:56.819719 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e57c342_3a3d_4c25_aeab_aab5a8bf6820.slice/crio-6a63eb8b4f36e6c3df2e9f06ec713efab08fe2134b6abeeaed6f101072c6e728 WatchSource:0}: Error finding container 6a63eb8b4f36e6c3df2e9f06ec713efab08fe2134b6abeeaed6f101072c6e728: Status 404 returned error can't find the container with id 6a63eb8b4f36e6c3df2e9f06ec713efab08fe2134b6abeeaed6f101072c6e728 Jun 10 16:52:56.823636 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.823581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.893717 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.893693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:56.991570 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:56.991543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:52:57.658574 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:52:57.658532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" event={"ID":"7e57c342-3a3d-4c25-aeab-aab5a8bf6820","Type":"ContainerStarted","Data":"6a63eb8b4f36e6c3df2e9f06ec713efab08fe2134b6abeeaed6f101072c6e728"} Jun 10 16:53:00.672258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:00.672229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" event={"ID":"7e57c342-3a3d-4c25-aeab-aab5a8bf6820","Type":"ContainerStarted","Data":"0055e123e9ffddc3ba20dffbb08a26665af1c27d4b015a711cb6bc84a35ecc6c"} Jun 10 16:53:01.678167 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:01.678136 2559 generic.go:356] "Generic (PLEG): container finished" podID="7e57c342-3a3d-4c25-aeab-aab5a8bf6820" containerID="0055e123e9ffddc3ba20dffbb08a26665af1c27d4b015a711cb6bc84a35ecc6c" exitCode=0 Jun 10 16:53:01.678571 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:01.678191 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" event={"ID":"7e57c342-3a3d-4c25-aeab-aab5a8bf6820","Type":"ContainerDied","Data":"0055e123e9ffddc3ba20dffbb08a26665af1c27d4b015a711cb6bc84a35ecc6c"} Jun 10 16:53:02.684137 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:02.684102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" event={"ID":"7e57c342-3a3d-4c25-aeab-aab5a8bf6820","Type":"ContainerStarted","Data":"9f141f84c078d4d359c381a73ad22e1a7ea022c6f267cf769303d48bcd5a7b9e"} Jun 10 16:53:02.684546 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:02.684254 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:53:02.705547 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:02.705501 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" podStartSLOduration=2.4580003440000002 podStartE2EDuration="6.705487024s" totalImagesPullingTime="3.340346343s" totalInitContainerRuntime="907.140337ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:02.704663876 +0000 UTC m=+498.123625417" watchObservedRunningTime="2026-06-10 16:53:02.705487024 +0000 UTC m=+498.124448559" Jun 10 16:53:07.159060 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:07.159012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:07.252073 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:07.252043 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:13.695162 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:13.695128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-fht26" Jun 10 16:53:15.453680 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:15.453648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:15.568480 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:15.568453 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:15.861711 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:15.861634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.006065 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.006036 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.116858 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.116788 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf"] Jun 10 16:53:16.121412 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.121390 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.125012 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.124988 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 16:53:16.125284 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.125268 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 16:53:16.125967 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.125934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 16:53:16.126101 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.125990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4q92m\"" Jun 10 16:53:16.126101 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.125990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 16:53:16.147849 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.147827 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf"] Jun 10 16:53:16.158597 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.158574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkvp\" (UniqueName: \"kubernetes.io/projected/362cae75-205e-4d0e-9d2d-cc1065feb9c3-kube-api-access-mpkvp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.158688 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.158616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.158688 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.158633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tmp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.259758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.259730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkvp\" (UniqueName: \"kubernetes.io/projected/362cae75-205e-4d0e-9d2d-cc1065feb9c3-kube-api-access-mpkvp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.259885 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.259782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.259885 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.259822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tmp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.262029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.262006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tmp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.262140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.262122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362cae75-205e-4d0e-9d2d-cc1065feb9c3-tls-certs\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.271904 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.271883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkvp\" (UniqueName: \"kubernetes.io/projected/362cae75-205e-4d0e-9d2d-cc1065feb9c3-kube-api-access-mpkvp\") pod \"kube-auth-proxy-67bbd649b8-f7fhf\" (UID: \"362cae75-205e-4d0e-9d2d-cc1065feb9c3\") " pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.274370 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.274345 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-49hrq"] Jun 10 16:53:16.276950 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.276933 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.279039 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.279015 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 16:53:16.279128 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.279070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5w2gk\"" Jun 10 16:53:16.303857 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.303834 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-49hrq"] Jun 10 16:53:16.336926 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.336900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.360758 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.360740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.360878 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.360776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rckww\" (UniqueName: \"kubernetes.io/projected/7fbf7d40-e066-4fe6-8eda-94c74472e539-kube-api-access-rckww\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.430785 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.430766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" Jun 10 16:53:16.442314 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.442287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.461907 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.461885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.462202 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.461926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rckww\" (UniqueName: \"kubernetes.io/projected/7fbf7d40-e066-4fe6-8eda-94c74472e539-kube-api-access-rckww\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.462202 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:53:16.462032 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 16:53:16.462202 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:53:16.462087 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert podName:7fbf7d40-e066-4fe6-8eda-94c74472e539 nodeName:}" failed. No retries permitted until 2026-06-10 16:53:16.962071797 +0000 UTC m=+512.381033314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert") pod "odh-model-controller-6dc94f689f-49hrq" (UID: "7fbf7d40-e066-4fe6-8eda-94c74472e539") : secret "odh-model-controller-webhook-cert" not found Jun 10 16:53:16.482323 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.482302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rckww\" (UniqueName: \"kubernetes.io/projected/7fbf7d40-e066-4fe6-8eda-94c74472e539-kube-api-access-rckww\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.538320 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.538288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.569845 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.569794 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf"] Jun 10 16:53:16.572496 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:16.572473 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362cae75_205e_4d0e_9d2d_cc1065feb9c3.slice/crio-27978edb835c304ae79a90560a9b242bf26008d107b9e92d0d911d016382ddaa WatchSource:0}: Error finding container 27978edb835c304ae79a90560a9b242bf26008d107b9e92d0d911d016382ddaa: Status 404 returned error can't find the container with id 27978edb835c304ae79a90560a9b242bf26008d107b9e92d0d911d016382ddaa Jun 10 16:53:16.748655 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.748594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" event={"ID":"362cae75-205e-4d0e-9d2d-cc1065feb9c3","Type":"ContainerStarted","Data":"27978edb835c304ae79a90560a9b242bf26008d107b9e92d0d911d016382ddaa"} Jun 10 16:53:16.798167 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.798143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:16.966406 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.966378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:16.968744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:16.968722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fbf7d40-e066-4fe6-8eda-94c74472e539-cert\") pod \"odh-model-controller-6dc94f689f-49hrq\" (UID: \"7fbf7d40-e066-4fe6-8eda-94c74472e539\") " pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:17.082325 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.082271 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-v7jcm"] Jun 10 16:53:17.084836 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.084819 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.091526 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.091509 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 16:53:17.127398 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.127380 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-v7jcm"] Jun 10 16:53:17.149665 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.149640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:17.168290 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.168263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/003fa5ff-0f76-4208-a81d-e8dfcab3768c-tls-certs\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.168407 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.168383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml996\" (UniqueName: \"kubernetes.io/projected/003fa5ff-0f76-4208-a81d-e8dfcab3768c-kube-api-access-ml996\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.187279 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.187259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:17.221612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.221587 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:17.269018 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.268988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml996\" (UniqueName: \"kubernetes.io/projected/003fa5ff-0f76-4208-a81d-e8dfcab3768c-kube-api-access-ml996\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.269141 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.269052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/003fa5ff-0f76-4208-a81d-e8dfcab3768c-tls-certs\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.271895 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.271868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/003fa5ff-0f76-4208-a81d-e8dfcab3768c-tls-certs\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.283669 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.283643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml996\" (UniqueName: \"kubernetes.io/projected/003fa5ff-0f76-4208-a81d-e8dfcab3768c-kube-api-access-ml996\") pod \"model-serving-api-5dd488fc48-v7jcm\" (UID: \"003fa5ff-0f76-4208-a81d-e8dfcab3768c\") " pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.345518 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.345471 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-49hrq"] Jun 10 16:53:17.347611 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:17.347580 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbf7d40_e066_4fe6_8eda_94c74472e539.slice/crio-b34e317c16476b1bd431944102deb4577b7ac390643944b72ea5b28015a4a084 WatchSource:0}: Error finding container b34e317c16476b1bd431944102deb4577b7ac390643944b72ea5b28015a4a084: Status 404 returned error can't find the container with id b34e317c16476b1bd431944102deb4577b7ac390643944b72ea5b28015a4a084 Jun 10 16:53:17.394797 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.394768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:17.546346 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.545920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-v7jcm"] Jun 10 16:53:17.548962 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:17.548934 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003fa5ff_0f76_4208_a81d_e8dfcab3768c.slice/crio-192287639bd3a6927a669f4b4eb9adf7dd687dc9282b4db6ca2afa523f246c05 WatchSource:0}: Error finding container 192287639bd3a6927a669f4b4eb9adf7dd687dc9282b4db6ca2afa523f246c05: Status 404 returned error can't find the container with id 192287639bd3a6927a669f4b4eb9adf7dd687dc9282b4db6ca2afa523f246c05 Jun 10 16:53:17.754821 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.754769 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" event={"ID":"003fa5ff-0f76-4208-a81d-e8dfcab3768c","Type":"ContainerStarted","Data":"192287639bd3a6927a669f4b4eb9adf7dd687dc9282b4db6ca2afa523f246c05"} Jun 10 16:53:17.756004 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.755973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" event={"ID":"7fbf7d40-e066-4fe6-8eda-94c74472e539","Type":"ContainerStarted","Data":"b34e317c16476b1bd431944102deb4577b7ac390643944b72ea5b28015a4a084"} Jun 10 16:53:17.776652 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.776627 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc"] Jun 10 16:53:17.779366 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.779348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.782010 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.781985 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:53:17.782110 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.782094 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:53:17.782183 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.782131 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:53:17.791695 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.791674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc"] Jun 10 16:53:17.875657 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.875621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.875799 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.875715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.875799 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.875753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntf24\" (UniqueName: \"kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.976672 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.976637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.976866 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.976705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.976866 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.976733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntf24\" (UniqueName: \"kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.977439 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.977409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.977553 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.977489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:17.986130 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:17.986103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntf24\" (UniqueName: \"kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:18.090258 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:18.090176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:18.855875 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:18.855703 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc"] Jun 10 16:53:19.541448 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:19.541416 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94275189_7747_4dbd_903d_9a4ede148d2b.slice/crio-ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd WatchSource:0}: Error finding container ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd: Status 404 returned error can't find the container with id ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd Jun 10 16:53:19.768790 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:19.768755 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" event={"ID":"94275189-7747-4dbd-903d-9a4ede148d2b","Type":"ContainerStarted","Data":"ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd"} Jun 10 16:53:21.781050 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.781021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" event={"ID":"7fbf7d40-e066-4fe6-8eda-94c74472e539","Type":"ContainerStarted","Data":"300afd860eb8b6aa2fb8d2cd5917388c147385d46b5b2c95cda88fc463f4b89c"} Jun 10 16:53:21.781482 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.781144 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:21.782498 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.782475 2559 generic.go:356] "Generic (PLEG): container finished" podID="94275189-7747-4dbd-903d-9a4ede148d2b" containerID="96400c3712840db4a322483c9d7900b262f37d89ce0486d53c0c2b20fa6dedb1" exitCode=0 Jun 10 16:53:21.782607 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.782554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" event={"ID":"94275189-7747-4dbd-903d-9a4ede148d2b","Type":"ContainerDied","Data":"96400c3712840db4a322483c9d7900b262f37d89ce0486d53c0c2b20fa6dedb1"} Jun 10 16:53:21.784173 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.784147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" event={"ID":"362cae75-205e-4d0e-9d2d-cc1065feb9c3","Type":"ContainerStarted","Data":"6ea4111bbbe704986ae8fc871f3018c28f4745ed1765220ff32d7dc8d0ffbdf9"} Jun 10 16:53:21.785623 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.785601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" event={"ID":"003fa5ff-0f76-4208-a81d-e8dfcab3768c","Type":"ContainerStarted","Data":"c6e60edafb74cdfb1e5667376fe4e82fb0b9e09046bcd5fab87b7ce3c23e9062"} Jun 10 16:53:21.785753 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.785736 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:21.798784 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.798749 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" podStartSLOduration=2.039274631 podStartE2EDuration="5.798736678s" totalImagesPullingTime="3.759462047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:21.797890423 +0000 UTC m=+517.216851961" watchObservedRunningTime="2026-06-10 16:53:21.798736678 +0000 UTC m=+517.217698221" Jun 10 16:53:21.815971 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.815934 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67bbd649b8-f7fhf" podStartSLOduration=1.286973855 podStartE2EDuration="5.815924855s" totalImagesPullingTime="4.528951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:21.814530883 +0000 UTC m=+517.233492444" watchObservedRunningTime="2026-06-10 16:53:21.815924855 +0000 UTC m=+517.234886394" Jun 10 16:53:21.832435 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:21.832388 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" podStartSLOduration=1.277095751 podStartE2EDuration="4.832371905s" totalImagesPullingTime="3.555276154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:21.830636279 +0000 UTC m=+517.249597815" watchObservedRunningTime="2026-06-10 16:53:21.832371905 +0000 UTC m=+517.251333446" Jun 10 16:53:22.792159 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:22.792125 2559 generic.go:356] "Generic (PLEG): container finished" podID="94275189-7747-4dbd-903d-9a4ede148d2b" containerID="5a6c86b20925c1a5bce15ab658181c0decb997168efb15c31a1c29fbb8907005" exitCode=0 Jun 10 16:53:22.792514 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:22.792217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" event={"ID":"94275189-7747-4dbd-903d-9a4ede148d2b","Type":"ContainerDied","Data":"5a6c86b20925c1a5bce15ab658181c0decb997168efb15c31a1c29fbb8907005"} Jun 10 16:53:23.799567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:23.799534 2559 generic.go:356] "Generic (PLEG): container finished" podID="94275189-7747-4dbd-903d-9a4ede148d2b" containerID="8324ae52deb9efadf7ac02b65794ab839c431f0d1233a9cebfe24a6841d56d16" exitCode=0 Jun 10 16:53:23.799977 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:23.799628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" event={"ID":"94275189-7747-4dbd-903d-9a4ede148d2b","Type":"ContainerDied","Data":"8324ae52deb9efadf7ac02b65794ab839c431f0d1233a9cebfe24a6841d56d16"} Jun 10 16:53:24.932792 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:24.932764 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:25.033692 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.033665 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle\") pod \"94275189-7747-4dbd-903d-9a4ede148d2b\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " Jun 10 16:53:25.033841 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.033724 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util\") pod \"94275189-7747-4dbd-903d-9a4ede148d2b\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " Jun 10 16:53:25.033841 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.033768 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntf24\" (UniqueName: \"kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24\") pod \"94275189-7747-4dbd-903d-9a4ede148d2b\" (UID: \"94275189-7747-4dbd-903d-9a4ede148d2b\") " Jun 10 16:53:25.034542 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.034518 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle" (OuterVolumeSpecName: "bundle") pod "94275189-7747-4dbd-903d-9a4ede148d2b" (UID: "94275189-7747-4dbd-903d-9a4ede148d2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:53:25.035718 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.035700 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24" (OuterVolumeSpecName: "kube-api-access-ntf24") pod "94275189-7747-4dbd-903d-9a4ede148d2b" (UID: "94275189-7747-4dbd-903d-9a4ede148d2b"). InnerVolumeSpecName "kube-api-access-ntf24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:53:25.041132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.041110 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util" (OuterVolumeSpecName: "util") pod "94275189-7747-4dbd-903d-9a4ede148d2b" (UID: "94275189-7747-4dbd-903d-9a4ede148d2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:53:25.135095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.135042 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntf24\" (UniqueName: \"kubernetes.io/projected/94275189-7747-4dbd-903d-9a4ede148d2b-kube-api-access-ntf24\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:25.135095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.135063 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:25.135095 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.135072 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94275189-7747-4dbd-903d-9a4ede148d2b-util\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:25.811067 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.811031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" event={"ID":"94275189-7747-4dbd-903d-9a4ede148d2b","Type":"ContainerDied","Data":"ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd"} Jun 10 16:53:25.811217 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.811079 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba1b08e306cd58172485d432db6fadd009eaf90eea83ca8ec80e232a0b5b4edd" Jun 10 16:53:25.811217 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.811092 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06m5wpc" Jun 10 16:53:25.886269 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.886236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:25.959087 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959061 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lgv48"] Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959336 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="extract" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959348 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="extract" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959362 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="pull" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959367 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="pull" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959375 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="util" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959380 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="util" Jun 10 16:53:25.959444 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.959425 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="94275189-7747-4dbd-903d-9a4ede148d2b" containerName="extract" Jun 10 16:53:25.962316 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.962303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:25.965224 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.965207 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gwg6w\"" Jun 10 16:53:25.965551 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.965525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 16:53:25.972322 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.972301 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg"] Jun 10 16:53:25.975265 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.975247 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:25.975854 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.975833 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lgv48"] Jun 10 16:53:25.977419 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.977402 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 16:53:25.977877 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.977858 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k4lb7\"" Jun 10 16:53:25.987550 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.987530 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg"] Jun 10 16:53:25.989082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:25.989059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:26.039646 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.039622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e8f8e13-f01d-40ba-a73d-44511c82ab60-cert\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.039740 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.039669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8wvz\" (UniqueName: \"kubernetes.io/projected/821bddb6-607a-41dc-9135-0b3ca70f3034-kube-api-access-h8wvz\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.039740 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.039702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzpn4\" (UniqueName: \"kubernetes.io/projected/4e8f8e13-f01d-40ba-a73d-44511c82ab60-kube-api-access-rzpn4\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.039852 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.039759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.122727 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.122669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:26.140207 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.140188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e8f8e13-f01d-40ba-a73d-44511c82ab60-cert\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.140283 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.140221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wvz\" (UniqueName: \"kubernetes.io/projected/821bddb6-607a-41dc-9135-0b3ca70f3034-kube-api-access-h8wvz\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.140283 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.140242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzpn4\" (UniqueName: \"kubernetes.io/projected/4e8f8e13-f01d-40ba-a73d-44511c82ab60-kube-api-access-rzpn4\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.140283 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.140268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.140403 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:53:26.140346 2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 10 16:53:26.140403 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:53:26.140389 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert podName:821bddb6-607a-41dc-9135-0b3ca70f3034 nodeName:}" failed. No retries permitted until 2026-06-10 16:53:26.640376396 +0000 UTC m=+522.059337913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert") pod "llmisvc-controller-manager-864bfd7bc9-2rpmg" (UID: "821bddb6-607a-41dc-9135-0b3ca70f3034") : secret "llmisvc-webhook-server-cert" not found Jun 10 16:53:26.142496 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.142478 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e8f8e13-f01d-40ba-a73d-44511c82ab60-cert\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.166930 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.166899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzpn4\" (UniqueName: \"kubernetes.io/projected/4e8f8e13-f01d-40ba-a73d-44511c82ab60-kube-api-access-rzpn4\") pod \"kserve-controller-manager-69fc866d76-lgv48\" (UID: \"4e8f8e13-f01d-40ba-a73d-44511c82ab60\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.172301 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.172283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8wvz\" (UniqueName: \"kubernetes.io/projected/821bddb6-607a-41dc-9135-0b3ca70f3034-kube-api-access-h8wvz\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.272482 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.272460 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:26.401440 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.401380 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lgv48"] Jun 10 16:53:26.404281 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:26.404253 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8f8e13_f01d_40ba_a73d_44511c82ab60.slice/crio-25c5211e04f7d28e250531d791b07b573ad5534ae7e03f6cef15c2148e983145 WatchSource:0}: Error finding container 25c5211e04f7d28e250531d791b07b573ad5534ae7e03f6cef15c2148e983145: Status 404 returned error can't find the container with id 25c5211e04f7d28e250531d791b07b573ad5534ae7e03f6cef15c2148e983145 Jun 10 16:53:26.543486 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.543460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:26.643567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.643543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.645759 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.645743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/821bddb6-607a-41dc-9135-0b3ca70f3034-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-2rpmg\" (UID: \"821bddb6-607a-41dc-9135-0b3ca70f3034\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:26.816612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.816580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" event={"ID":"4e8f8e13-f01d-40ba-a73d-44511c82ab60","Type":"ContainerStarted","Data":"25c5211e04f7d28e250531d791b07b573ad5534ae7e03f6cef15c2148e983145"} Jun 10 16:53:26.885176 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:26.885152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:27.025334 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:27.025308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg"] Jun 10 16:53:27.027866 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:27.027837 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod821bddb6_607a_41dc_9135_0b3ca70f3034.slice/crio-476a5734b0b32e0a3ba70e26ea15d750b90e76d448a9ce77359bbb1ca2018c3f WatchSource:0}: Error finding container 476a5734b0b32e0a3ba70e26ea15d750b90e76d448a9ce77359bbb1ca2018c3f: Status 404 returned error can't find the container with id 476a5734b0b32e0a3ba70e26ea15d750b90e76d448a9ce77359bbb1ca2018c3f Jun 10 16:53:27.175621 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:27.175595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:27.293167 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:27.293141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:27.824440 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:27.824407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" event={"ID":"821bddb6-607a-41dc-9135-0b3ca70f3034","Type":"ContainerStarted","Data":"476a5734b0b32e0a3ba70e26ea15d750b90e76d448a9ce77359bbb1ca2018c3f"} Jun 10 16:53:29.837617 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:29.837570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" event={"ID":"4e8f8e13-f01d-40ba-a73d-44511c82ab60","Type":"ContainerStarted","Data":"45ce955bb783e668007ac7ea15af4a605dc36f469162541f219f08ea5b9aead8"} Jun 10 16:53:29.838102 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:29.837841 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:53:29.857076 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:29.857029 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" podStartSLOduration=1.940164928 podStartE2EDuration="4.857009726s" totalImagesPullingTime="2.916844798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:29.855304354 +0000 UTC m=+525.274265895" watchObservedRunningTime="2026-06-10 16:53:29.857009726 +0000 UTC m=+525.275971266" Jun 10 16:53:30.843105 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:30.843070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" event={"ID":"821bddb6-607a-41dc-9135-0b3ca70f3034","Type":"ContainerStarted","Data":"485e8e2ff0229500ab67ceef838741c1e9f08f542978d1ae3429d484df2575bb"} Jun 10 16:53:30.843470 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:30.843340 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:53:30.866694 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:30.866647 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" podStartSLOduration=2.8625521640000002 podStartE2EDuration="5.866626348s" totalImagesPullingTime="3.004074184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:30.866394794 +0000 UTC m=+526.285356336" watchObservedRunningTime="2026-06-10 16:53:30.866626348 +0000 UTC m=+526.285587886" Jun 10 16:53:32.565380 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:32.565332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:32.738495 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:32.738460 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:32.795288 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:32.795267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-49hrq" Jun 10 16:53:32.797030 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:32.797002 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-v7jcm" Jun 10 16:53:33.946260 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.946189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:33.980099 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.980074 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc"] Jun 10 16:53:33.986160 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.986141 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:33.994082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.994063 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:53:33.994628 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.994613 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:53:33.994684 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:33.994619 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:53:34.011035 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.011016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc"] Jun 10 16:53:34.107138 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.107113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.107324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.107153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.107324 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.107228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrp7h\" (UniqueName: \"kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.207957 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.207906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.207957 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.207939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.208106 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.207968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrp7h\" (UniqueName: \"kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.208256 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.208239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.208312 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.208294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.221477 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.221457 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrp7h\" (UniqueName: \"kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.294228 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.294208 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:34.405541 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.405505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:34.457369 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.457226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc"] Jun 10 16:53:34.459979 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:34.459914 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38513b2_fc90_4bba_829b_4fdc24cc8655.slice/crio-42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e WatchSource:0}: Error finding container 42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e: Status 404 returned error can't find the container with id 42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e Jun 10 16:53:34.862350 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.862285 2559 generic.go:356] "Generic (PLEG): container finished" podID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerID="0204b32ba5956f1ac1775bdfdd0133d98ba539da3899bcef6818fc7b1a747346" exitCode=0 Jun 10 16:53:34.862350 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.862326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" event={"ID":"b38513b2-fc90-4bba-829b-4fdc24cc8655","Type":"ContainerDied","Data":"0204b32ba5956f1ac1775bdfdd0133d98ba539da3899bcef6818fc7b1a747346"} Jun 10 16:53:34.862482 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:34.862361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" event={"ID":"b38513b2-fc90-4bba-829b-4fdc24cc8655","Type":"ContainerStarted","Data":"42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e"} Jun 10 16:53:35.069251 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.069221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:35.242465 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.242440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:35.456104 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.456078 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hmflb"] Jun 10 16:53:35.458719 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.458704 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.462262 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.462243 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 16:53:35.462468 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.462455 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 16:53:35.462762 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.462750 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-bxqjz\"" Jun 10 16:53:35.478127 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.478082 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hmflb"] Jun 10 16:53:35.620248 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.620222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.620374 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.620286 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nl2v\" (UniqueName: \"kubernetes.io/projected/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-kube-api-access-2nl2v\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.721025 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.720991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nl2v\" (UniqueName: \"kubernetes.io/projected/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-kube-api-access-2nl2v\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.721145 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.721043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.723445 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.723427 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.730500 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.730442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nl2v\" (UniqueName: \"kubernetes.io/projected/efdf4a9a-1a8c-4e0d-86ed-5087cb12979a-kube-api-access-2nl2v\") pod \"servicemesh-operator3-57f65f65fb-hmflb\" (UID: \"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.767401 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.767383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:35.921361 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:35.921334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hmflb"] Jun 10 16:53:35.921944 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:35.921918 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdf4a9a_1a8c_4e0d_86ed_5087cb12979a.slice/crio-c7399005bd3fa5e9965c5d82d261abd3042249cf82c08e2d9e391476f9848ce6 WatchSource:0}: Error finding container c7399005bd3fa5e9965c5d82d261abd3042249cf82c08e2d9e391476f9848ce6: Status 404 returned error can't find the container with id c7399005bd3fa5e9965c5d82d261abd3042249cf82c08e2d9e391476f9848ce6 Jun 10 16:53:36.873337 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:36.873308 2559 generic.go:356] "Generic (PLEG): container finished" podID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerID="73f5b4f7786126a3e47beeb05b0fee2a00256afa290e6ca80ac567ff1075e014" exitCode=0 Jun 10 16:53:36.873763 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:36.873372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" event={"ID":"b38513b2-fc90-4bba-829b-4fdc24cc8655","Type":"ContainerDied","Data":"73f5b4f7786126a3e47beeb05b0fee2a00256afa290e6ca80ac567ff1075e014"} Jun 10 16:53:36.874972 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:36.874936 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" event={"ID":"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a","Type":"ContainerStarted","Data":"c7399005bd3fa5e9965c5d82d261abd3042249cf82c08e2d9e391476f9848ce6"} Jun 10 16:53:37.881964 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:37.881926 2559 generic.go:356] "Generic (PLEG): container finished" podID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerID="1a99859ef64ed52d49eb4d52a5eea2440abd8b896cc8377e256235ae80e46fae" exitCode=0 Jun 10 16:53:37.882425 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:37.882021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" event={"ID":"b38513b2-fc90-4bba-829b-4fdc24cc8655","Type":"ContainerDied","Data":"1a99859ef64ed52d49eb4d52a5eea2440abd8b896cc8377e256235ae80e46fae"} Jun 10 16:53:39.035687 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.035664 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:39.150294 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.150208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle\") pod \"b38513b2-fc90-4bba-829b-4fdc24cc8655\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " Jun 10 16:53:39.150445 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.150409 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrp7h\" (UniqueName: \"kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h\") pod \"b38513b2-fc90-4bba-829b-4fdc24cc8655\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " Jun 10 16:53:39.150504 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.150489 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util\") pod \"b38513b2-fc90-4bba-829b-4fdc24cc8655\" (UID: \"b38513b2-fc90-4bba-829b-4fdc24cc8655\") " Jun 10 16:53:39.151764 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.151732 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle" (OuterVolumeSpecName: "bundle") pod "b38513b2-fc90-4bba-829b-4fdc24cc8655" (UID: "b38513b2-fc90-4bba-829b-4fdc24cc8655"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:53:39.156364 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.156282 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h" (OuterVolumeSpecName: "kube-api-access-lrp7h") pod "b38513b2-fc90-4bba-829b-4fdc24cc8655" (UID: "b38513b2-fc90-4bba-829b-4fdc24cc8655"). InnerVolumeSpecName "kube-api-access-lrp7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:53:39.157779 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.157754 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util" (OuterVolumeSpecName: "util") pod "b38513b2-fc90-4bba-829b-4fdc24cc8655" (UID: "b38513b2-fc90-4bba-829b-4fdc24cc8655"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:53:39.251969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.251939 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrp7h\" (UniqueName: \"kubernetes.io/projected/b38513b2-fc90-4bba-829b-4fdc24cc8655-kube-api-access-lrp7h\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:39.251969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.251971 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-util\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:39.252160 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.251987 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b38513b2-fc90-4bba-829b-4fdc24cc8655-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:53:39.893369 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.893345 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" Jun 10 16:53:39.893534 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.893335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atr2nc" event={"ID":"b38513b2-fc90-4bba-829b-4fdc24cc8655","Type":"ContainerDied","Data":"42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e"} Jun 10 16:53:39.893534 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.893475 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42c3cc1749200f0989055db60dbf63c374f2803f7d6bf2313bf1e3781c112d0e" Jun 10 16:53:39.895363 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.895340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" event={"ID":"efdf4a9a-1a8c-4e0d-86ed-5087cb12979a","Type":"ContainerStarted","Data":"bf4cb287fdf52c6abfa76dbe513487107cfb46d327374ec48adf6b7c04b6c654"} Jun 10 16:53:39.895492 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.895398 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:39.917694 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:39.917644 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" podStartSLOduration=1.885376751 podStartE2EDuration="4.91762899s" totalImagesPullingTime="3.032252239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:39.915551264 +0000 UTC m=+535.334512804" watchObservedRunningTime="2026-06-10 16:53:39.91762899 +0000 UTC m=+535.336590531" Jun 10 16:53:40.592174 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592142 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn"] Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592425 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="pull" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592437 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="pull" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592455 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="util" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592460 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="util" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592467 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="extract" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592472 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="extract" Jun 10 16:53:40.592608 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.592534 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38513b2-fc90-4bba-829b-4fdc24cc8655" containerName="extract" Jun 10 16:53:40.595731 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.595713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.598092 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.598071 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 16:53:40.598195 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.598126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 16:53:40.598494 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.598478 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 16:53:40.598633 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.598618 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 16:53:40.598671 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.598623 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wzc42\"" Jun 10 16:53:40.607463 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.607272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn"] Jun 10 16:53:40.607636 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.607615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:40.764695 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764695 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd8l\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-kube-api-access-bkd8l\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.764920 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.764832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.865797 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.865797 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.865797 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.866083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.866083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.866083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.865969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd8l\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-kube-api-access-bkd8l\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.866083 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.866001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.866565 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.866544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.868168 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.868148 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.868278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.868178 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.868356 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.868342 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.868485 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.868469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.873947 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.873929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd8l\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-kube-api-access-bkd8l\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.874114 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.874087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b5ee7c-8e6a-4d6b-805d-c04568b6ea72-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qbmtn\" (UID: \"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:40.904949 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:40.904912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:41.042260 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:41.042231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn"] Jun 10 16:53:41.043995 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:53:41.043964 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b5ee7c_8e6a_4d6b_805d_c04568b6ea72.slice/crio-79ba5161cd1235ec89682390a5c4eed965306263b52976f34a6bb9875999bedd WatchSource:0}: Error finding container 79ba5161cd1235ec89682390a5c4eed965306263b52976f34a6bb9875999bedd: Status 404 returned error can't find the container with id 79ba5161cd1235ec89682390a5c4eed965306263b52976f34a6bb9875999bedd Jun 10 16:53:41.656698 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:41.656665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:41.907696 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:41.907618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" event={"ID":"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72","Type":"ContainerStarted","Data":"79ba5161cd1235ec89682390a5c4eed965306263b52976f34a6bb9875999bedd"} Jun 10 16:53:43.657177 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:43.657113 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 16:53:43.657429 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:43.657210 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 16:53:43.917895 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:43.917864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" event={"ID":"11b5ee7c-8e6a-4d6b-805d-c04568b6ea72","Type":"ContainerStarted","Data":"d52971fdaebd2c744b43ba179b8f61eca6301eba13e116333e1b78a29534b33d"} Jun 10 16:53:43.918075 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:43.917999 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:43.940240 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:43.940193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" podStartSLOduration=1.32940979 podStartE2EDuration="3.94018019s" totalImagesPullingTime="2.6107704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:43.939014334 +0000 UTC m=+539.357975872" watchObservedRunningTime="2026-06-10 16:53:43.94018019 +0000 UTC m=+539.359141728" Jun 10 16:53:44.463273 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:44.463224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:44.561090 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:44.561045 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:44.763302 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:44.763224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:44.924304 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:44.924281 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmtn" Jun 10 16:53:44.983681 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:44.983639 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:45.123272 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:45.123191 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:45.330472 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:45.330438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:45.523418 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:45.523384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:45.623563 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:45.623515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:50.904721 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:50.904696 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hmflb" Jun 10 16:53:53.143940 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:53.143901 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:53:53.239901 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:53:53.239853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:00.847887 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:00.847859 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lgv48" Jun 10 16:54:01.849897 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:01.849873 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-2rpmg" Jun 10 16:54:03.642969 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:03.642930 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:54:03.798599 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:03.798559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:03.859606 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:03.859561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:16.969746 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:16.969708 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:17.073167 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:17.073128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:17.173458 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:17.173429 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:17.855564 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:17.855529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:17.955133 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:17.955091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:18.108256 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:18.108181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:28.662595 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.662524 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65c78d4594-6rc92" podUID="90298a36-180b-45f1-8a5a-3eda69f85f1e" containerName="console" containerID="cri-o://8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2" gracePeriod=15 Jun 10 16:54:28.901721 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.901700 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:54:28.989125 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989100 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s78h\" (UniqueName: \"kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989132 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989153 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989179 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989250 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989507 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989507 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989315 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config\") pod \"90298a36-180b-45f1-8a5a-3eda69f85f1e\" (UID: \"90298a36-180b-45f1-8a5a-3eda69f85f1e\") " Jun 10 16:54:28.989603 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989538 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:54:28.989842 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.989774 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config" (OuterVolumeSpecName: "console-config") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:54:28.990526 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.990498 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:54:28.990637 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.990581 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:54:28.991287 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.991261 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h" (OuterVolumeSpecName: "kube-api-access-4s78h") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "kube-api-access-4s78h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:28.991384 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.991341 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:54:28.991610 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:28.991591 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90298a36-180b-45f1-8a5a-3eda69f85f1e" (UID: "90298a36-180b-45f1-8a5a-3eda69f85f1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:54:29.090502 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090477 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090502 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090502 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090643 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090516 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090643 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090529 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s78h\" (UniqueName: \"kubernetes.io/projected/90298a36-180b-45f1-8a5a-3eda69f85f1e-kube-api-access-4s78h\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090643 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090541 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-trusted-ca-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090643 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090553 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90298a36-180b-45f1-8a5a-3eda69f85f1e-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.090643 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.090564 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90298a36-180b-45f1-8a5a-3eda69f85f1e-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:54:29.123933 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.123906 2559 generic.go:356] "Generic (PLEG): container finished" podID="90298a36-180b-45f1-8a5a-3eda69f85f1e" containerID="8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2" exitCode=0 Jun 10 16:54:29.124032 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.123948 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c78d4594-6rc92" Jun 10 16:54:29.124032 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.123980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c78d4594-6rc92" event={"ID":"90298a36-180b-45f1-8a5a-3eda69f85f1e","Type":"ContainerDied","Data":"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2"} Jun 10 16:54:29.124032 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.124028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c78d4594-6rc92" event={"ID":"90298a36-180b-45f1-8a5a-3eda69f85f1e","Type":"ContainerDied","Data":"1bf36858bf06f8e4f129b3a51a204adcbe998f6e1bc13a4f97e4c18b3052bb2c"} Jun 10 16:54:29.124187 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.124056 2559 scope.go:117] "RemoveContainer" containerID="8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2" Jun 10 16:54:29.138669 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.138647 2559 scope.go:117] "RemoveContainer" containerID="8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2" Jun 10 16:54:29.138941 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:54:29.138922 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2\": container with ID starting with 8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2 not found: ID does not exist" containerID="8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2" Jun 10 16:54:29.139024 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.138947 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2"} err="failed to get container status \"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2\": rpc error: code = NotFound desc = could not find container \"8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2\": container with ID starting with 8eaca2350b3a4f6911fb77cabfc30229ae515aac5bbb23f3573fb51a800393d2 not found: ID does not exist" Jun 10 16:54:29.148830 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.148792 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:54:29.151563 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:29.151544 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65c78d4594-6rc92"] Jun 10 16:54:30.991566 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:30.991534 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90298a36-180b-45f1-8a5a-3eda69f85f1e" path="/var/lib/kubelet/pods/90298a36-180b-45f1-8a5a-3eda69f85f1e/volumes" Jun 10 16:54:40.012397 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:40.012354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:43.111367 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:43.111332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:44.972576 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:44.972553 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:54:44.973794 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:44.973763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:54:45.622659 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:45.622625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:46.950546 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.950510 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4"] Jun 10 16:54:46.950942 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.950832 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90298a36-180b-45f1-8a5a-3eda69f85f1e" containerName="console" Jun 10 16:54:46.950942 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.950844 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90298a36-180b-45f1-8a5a-3eda69f85f1e" containerName="console" Jun 10 16:54:46.950942 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.950900 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90298a36-180b-45f1-8a5a-3eda69f85f1e" containerName="console" Jun 10 16:54:46.954876 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.954858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:46.957473 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.957441 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 16:54:46.957623 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.957527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 16:54:46.958317 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.958297 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xr47n\"" Jun 10 16:54:46.958421 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.958297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 16:54:46.967157 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:46.967132 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4"] Jun 10 16:54:47.021589 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.021560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqc8\" (UniqueName: \"kubernetes.io/projected/8afb64bc-3ea5-45ec-b014-0bf1aa2732e1-kube-api-access-wxqc8\") pod \"dns-operator-controller-manager-864dd78c4c-9xcs4\" (UID: \"8afb64bc-3ea5-45ec-b014-0bf1aa2732e1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:47.100449 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.100412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:47.122171 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.122149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqc8\" (UniqueName: \"kubernetes.io/projected/8afb64bc-3ea5-45ec-b014-0bf1aa2732e1-kube-api-access-wxqc8\") pod \"dns-operator-controller-manager-864dd78c4c-9xcs4\" (UID: \"8afb64bc-3ea5-45ec-b014-0bf1aa2732e1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:47.133303 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.133282 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqc8\" (UniqueName: \"kubernetes.io/projected/8afb64bc-3ea5-45ec-b014-0bf1aa2732e1-kube-api-access-wxqc8\") pod \"dns-operator-controller-manager-864dd78c4c-9xcs4\" (UID: \"8afb64bc-3ea5-45ec-b014-0bf1aa2732e1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:47.265871 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.265801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:47.397132 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:47.397082 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4"] Jun 10 16:54:47.399691 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:54:47.399663 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afb64bc_3ea5_45ec_b014_0bf1aa2732e1.slice/crio-ccb9831877974124218f8bade2bf8ceccc9da0d0493542147342f015e1f39401 WatchSource:0}: Error finding container ccb9831877974124218f8bade2bf8ceccc9da0d0493542147342f015e1f39401: Status 404 returned error can't find the container with id ccb9831877974124218f8bade2bf8ceccc9da0d0493542147342f015e1f39401 Jun 10 16:54:48.018189 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:48.018160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:48.211817 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:48.211776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" event={"ID":"8afb64bc-3ea5-45ec-b014-0bf1aa2732e1","Type":"ContainerStarted","Data":"ccb9831877974124218f8bade2bf8ceccc9da0d0493542147342f015e1f39401"} Jun 10 16:54:49.479249 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.479172 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:49.830571 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.830507 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h"] Jun 10 16:54:49.833797 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.833780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:49.836005 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.835985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f9j2d\"" Jun 10 16:54:49.843042 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.843021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h"] Jun 10 16:54:49.946770 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:49.946745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbp59\" (UniqueName: \"kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59\") pod \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" (UID: \"88b03f28-f421-4824-a800-20f1a15d4ad5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:50.048049 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.048023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbp59\" (UniqueName: \"kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59\") pod \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" (UID: \"88b03f28-f421-4824-a800-20f1a15d4ad5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:50.057571 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.057546 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbp59\" (UniqueName: \"kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59\") pod \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" (UID: \"88b03f28-f421-4824-a800-20f1a15d4ad5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:50.143791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.143742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:50.212354 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.212326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:50.225975 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.225949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" event={"ID":"8afb64bc-3ea5-45ec-b014-0bf1aa2732e1","Type":"ContainerStarted","Data":"cf74466e7cc7f98dd004d95fa6ae4f44a07f2bac22c77d084298c144fe8affd0"} Jun 10 16:54:50.226096 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.226030 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:54:50.244100 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.244050 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" podStartSLOduration=2.10278418 podStartE2EDuration="4.244029001s" totalImagesPullingTime="2.141244821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:50.242933787 +0000 UTC m=+605.661895328" watchObservedRunningTime="2026-06-10 16:54:50.244029001 +0000 UTC m=+605.662990546" Jun 10 16:54:50.274384 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.274334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h"] Jun 10 16:54:50.277332 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:54:50.277304 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b03f28_f421_4824_a800_20f1a15d4ad5.slice/crio-f9c2c86c020ddcb6e3c95e301af426096a5465b7eb63c11752fa0b32302d3af3 WatchSource:0}: Error finding container f9c2c86c020ddcb6e3c95e301af426096a5465b7eb63c11752fa0b32302d3af3: Status 404 returned error can't find the container with id f9c2c86c020ddcb6e3c95e301af426096a5465b7eb63c11752fa0b32302d3af3 Jun 10 16:54:50.842556 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:50.842522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:51.233508 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:51.233476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" event={"ID":"88b03f28-f421-4824-a800-20f1a15d4ad5","Type":"ContainerStarted","Data":"f9c2c86c020ddcb6e3c95e301af426096a5465b7eb63c11752fa0b32302d3af3"} Jun 10 16:54:51.673377 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:51.673342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:51.780466 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:51.780437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:53.244434 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:53.244396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" event={"ID":"88b03f28-f421-4824-a800-20f1a15d4ad5","Type":"ContainerStarted","Data":"b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749"} Jun 10 16:54:53.244864 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:53.244545 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:54:53.291314 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:53.291266 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" podStartSLOduration=2.290371445 podStartE2EDuration="4.291252033s" totalImagesPullingTime="2.000880588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:53.288702799 +0000 UTC m=+608.707664337" watchObservedRunningTime="2026-06-10 16:54:53.291252033 +0000 UTC m=+608.710213572" Jun 10 16:54:54.679490 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:54.679463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:54.790305 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:54.790274 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:54.923629 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:54.923599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:55.025580 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:55.025505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:56.105352 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:56.105313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:54:56.169085 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:54:56.169058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:01.235681 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:01.235654 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9xcs4" Jun 10 16:55:04.251070 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.250988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:04.251877 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.251859 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.348397 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.348372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:04.602781 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.602707 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h"] Jun 10 16:55:04.602989 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.602964 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" containerName="manager" containerID="cri-o://b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749" gracePeriod=2 Jun 10 16:55:04.622394 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.622370 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h"] Jun 10 16:55:04.632799 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:55:04.632770 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"88b03f28-f421-4824-a800-20f1a15d4ad5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-hnv9h\": pods \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.652514 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.652490 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl"] Jun 10 16:55:04.652859 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.652843 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" containerName="manager" Jun 10 16:55:04.652938 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.652861 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" containerName="manager" Jun 10 16:55:04.652995 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.652940 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" containerName="manager" Jun 10 16:55:04.655767 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.655750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:04.658912 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:55:04.658882 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" is forbidden: User \"system:node:ip-10-0-141-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-105.ec2.internal' and this object" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.671140 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.671119 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl"] Jun 10 16:55:04.760054 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.760019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjw9h\" (UniqueName: \"kubernetes.io/projected/10c8bf80-5c45-4a9e-b3eb-b205a90690e6-kube-api-access-cjw9h\") pod \"limitador-operator-controller-manager-859d7b78bd-g84xl\" (UID: \"10c8bf80-5c45-4a9e-b3eb-b205a90690e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:04.839115 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.839094 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.844212 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:55:04.844188 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" is forbidden: User \"system:node:ip-10-0-141-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-105.ec2.internal' and this object" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.861098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.861041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjw9h\" (UniqueName: \"kubernetes.io/projected/10c8bf80-5c45-4a9e-b3eb-b205a90690e6-kube-api-access-cjw9h\") pod \"limitador-operator-controller-manager-859d7b78bd-g84xl\" (UID: \"10c8bf80-5c45-4a9e-b3eb-b205a90690e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:04.869791 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.869771 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjw9h\" (UniqueName: \"kubernetes.io/projected/10c8bf80-5c45-4a9e-b3eb-b205a90690e6-kube-api-access-cjw9h\") pod \"limitador-operator-controller-manager-859d7b78bd-g84xl\" (UID: \"10c8bf80-5c45-4a9e-b3eb-b205a90690e6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:04.961305 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.961279 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbp59\" (UniqueName: \"kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59\") pod \"88b03f28-f421-4824-a800-20f1a15d4ad5\" (UID: \"88b03f28-f421-4824-a800-20f1a15d4ad5\") " Jun 10 16:55:04.963121 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.963102 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59" (OuterVolumeSpecName: "kube-api-access-mbp59") pod "88b03f28-f421-4824-a800-20f1a15d4ad5" (UID: "88b03f28-f421-4824-a800-20f1a15d4ad5"). InnerVolumeSpecName "kube-api-access-mbp59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:55:04.980365 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.980348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:04.990239 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:55:04.990211 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnv9h\" is forbidden: User \"system:node:ip-10-0-141-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-105.ec2.internal' and this object" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:04.991243 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:04.991223 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b03f28-f421-4824-a800-20f1a15d4ad5" path="/var/lib/kubelet/pods/88b03f28-f421-4824-a800-20f1a15d4ad5/volumes" Jun 10 16:55:05.062499 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.062469 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbp59\" (UniqueName: \"kubernetes.io/projected/88b03f28-f421-4824-a800-20f1a15d4ad5-kube-api-access-mbp59\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:55:05.104563 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.104544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl"] Jun 10 16:55:05.106335 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:55:05.106302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c8bf80_5c45_4a9e_b3eb_b205a90690e6.slice/crio-fe9b3f4171919daa663e642f1a2b7cb04414b0248da34c2b899cc8a7cfbad133 WatchSource:0}: Error finding container fe9b3f4171919daa663e642f1a2b7cb04414b0248da34c2b899cc8a7cfbad133: Status 404 returned error can't find the container with id fe9b3f4171919daa663e642f1a2b7cb04414b0248da34c2b899cc8a7cfbad133 Jun 10 16:55:05.305257 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.305229 2559 generic.go:356] "Generic (PLEG): container finished" podID="88b03f28-f421-4824-a800-20f1a15d4ad5" containerID="b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749" exitCode=0 Jun 10 16:55:05.305580 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.305271 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnv9h" Jun 10 16:55:05.305580 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.305321 2559 scope.go:117] "RemoveContainer" containerID="b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749" Jun 10 16:55:05.307278 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.307251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" event={"ID":"10c8bf80-5c45-4a9e-b3eb-b205a90690e6","Type":"ContainerStarted","Data":"91f8ceccca468d94be1f41dcb78acb9e016d1a7145ae27a15ad1e9bcd716c9de"} Jun 10 16:55:05.307387 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.307306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:05.307387 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.307326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" event={"ID":"10c8bf80-5c45-4a9e-b3eb-b205a90690e6","Type":"ContainerStarted","Data":"fe9b3f4171919daa663e642f1a2b7cb04414b0248da34c2b899cc8a7cfbad133"} Jun 10 16:55:05.313639 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.313607 2559 scope.go:117] "RemoveContainer" containerID="b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749" Jun 10 16:55:05.313947 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:55:05.313911 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749\": container with ID starting with b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749 not found: ID does not exist" containerID="b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749" Jun 10 16:55:05.314054 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:05.313953 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749"} err="failed to get container status \"b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749\": rpc error: code = NotFound desc = could not find container \"b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749\": container with ID starting with b4fa013bfa14d2f886b4d6cc8c093cda4d7602f9a5f59562941df99661772749 not found: ID does not exist" Jun 10 16:55:08.677465 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:08.677422 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:08.838576 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:08.838545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:13.614065 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:13.614021 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:13.715042 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:13.715002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:14.209227 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:14.209195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:14.278442 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:14.278413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:16.315612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:16.315575 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" Jun 10 16:55:16.333891 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:16.333801 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g84xl" podStartSLOduration=12.333783586 podStartE2EDuration="12.333783586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:55:05.34558753 +0000 UTC m=+620.764549070" watchObservedRunningTime="2026-06-10 16:55:16.333783586 +0000 UTC m=+631.752745126" Jun 10 16:55:17.085866 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:17.085830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:17.200185 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:17.200157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:24.738355 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:24.738312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:24.835531 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:24.835499 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:29.432027 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:29.431987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:29.537047 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:29.537012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:34.224598 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:34.224552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:34.324540 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:34.324493 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:38.619648 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:38.619604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:38.677757 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:38.677711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:55.970618 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:55.970580 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:56.037471 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:56.037430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:55:59.936250 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:55:59.936214 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:00.288506 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.288467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:00.307570 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.307530 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:00.311998 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.311980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.315260 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.315235 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ft79b\"" Jun 10 16:56:00.315744 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.315724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 16:56:00.319793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.319776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:00.343545 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.343516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.343707 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.343579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n52w\" (UniqueName: \"kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.390734 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.390702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:00.415476 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.415444 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:00.445056 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.445021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.445217 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.445095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n52w\" (UniqueName: \"kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.445641 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.445623 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.453823 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.453787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n52w\" (UniqueName: \"kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w\") pod \"limitador-limitador-64c94fd64f-c45wn\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.491480 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.491445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:00.623855 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.623762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:00.755139 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:00.755111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:00.758230 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:56:00.758205 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f04a981_2f39_4d9b_8122_30b1400b7640.slice/crio-35641c8f981e8869f36f8008967e546f9629acdc391cf2de2bf10edf5f71b549 WatchSource:0}: Error finding container 35641c8f981e8869f36f8008967e546f9629acdc391cf2de2bf10edf5f71b549: Status 404 returned error can't find the container with id 35641c8f981e8869f36f8008967e546f9629acdc391cf2de2bf10edf5f71b549 Jun 10 16:56:01.118793 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:01.118749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:01.188045 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:01.188014 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:01.591802 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:01.591765 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" event={"ID":"3f04a981-2f39-4d9b-8122-30b1400b7640","Type":"ContainerStarted","Data":"35641c8f981e8869f36f8008967e546f9629acdc391cf2de2bf10edf5f71b549"} Jun 10 16:56:04.609736 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:04.609702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" event={"ID":"3f04a981-2f39-4d9b-8122-30b1400b7640","Type":"ContainerStarted","Data":"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922"} Jun 10 16:56:04.610173 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:04.609766 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:04.626963 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:04.626916 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" podStartSLOduration=1.842580417 podStartE2EDuration="4.626900336s" totalImagesPullingTime="2.784319919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:04.625154904 +0000 UTC m=+680.044116446" watchObservedRunningTime="2026-06-10 16:56:04.626900336 +0000 UTC m=+680.045861874" Jun 10 16:56:15.615256 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:15.615221 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:17.347109 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.347063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:17.355143 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.355101 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:17.355395 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.355336 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" podUID="3f04a981-2f39-4d9b-8122-30b1400b7640" containerName="limitador" containerID="cri-o://6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922" gracePeriod=30 Jun 10 16:56:17.926295 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.926265 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:17.997241 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.997190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n52w\" (UniqueName: \"kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w\") pod \"3f04a981-2f39-4d9b-8122-30b1400b7640\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " Jun 10 16:56:17.997452 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.997303 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file\") pod \"3f04a981-2f39-4d9b-8122-30b1400b7640\" (UID: \"3f04a981-2f39-4d9b-8122-30b1400b7640\") " Jun 10 16:56:17.997686 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.997662 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file" (OuterVolumeSpecName: "config-file") pod "3f04a981-2f39-4d9b-8122-30b1400b7640" (UID: "3f04a981-2f39-4d9b-8122-30b1400b7640"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:56:17.999567 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:17.999536 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w" (OuterVolumeSpecName: "kube-api-access-2n52w") pod "3f04a981-2f39-4d9b-8122-30b1400b7640" (UID: "3f04a981-2f39-4d9b-8122-30b1400b7640"). InnerVolumeSpecName "kube-api-access-2n52w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:56:18.098046 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.098007 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n52w\" (UniqueName: \"kubernetes.io/projected/3f04a981-2f39-4d9b-8122-30b1400b7640-kube-api-access-2n52w\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:56:18.098046 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.098042 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f04a981-2f39-4d9b-8122-30b1400b7640-config-file\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:56:18.681523 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.681482 2559 generic.go:356] "Generic (PLEG): container finished" podID="3f04a981-2f39-4d9b-8122-30b1400b7640" containerID="6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922" exitCode=0 Jun 10 16:56:18.682016 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.681546 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" Jun 10 16:56:18.682016 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.681568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" event={"ID":"3f04a981-2f39-4d9b-8122-30b1400b7640","Type":"ContainerDied","Data":"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922"} Jun 10 16:56:18.682016 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.681640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c45wn" event={"ID":"3f04a981-2f39-4d9b-8122-30b1400b7640","Type":"ContainerDied","Data":"35641c8f981e8869f36f8008967e546f9629acdc391cf2de2bf10edf5f71b549"} Jun 10 16:56:18.682016 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.681665 2559 scope.go:117] "RemoveContainer" containerID="6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922" Jun 10 16:56:18.693966 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.693936 2559 scope.go:117] "RemoveContainer" containerID="6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922" Jun 10 16:56:18.694605 ip-10-0-141-105 kubenswrapper[2559]: E0610 16:56:18.694576 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922\": container with ID starting with 6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922 not found: ID does not exist" containerID="6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922" Jun 10 16:56:18.694753 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.694725 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922"} err="failed to get container status \"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922\": rpc error: code = NotFound desc = could not find container \"6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922\": container with ID starting with 6443217d66e6e2f8c20aa25070d2198f06d2955a9b459778bc66b5f22c30c922 not found: ID does not exist" Jun 10 16:56:18.710895 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.710859 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:18.714736 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.714696 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c45wn"] Jun 10 16:56:18.992568 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:18.992454 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f04a981-2f39-4d9b-8122-30b1400b7640" path="/var/lib/kubelet/pods/3f04a981-2f39-4d9b-8122-30b1400b7640/volumes" Jun 10 16:56:21.652785 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.652751 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rmtn8"] Jun 10 16:56:21.653331 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.653307 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f04a981-2f39-4d9b-8122-30b1400b7640" containerName="limitador" Jun 10 16:56:21.653409 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.653334 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f04a981-2f39-4d9b-8122-30b1400b7640" containerName="limitador" Jun 10 16:56:21.653460 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.653436 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f04a981-2f39-4d9b-8122-30b1400b7640" containerName="limitador" Jun 10 16:56:21.657500 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.657478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.659776 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.659752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 16:56:21.659911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.659836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k7dwj\"" Jun 10 16:56:21.663526 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.663496 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rmtn8"] Jun 10 16:56:21.690954 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.690921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:21.730200 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.730165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7b4d\" (UniqueName: \"kubernetes.io/projected/5816e435-1517-4e60-b37d-709348368ede-kube-api-access-w7b4d\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.730200 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.730204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5816e435-1517-4e60-b37d-709348368ede-data\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.831494 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.831459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7b4d\" (UniqueName: \"kubernetes.io/projected/5816e435-1517-4e60-b37d-709348368ede-kube-api-access-w7b4d\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.831494 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.831498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5816e435-1517-4e60-b37d-709348368ede-data\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.832000 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.831983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5816e435-1517-4e60-b37d-709348368ede-data\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.843165 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.843141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7b4d\" (UniqueName: \"kubernetes.io/projected/5816e435-1517-4e60-b37d-709348368ede-kube-api-access-w7b4d\") pod \"postgres-69fb4594cf-rmtn8\" (UID: \"5816e435-1517-4e60-b37d-709348368ede\") " pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:21.970659 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:21.970622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:22.110552 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:22.110526 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rmtn8"] Jun 10 16:56:22.112940 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:56:22.112913 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5816e435_1517_4e60_b37d_709348368ede.slice/crio-2945f9061ec851dbba1898fe9f7e7a1144e94c16d52c7a1d098d113fc46d74d3 WatchSource:0}: Error finding container 2945f9061ec851dbba1898fe9f7e7a1144e94c16d52c7a1d098d113fc46d74d3: Status 404 returned error can't find the container with id 2945f9061ec851dbba1898fe9f7e7a1144e94c16d52c7a1d098d113fc46d74d3 Jun 10 16:56:22.703403 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:22.703369 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rmtn8" event={"ID":"5816e435-1517-4e60-b37d-709348368ede","Type":"ContainerStarted","Data":"2945f9061ec851dbba1898fe9f7e7a1144e94c16d52c7a1d098d113fc46d74d3"} Jun 10 16:56:27.738089 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:27.738050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rmtn8" event={"ID":"5816e435-1517-4e60-b37d-709348368ede","Type":"ContainerStarted","Data":"b7d5c5bc391432ce0c51a6615790b70c406fd826553ac71e98645d93a04ce40e"} Jun 10 16:56:27.738535 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:27.738140 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:27.754257 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:27.754199 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rmtn8" podStartSLOduration=1.581184768 podStartE2EDuration="6.754181682s" totalImagesPullingTime="5.172996914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:27.75302289 +0000 UTC m=+703.171984445" watchObservedRunningTime="2026-06-10 16:56:27.754181682 +0000 UTC m=+703.173143220" Jun 10 16:56:33.774826 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:33.774790 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rmtn8" Jun 10 16:56:34.109299 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:34.109198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:34.205966 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:34.205927 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:34.341266 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:34.341223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:56:35.438064 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.438030 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl"] Jun 10 16:56:35.444513 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.444488 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.447252 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.447218 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:56:35.447252 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.447218 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:56:35.447796 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.447780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:56:35.451927 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.451898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl"] Jun 10 16:56:35.559883 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.559831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxrhj\" (UniqueName: \"kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.560108 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.559920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.565329 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.559950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.666486 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.666453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxrhj\" (UniqueName: \"kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.666690 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.666495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.666690 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.666519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.666957 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.666937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.667029 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.666977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.675886 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.675856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxrhj\" (UniqueName: \"kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.754912 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.754788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:35.899750 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:35.899719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl"] Jun 10 16:56:35.902043 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:56:35.902013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00912b6a_6857_4728_8742_fbab6ed0bfbb.slice/crio-decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc WatchSource:0}: Error finding container decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc: Status 404 returned error can't find the container with id decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc Jun 10 16:56:36.786984 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:36.786947 2559 generic.go:356] "Generic (PLEG): container finished" podID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerID="576df4085650d32dd5067ce3807a42edb8dbf681adcfc46a7dba9cf87e453532" exitCode=0 Jun 10 16:56:36.787433 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:36.787012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" event={"ID":"00912b6a-6857-4728-8742-fbab6ed0bfbb","Type":"ContainerDied","Data":"576df4085650d32dd5067ce3807a42edb8dbf681adcfc46a7dba9cf87e453532"} Jun 10 16:56:36.787433 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:36.787092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" event={"ID":"00912b6a-6857-4728-8742-fbab6ed0bfbb","Type":"ContainerStarted","Data":"decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc"} Jun 10 16:56:38.800248 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:38.800205 2559 generic.go:356] "Generic (PLEG): container finished" podID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerID="4e31324b42c6f650aa55e68a52fcab921a5a075aa896f1b08db4ab05963b4fae" exitCode=0 Jun 10 16:56:38.800248 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:38.800246 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" event={"ID":"00912b6a-6857-4728-8742-fbab6ed0bfbb","Type":"ContainerDied","Data":"4e31324b42c6f650aa55e68a52fcab921a5a075aa896f1b08db4ab05963b4fae"} Jun 10 16:56:39.813116 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:39.813074 2559 generic.go:356] "Generic (PLEG): container finished" podID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerID="6fe3b708c8163169688d177775b646aa3191a0a4cb7a93b634a5ea6d7aae887c" exitCode=0 Jun 10 16:56:39.813616 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:39.813150 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" event={"ID":"00912b6a-6857-4728-8742-fbab6ed0bfbb","Type":"ContainerDied","Data":"6fe3b708c8163169688d177775b646aa3191a0a4cb7a93b634a5ea6d7aae887c"} Jun 10 16:56:40.975326 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:40.975293 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:41.118720 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.118612 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util\") pod \"00912b6a-6857-4728-8742-fbab6ed0bfbb\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " Jun 10 16:56:41.118720 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.118672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle\") pod \"00912b6a-6857-4728-8742-fbab6ed0bfbb\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " Jun 10 16:56:41.118720 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.118722 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxrhj\" (UniqueName: \"kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj\") pod \"00912b6a-6857-4728-8742-fbab6ed0bfbb\" (UID: \"00912b6a-6857-4728-8742-fbab6ed0bfbb\") " Jun 10 16:56:41.119260 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.119225 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle" (OuterVolumeSpecName: "bundle") pod "00912b6a-6857-4728-8742-fbab6ed0bfbb" (UID: "00912b6a-6857-4728-8742-fbab6ed0bfbb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:56:41.120937 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.120915 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj" (OuterVolumeSpecName: "kube-api-access-gxrhj") pod "00912b6a-6857-4728-8742-fbab6ed0bfbb" (UID: "00912b6a-6857-4728-8742-fbab6ed0bfbb"). InnerVolumeSpecName "kube-api-access-gxrhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:56:41.127704 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.127662 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util" (OuterVolumeSpecName: "util") pod "00912b6a-6857-4728-8742-fbab6ed0bfbb" (UID: "00912b6a-6857-4728-8742-fbab6ed0bfbb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:56:41.220048 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.220007 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxrhj\" (UniqueName: \"kubernetes.io/projected/00912b6a-6857-4728-8742-fbab6ed0bfbb-kube-api-access-gxrhj\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:56:41.220048 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.220040 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-util\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:56:41.220048 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.220053 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00912b6a-6857-4728-8742-fbab6ed0bfbb-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 16:56:41.825428 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.825402 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" Jun 10 16:56:41.825612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.825400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748ddvgl" event={"ID":"00912b6a-6857-4728-8742-fbab6ed0bfbb","Type":"ContainerDied","Data":"decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc"} Jun 10 16:56:41.825612 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:41.825518 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="decdf02d057a74cdc6d38a61de01a771917accba460e8d9f39f71f9b6cbf32bc" Jun 10 16:56:49.033690 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.033654 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-v9vc6"] Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.033987 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="pull" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.033998 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="pull" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.034007 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="extract" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.034013 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="extract" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.034025 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="util" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.034031 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="util" Jun 10 16:56:49.034098 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.034092 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="00912b6a-6857-4728-8742-fbab6ed0bfbb" containerName="extract" Jun 10 16:56:49.036518 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.036500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" Jun 10 16:56:49.042285 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.042259 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 16:56:49.042442 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.042326 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 16:56:49.042442 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.042259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-pmr82\"" Jun 10 16:56:49.048386 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.048362 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-v9vc6"] Jun 10 16:56:49.076226 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.076181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4r7\" (UniqueName: \"kubernetes.io/projected/1ad90ad9-9444-4cb0-8b77-d22678c1771b-kube-api-access-tz4r7\") pod \"keycloak-operator-d67dbbb48-v9vc6\" (UID: \"1ad90ad9-9444-4cb0-8b77-d22678c1771b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" Jun 10 16:56:49.177321 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.177275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4r7\" (UniqueName: \"kubernetes.io/projected/1ad90ad9-9444-4cb0-8b77-d22678c1771b-kube-api-access-tz4r7\") pod \"keycloak-operator-d67dbbb48-v9vc6\" (UID: \"1ad90ad9-9444-4cb0-8b77-d22678c1771b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" Jun 10 16:56:49.187341 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.187308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4r7\" (UniqueName: \"kubernetes.io/projected/1ad90ad9-9444-4cb0-8b77-d22678c1771b-kube-api-access-tz4r7\") pod \"keycloak-operator-d67dbbb48-v9vc6\" (UID: \"1ad90ad9-9444-4cb0-8b77-d22678c1771b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" Jun 10 16:56:49.347596 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.347503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" Jun 10 16:56:49.495204 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.495102 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-v9vc6"] Jun 10 16:56:49.497523 ip-10-0-141-105 kubenswrapper[2559]: W0610 16:56:49.497495 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad90ad9_9444_4cb0_8b77_d22678c1771b.slice/crio-60410d969aca6705c1315b8f912bd9c976f325bb21bbb82633acd6be928395ac WatchSource:0}: Error finding container 60410d969aca6705c1315b8f912bd9c976f325bb21bbb82633acd6be928395ac: Status 404 returned error can't find the container with id 60410d969aca6705c1315b8f912bd9c976f325bb21bbb82633acd6be928395ac Jun 10 16:56:49.499051 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.499033 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:56:49.875163 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:49.875121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" event={"ID":"1ad90ad9-9444-4cb0-8b77-d22678c1771b","Type":"ContainerStarted","Data":"60410d969aca6705c1315b8f912bd9c976f325bb21bbb82633acd6be928395ac"} Jun 10 16:56:56.925994 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:56.925888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" event={"ID":"1ad90ad9-9444-4cb0-8b77-d22678c1771b","Type":"ContainerStarted","Data":"dd2b46b7c01024ccb5dab4c06ba5ae1b3c80d782d026b697b3fb28583b52b606"} Jun 10 16:56:56.944973 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:56:56.944917 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-v9vc6" podStartSLOduration=0.685834588 podStartE2EDuration="7.944895756s" totalImagesPullingTime="7.259061168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:56.94264274 +0000 UTC m=+732.361604293" watchObservedRunningTime="2026-06-10 16:56:56.944895756 +0000 UTC m=+732.363857295" Jun 10 16:57:05.841137 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:05.841080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:06.173463 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:06.173427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:06.272880 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:06.272837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:36.831427 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:36.831373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:36.966147 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:36.966103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:42.511692 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:42.511654 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:42.618082 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:42.618051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:42.683178 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:42.683139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:43.017520 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:43.017482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:46.611972 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:46.611895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:57:46.778897 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:57:46.778857 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:17.705143 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:17.705101 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:17.996185 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:17.996077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:18.275378 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:18.275275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:18.374914 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:18.374852 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:29.561429 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:29.561390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:41.167362 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:41.167323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:58:41.273996 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:58:41.273954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:08.729911 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:08.729862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:09.711711 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:09.711658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:19.589485 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:19.589443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:24.907547 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:24.907509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:30.697943 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:30.697888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:45.004529 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:45.004502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:59:45.007336 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:45.007314 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 16:59:47.007610 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:47.007559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:53.844262 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:53.844220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:53.895926 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:53.895870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 16:59:59.737544 ip-10-0-141-105 kubenswrapper[2559]: I0610 16:59:59.737502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:00:00.137847 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.137713 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29685180-qd9dv"] Jun 10 17:00:00.141120 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.141091 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:00.143294 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.143276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9hqfr\"" Jun 10 17:00:00.149211 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.148982 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685180-qd9dv"] Jun 10 17:00:00.270116 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.270072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2hf\" (UniqueName: \"kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf\") pod \"maas-api-key-cleanup-29685180-qd9dv\" (UID: \"c036785a-ce7a-43c4-8e71-1531a1cdfbee\") " pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:00.371354 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.371317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2hf\" (UniqueName: \"kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf\") pod \"maas-api-key-cleanup-29685180-qd9dv\" (UID: \"c036785a-ce7a-43c4-8e71-1531a1cdfbee\") " pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:00.379845 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.379787 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2hf\" (UniqueName: \"kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf\") pod \"maas-api-key-cleanup-29685180-qd9dv\" (UID: \"c036785a-ce7a-43c4-8e71-1531a1cdfbee\") " pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:00.453693 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.453646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:00.619728 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.619699 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685180-qd9dv"] Jun 10 17:00:00.622629 ip-10-0-141-105 kubenswrapper[2559]: W0610 17:00:00.622591 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc036785a_ce7a_43c4_8e71_1531a1cdfbee.slice/crio-11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4 WatchSource:0}: Error finding container 11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4: Status 404 returned error can't find the container with id 11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4 Jun 10 17:00:00.852467 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:00.852376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" event={"ID":"c036785a-ce7a-43c4-8e71-1531a1cdfbee","Type":"ContainerStarted","Data":"11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4"} Jun 10 17:00:04.874170 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:04.874071 2559 generic.go:356] "Generic (PLEG): container finished" podID="c036785a-ce7a-43c4-8e71-1531a1cdfbee" containerID="96408fefca53ae08e6ea31944d129e8385b6dd45c8308dad5188c4bedc1bea72" exitCode=0 Jun 10 17:00:04.874541 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:04.874164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" event={"ID":"c036785a-ce7a-43c4-8e71-1531a1cdfbee","Type":"ContainerDied","Data":"96408fefca53ae08e6ea31944d129e8385b6dd45c8308dad5188c4bedc1bea72"} Jun 10 17:00:06.021690 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.021657 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:06.112213 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.112173 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b2hf\" (UniqueName: \"kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf\") pod \"c036785a-ce7a-43c4-8e71-1531a1cdfbee\" (UID: \"c036785a-ce7a-43c4-8e71-1531a1cdfbee\") " Jun 10 17:00:06.114599 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.114572 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf" (OuterVolumeSpecName: "kube-api-access-8b2hf") pod "c036785a-ce7a-43c4-8e71-1531a1cdfbee" (UID: "c036785a-ce7a-43c4-8e71-1531a1cdfbee"). InnerVolumeSpecName "kube-api-access-8b2hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:00:06.213554 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.213517 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b2hf\" (UniqueName: \"kubernetes.io/projected/c036785a-ce7a-43c4-8e71-1531a1cdfbee-kube-api-access-8b2hf\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jun 10 17:00:06.885173 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.885143 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" Jun 10 17:00:06.885173 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.885151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685180-qd9dv" event={"ID":"c036785a-ce7a-43c4-8e71-1531a1cdfbee","Type":"ContainerDied","Data":"11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4"} Jun 10 17:00:06.885436 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:06.885197 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11954af5c81d7d3f03273cc7109407943474394bd33d6e531cfb36368df291d4" Jun 10 17:00:25.511356 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:25.511311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:00:29.489631 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:00:29.489594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:02:39.957068 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:02:39.956973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:02:40.037468 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:02:40.037420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:04:17.420013 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:17.419978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lgv48_4e8f8e13-f01d-40ba-a73d-44511c82ab60/manager/0.log" Jun 10 17:04:17.542491 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:17.542454 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2rpmg_821bddb6-607a-41dc-9135-0b3ca70f3034/manager/0.log" Jun 10 17:04:17.752252 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:17.752164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685180-qd9dv_c036785a-ce7a-43c4-8e71-1531a1cdfbee/cleanup/0.log" Jun 10 17:04:17.969723 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:17.969693 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-v7jcm_003fa5ff-0f76-4208-a81d-e8dfcab3768c/server/0.log" Jun 10 17:04:18.096792 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:18.096705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-49hrq_7fbf7d40-e066-4fe6-8eda-94c74472e539/manager/0.log" Jun 10 17:04:18.321521 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:18.321492 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-fht26_7e57c342-3a3d-4c25-aeab-aab5a8bf6820/copy-manifests/0.log" Jun 10 17:04:18.328702 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:18.328674 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-fht26_7e57c342-3a3d-4c25-aeab-aab5a8bf6820/manager/0.log" Jun 10 17:04:18.549397 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:18.549358 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rmtn8_5816e435-1517-4e60-b37d-709348368ede/postgres/0.log" Jun 10 17:04:20.002047 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:20.002011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9xcs4_8afb64bc-3ea5-45ec-b014-0bf1aa2732e1/manager/0.log" Jun 10 17:04:20.564243 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:20.564203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g84xl_10c8bf80-5c45-4a9e-b3eb-b205a90690e6/manager/0.log" Jun 10 17:04:21.018538 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:21.018500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmtn_11b5ee7c-8e6a-4d6b-805d-c04568b6ea72/discovery/0.log" Jun 10 17:04:21.130698 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:21.130659 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-f7fhf_362cae75-205e-4d0e-9d2d-cc1065feb9c3/kube-auth-proxy/0.log" Jun 10 17:04:26.221970 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.221931 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-854d7/must-gather-mxvdc"] Jun 10 17:04:26.222386 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.222273 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c036785a-ce7a-43c4-8e71-1531a1cdfbee" containerName="cleanup" Jun 10 17:04:26.222386 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.222285 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c036785a-ce7a-43c4-8e71-1531a1cdfbee" containerName="cleanup" Jun 10 17:04:26.222386 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.222344 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c036785a-ce7a-43c4-8e71-1531a1cdfbee" containerName="cleanup" Jun 10 17:04:26.225262 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.225241 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.227498 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.227475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-854d7\"/\"default-dockercfg-cd8ht\"" Jun 10 17:04:26.227613 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.227546 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"kube-root-ca.crt\"" Jun 10 17:04:26.227613 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.227546 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"openshift-service-ca.crt\"" Jun 10 17:04:26.240404 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.240368 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/must-gather-mxvdc"] Jun 10 17:04:26.252167 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.252131 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:04:26.295952 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.295907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-must-gather-output\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.296137 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.295972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8sgz\" (UniqueName: \"kubernetes.io/projected/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-kube-api-access-g8sgz\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.396713 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.396671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8sgz\" (UniqueName: \"kubernetes.io/projected/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-kube-api-access-g8sgz\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.396949 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.396770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-must-gather-output\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.397157 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.397139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-must-gather-output\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.404518 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.404485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8sgz\" (UniqueName: \"kubernetes.io/projected/9fbd217f-7f0f-4ad1-bf7b-579778e9243f-kube-api-access-g8sgz\") pod \"must-gather-mxvdc\" (UID: \"9fbd217f-7f0f-4ad1-bf7b-579778e9243f\") " pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.535617 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.535516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/must-gather-mxvdc" Jun 10 17:04:26.675492 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.675467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/must-gather-mxvdc"] Jun 10 17:04:26.677977 ip-10-0-141-105 kubenswrapper[2559]: W0610 17:04:26.677948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fbd217f_7f0f_4ad1_bf7b_579778e9243f.slice/crio-3da5bc27e89600695ba79371d20cb73d907b5f935840fb6e892d0dfc704b89b4 WatchSource:0}: Error finding container 3da5bc27e89600695ba79371d20cb73d907b5f935840fb6e892d0dfc704b89b4: Status 404 returned error can't find the container with id 3da5bc27e89600695ba79371d20cb73d907b5f935840fb6e892d0dfc704b89b4 Jun 10 17:04:26.679935 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:26.679918 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:04:27.233392 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:27.233354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/must-gather-mxvdc" event={"ID":"9fbd217f-7f0f-4ad1-bf7b-579778e9243f","Type":"ContainerStarted","Data":"3da5bc27e89600695ba79371d20cb73d907b5f935840fb6e892d0dfc704b89b4"} Jun 10 17:04:27.425067 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:27.425027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" limit=1024 Jun 10 17:04:28.242061 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:28.241966 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/must-gather-mxvdc" event={"ID":"9fbd217f-7f0f-4ad1-bf7b-579778e9243f","Type":"ContainerStarted","Data":"1b9ca698396657aae9f4a3380ab380ad9efb399f1a447b0347173601eeb79bca"} Jun 10 17:04:28.242061 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:28.242028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/must-gather-mxvdc" event={"ID":"9fbd217f-7f0f-4ad1-bf7b-579778e9243f","Type":"ContainerStarted","Data":"b356499f13aa64331f65ae524e1fb9501becc89545311cb3d68a6a0c1fdb82fc"} Jun 10 17:04:28.258971 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:28.258888 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-854d7/must-gather-mxvdc" podStartSLOduration=1.495535757 podStartE2EDuration="2.258843306s" totalImagesPullingTime="763.307549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:04:28.258254731 +0000 UTC m=+1183.677216295" watchObservedRunningTime="2026-06-10 17:04:28.258843306 +0000 UTC m=+1183.677804842" Jun 10 17:04:29.161203 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:29.161172 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tg948_bb0f6760-63fb-41b8-81d5-854853a9b4ba/global-pull-secret-syncer/0.log" Jun 10 17:04:29.216115 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:29.216078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4hpmv_f86ded2c-daa8-41d1-b7ef-d853114e66f4/konnectivity-agent/0.log" Jun 10 17:04:29.323209 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:29.323141 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-105.ec2.internal_628f415a9f2c3046f7d08d14bd680499/haproxy/0.log" Jun 10 17:04:32.804470 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:32.804408 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-hmflb_efdf4a9a-1a8c-4e0d-86ed-5087cb12979a/sail-operator/0.log" Jun 10 17:04:34.436949 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:34.436916 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9xcs4_8afb64bc-3ea5-45ec-b014-0bf1aa2732e1/manager/0.log" Jun 10 17:04:34.599439 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:34.599401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g84xl_10c8bf80-5c45-4a9e-b3eb-b205a90690e6/manager/0.log" Jun 10 17:04:36.713849 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:36.713801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/node-exporter/0.log" Jun 10 17:04:36.734587 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:36.734517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/kube-rbac-proxy/0.log" Jun 10 17:04:36.754149 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:36.754108 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xw5nf_6e8f1d4f-5365-4470-a390-92e2691b7d89/init-textfile/0.log" Jun 10 17:04:39.008523 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:39.008493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-kmhdr_7f4c6d36-0207-4be5-b10b-979b0a642148/networking-console-plugin/0.log" Jun 10 17:04:40.545347 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.545310 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-946nk"] Jun 10 17:04:40.552639 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.552604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.557789 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.557759 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-946nk"] Jun 10 17:04:40.649939 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.649897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-podres\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.650136 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.649957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gnt\" (UniqueName: \"kubernetes.io/projected/6a580b51-63d3-4016-a392-3b18a8b68712-kube-api-access-c4gnt\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.650136 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.649998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-sys\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.650136 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.650034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-proc\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.650136 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.650101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-lib-modules\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751103 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-podres\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751103 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gnt\" (UniqueName: \"kubernetes.io/projected/6a580b51-63d3-4016-a392-3b18a8b68712-kube-api-access-c4gnt\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-sys\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-proc\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-podres\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-sys\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751349 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-proc\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751547 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-lib-modules\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.751595 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.751578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a580b51-63d3-4016-a392-3b18a8b68712-lib-modules\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.759304 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.759264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gnt\" (UniqueName: \"kubernetes.io/projected/6a580b51-63d3-4016-a392-3b18a8b68712-kube-api-access-c4gnt\") pod \"perf-node-gather-daemonset-946nk\" (UID: \"6a580b51-63d3-4016-a392-3b18a8b68712\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:40.867129 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:40.866787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:41.075954 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:41.075917 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-946nk"] Jun 10 17:04:41.080487 ip-10-0-141-105 kubenswrapper[2559]: W0610 17:04:41.080449 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a580b51_63d3_4016_a392_3b18a8b68712.slice/crio-9c434f99eaf3ed8cd707bdfbcce2fd8ec82b700a79d128c8fa37c376866c9b91 WatchSource:0}: Error finding container 9c434f99eaf3ed8cd707bdfbcce2fd8ec82b700a79d128c8fa37c376866c9b91: Status 404 returned error can't find the container with id 9c434f99eaf3ed8cd707bdfbcce2fd8ec82b700a79d128c8fa37c376866c9b91 Jun 10 17:04:41.339270 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:41.339235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" event={"ID":"6a580b51-63d3-4016-a392-3b18a8b68712","Type":"ContainerStarted","Data":"12862ba4d32d6ee618190aeaa361b8b4396d06f1510771f70026a81e9444f68d"} Jun 10 17:04:41.339490 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:41.339297 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" event={"ID":"6a580b51-63d3-4016-a392-3b18a8b68712","Type":"ContainerStarted","Data":"9c434f99eaf3ed8cd707bdfbcce2fd8ec82b700a79d128c8fa37c376866c9b91"} Jun 10 17:04:41.339490 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:41.339331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:41.356128 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:41.356052 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" podStartSLOduration=1.356024957 podStartE2EDuration="1.356024957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:04:41.353827693 +0000 UTC m=+1196.772789229" watchObservedRunningTime="2026-06-10 17:04:41.356024957 +0000 UTC m=+1196.774986500" Jun 10 17:04:42.341223 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:42.341192 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z72fb_9f61e0b1-d9da-4505-ad15-204dfea8723e/dns/0.log" Jun 10 17:04:42.360094 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:42.360057 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z72fb_9f61e0b1-d9da-4505-ad15-204dfea8723e/kube-rbac-proxy/0.log" Jun 10 17:04:42.403002 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:42.402973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ksg46_7331b2fa-118f-4781-b732-560f49f1ab62/dns-node-resolver/0.log" Jun 10 17:04:42.951635 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:42.951599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75fb6474df-vjnv9_112db6fa-3a90-4fa0-9dcb-9db7162cd1b2/registry/0.log" Jun 10 17:04:42.958317 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:42.958287 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75fb6474df-vjnv9_112db6fa-3a90-4fa0-9dcb-9db7162cd1b2/registry/1.log" Jun 10 17:04:43.000288 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:43.000255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b7htg_7cd0a680-3a66-442b-8d8b-3980a1a11c19/node-ca/0.log" Jun 10 17:04:44.070829 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:44.070781 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmtn_11b5ee7c-8e6a-4d6b-805d-c04568b6ea72/discovery/0.log" Jun 10 17:04:44.096883 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:44.096851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-f7fhf_362cae75-205e-4d0e-9d2d-cc1065feb9c3/kube-auth-proxy/0.log" Jun 10 17:04:44.860989 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:44.860942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zknq8_716d615a-3a84-4647-9d52-1fd0ad695bfb/serve-healthcheck-canary/0.log" Jun 10 17:04:45.039539 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:45.039504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 17:04:45.039986 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:45.039968 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-frfnp_ac7fd6d5-277e-4ba8-8661-7e4806fa4ba1/ovn-acl-logging/0.log" Jun 10 17:04:45.484385 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:45.484349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lp4pf_1c4b710f-e872-41fb-bb3b-58e79b48256f/kube-rbac-proxy/0.log" Jun 10 17:04:45.503484 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:45.503448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lp4pf_1c4b710f-e872-41fb-bb3b-58e79b48256f/exporter/0.log" Jun 10 17:04:45.524087 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:45.524061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lp4pf_1c4b710f-e872-41fb-bb3b-58e79b48256f/extractor/0.log" Jun 10 17:04:47.356719 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:47.356666 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-946nk" Jun 10 17:04:47.940670 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:47.940633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lgv48_4e8f8e13-f01d-40ba-a73d-44511c82ab60/manager/0.log" Jun 10 17:04:47.982209 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:47.982173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-2rpmg_821bddb6-607a-41dc-9135-0b3ca70f3034/manager/0.log" Jun 10 17:04:48.029982 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.029954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685180-qd9dv_c036785a-ce7a-43c4-8e71-1531a1cdfbee/cleanup/0.log" Jun 10 17:04:48.094726 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.094664 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-v7jcm_003fa5ff-0f76-4208-a81d-e8dfcab3768c/server/0.log" Jun 10 17:04:48.169458 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.169422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-49hrq_7fbf7d40-e066-4fe6-8eda-94c74472e539/manager/0.log" Jun 10 17:04:48.255023 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.254910 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-fht26_7e57c342-3a3d-4c25-aeab-aab5a8bf6820/manager/0.log" Jun 10 17:04:48.273585 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.273546 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-fht26_7e57c342-3a3d-4c25-aeab-aab5a8bf6820/copy-manifests/0.log" Jun 10 17:04:48.351910 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:48.351877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rmtn8_5816e435-1517-4e60-b37d-709348368ede/postgres/0.log" Jun 10 17:04:56.157165 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:56.157124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmtn_11b5ee7c-8e6a-4d6b-805d-c04568b6ea72/discovery/0.log" Jun 10 17:04:56.168739 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:56.168717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-f7fhf_362cae75-205e-4d0e-9d2d-cc1065feb9c3/kube-auth-proxy/0.log" Jun 10 17:04:57.061543 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.061511 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/kube-multus-additional-cni-plugins/0.log" Jun 10 17:04:57.081247 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.081215 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/egress-router-binary-copy/0.log" Jun 10 17:04:57.100736 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.100703 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/cni-plugins/0.log" Jun 10 17:04:57.121905 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.121869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/bond-cni-plugin/0.log" Jun 10 17:04:57.139968 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.139939 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/routeoverride-cni/0.log" Jun 10 17:04:57.160340 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.160310 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/whereabouts-cni-bincopy/0.log" Jun 10 17:04:57.178846 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.178799 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-68z29_ecdfe914-0186-429c-a2ef-d681c40d1f57/whereabouts-cni/0.log" Jun 10 17:04:57.431839 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.431788 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qbmtn_11b5ee7c-8e6a-4d6b-805d-c04568b6ea72/discovery/0.log" Jun 10 17:04:57.441885 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.441856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bbd649b8-f7fhf_362cae75-205e-4d0e-9d2d-cc1065feb9c3/kube-auth-proxy/0.log" Jun 10 17:04:57.495333 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.495300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f9k8w_7ff1ab10-1518-40b3-a4c7-af352b0cadbc/kube-multus/0.log" Jun 10 17:04:57.631251 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.631220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gmcfv_b081f2c5-6532-4993-8d4c-5c489eaad0de/network-metrics-daemon/0.log" Jun 10 17:04:57.651711 ip-10-0-141-105 kubenswrapper[2559]: I0610 17:04:57.651675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gmcfv_b081f2c5-6532-4993-8d4c-5c489eaad0de/kube-rbac-proxy/0.log"