Jun 10 01:01:51.212637 ip-10-0-142-67 systemd[1]: Starting Kubernetes Kubelet... Jun 10 01:01:51.531635 ip-10-0-142-67 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:51.531635 ip-10-0-142-67 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 01:01:51.531635 ip-10-0-142-67 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:51.531635 ip-10-0-142-67 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 01:01:51.531635 ip-10-0-142-67 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:01:51.533235 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.533158 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 01:01:51.537420 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537402 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.537420 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537418 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.537420 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537423 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.537420 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537427 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537431 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537436 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537440 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537444 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537448 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537452 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537455 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537466 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537470 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537474 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537477 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537483 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537487 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537491 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537495 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537499 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537503 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537507 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537511 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.537665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537515 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537519 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537523 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537527 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537531 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537535 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537540 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537544 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537549 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537553 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537558 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537562 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537568 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537574 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537580 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537586 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537592 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537597 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537602 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.538504 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537606 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537611 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537615 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537620 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537627 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537631 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537636 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537641 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537645 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537650 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537654 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537659 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537664 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537668 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537672 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537677 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537681 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537686 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537690 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537695 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.539378 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537699 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537705 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537709 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537714 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537719 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537723 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537727 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537735 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537739 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537745 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537749 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537756 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537761 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537766 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537771 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537775 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537779 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537784 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537788 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.540201 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537794 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537800 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537804 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537808 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537812 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537816 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537821 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537825 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537829 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537833 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537837 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537841 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537845 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537849 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537853 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537856 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537861 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.537865 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539036 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.541032 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539046 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539053 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539058 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539063 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539069 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539074 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539079 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539084 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539089 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539093 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539097 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539101 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539106 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539110 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539114 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539118 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539122 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539126 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539131 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.541912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539135 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539139 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539143 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539147 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539151 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539156 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539160 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539164 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539168 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539172 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539176 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539180 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539184 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539188 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539193 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539197 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539201 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539205 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539210 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539214 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.542665 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539219 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539224 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539228 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539233 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539237 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539241 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539246 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539250 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539254 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539258 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539262 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539266 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539269 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539274 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539278 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539282 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539286 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539291 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539297 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.543333 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539302 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539324 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539331 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539335 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539340 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539347 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539352 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539357 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539361 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539365 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539369 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539373 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539377 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539382 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539388 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539393 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539398 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539404 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539409 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539413 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.543866 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539417 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539421 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539426 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539430 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539434 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539438 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539442 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539446 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539450 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539455 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539459 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539463 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539468 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539472 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539475 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539479 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539484 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539487 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539492 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.539496 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.544413 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540121 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540129 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540133 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540138 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540149 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540154 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540158 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540166 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540171 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540176 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540180 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540184 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540188 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540192 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540196 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540203 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540208 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540212 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540217 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540222 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.544933 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540226 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540231 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540236 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540240 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540244 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540249 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540253 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540257 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540261 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540266 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540270 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540274 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540278 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540282 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540286 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540290 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540296 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540329 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.545452 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540333 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540337 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540341 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540345 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540349 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540353 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540357 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540361 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540365 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540369 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540373 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540378 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540382 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540386 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540390 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540395 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540399 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540404 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540408 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540412 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540416 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.545891 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540420 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540424 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540428 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540435 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540439 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540444 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540448 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540452 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540456 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540459 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540466 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540481 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540487 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540491 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540496 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540500 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540505 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540509 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540513 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540517 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.546465 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540523 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540527 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540531 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540539 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540543 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540547 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540552 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540556 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540560 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540564 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540568 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540572 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540576 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540580 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540584 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540593 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540597 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540601 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540606 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.540610 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.546948 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540716 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540726 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540743 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540750 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540764 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540769 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540776 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540782 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540787 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540792 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540798 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540803 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540808 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540813 2568 flags.go:64] FLAG: --cgroup-root="" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540817 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540823 2568 flags.go:64] FLAG: --client-ca-file="" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540828 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540833 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540843 2568 flags.go:64] FLAG: --cluster-domain="" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540848 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540853 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540857 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540863 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540876 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 01:01:51.547523 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540882 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540887 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540892 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540898 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540903 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540907 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540912 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540917 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540924 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540929 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540934 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540938 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540943 2568 flags.go:64] FLAG: --enable-server="true" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540959 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540969 2568 flags.go:64] FLAG: --event-burst="100" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540974 2568 flags.go:64] FLAG: --event-qps="50" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540979 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540984 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540989 2568 flags.go:64] FLAG: --eviction-hard="" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540994 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.540998 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541003 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541008 2568 flags.go:64] FLAG: --eviction-soft="" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541015 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541019 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 01:01:51.548109 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541024 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541028 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541032 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541037 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541041 2568 flags.go:64] FLAG: --feature-gates="" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541047 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541051 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541055 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541060 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541065 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541072 2568 flags.go:64] FLAG: --help="false" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541076 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541082 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541086 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541091 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541096 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541101 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541106 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541111 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541115 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541120 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541126 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541131 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541136 2568 flags.go:64] FLAG: --kube-reserved="" Jun 10 01:01:51.548741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541141 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541145 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541150 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541155 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541159 2568 flags.go:64] FLAG: --lock-file="" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541164 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541169 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541173 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541182 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541186 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541190 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541195 2568 flags.go:64] FLAG: --logging-format="text" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541199 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541205 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541209 2568 flags.go:64] FLAG: --manifest-url="" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541214 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541220 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541224 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541232 2568 flags.go:64] FLAG: --max-pods="110" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541238 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541242 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541247 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541251 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541256 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541261 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 01:01:51.549357 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541266 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541276 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541281 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541285 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541290 2568 flags.go:64] FLAG: --pod-cidr="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541296 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541324 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541330 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541334 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541339 2568 flags.go:64] FLAG: --port="10250" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541343 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541348 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af678f13d6fb9256" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541353 2568 flags.go:64] FLAG: --qos-reserved="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541358 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541364 2568 flags.go:64] FLAG: --register-node="true" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541369 2568 flags.go:64] FLAG: --register-with-taints="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541375 2568 flags.go:64] FLAG: --registry-burst="10" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541379 2568 flags.go:64] FLAG: --registry-qps="5" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541384 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541388 2568 flags.go:64] FLAG: --reserved-memory="" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541394 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541399 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541404 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541408 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541413 2568 flags.go:64] FLAG: --runonce="false" Jun 10 01:01:51.550009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541419 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541425 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541430 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541435 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541439 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541444 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541449 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541454 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541458 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541463 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541467 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541473 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541479 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541485 2568 flags.go:64] FLAG: --system-cgroups="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541489 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541498 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541503 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541507 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541514 2568 flags.go:64] FLAG: --tls-min-version="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541519 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541524 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541528 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541533 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541538 2568 flags.go:64] FLAG: --v="2" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541544 2568 flags.go:64] FLAG: --version="false" Jun 10 01:01:51.550639 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541550 2568 flags.go:64] FLAG: --vmodule="" Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541555 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.541560 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541796 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541804 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541809 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541813 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541820 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541824 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541829 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541835 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541839 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541844 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541849 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541853 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541858 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541862 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541867 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541871 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541875 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.551256 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541879 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541891 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541895 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541899 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541903 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541908 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541914 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541919 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541923 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541927 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541931 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541937 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541943 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541948 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541953 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541958 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541963 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541967 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541971 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.551832 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541976 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541980 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541985 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541989 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541993 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.541997 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542002 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542006 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542010 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542014 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542018 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542022 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542026 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542030 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542034 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542046 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542050 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542055 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542060 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542064 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.552299 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542068 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542073 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542077 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542081 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542085 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542089 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542093 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542097 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542101 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542105 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542109 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542114 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542120 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542124 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542128 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542132 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542136 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542143 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542148 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542153 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.552801 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542157 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542162 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542166 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542170 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542174 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542178 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542182 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542186 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542200 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542205 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542210 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542214 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542218 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542222 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542227 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542231 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542235 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542240 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542245 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.553291 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542249 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542252 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542257 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.542261 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.542269 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.549032 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.549047 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.549867 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.549875 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549944 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549949 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549952 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549955 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549959 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549962 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.553797 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549965 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549967 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549970 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549972 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549975 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549977 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549980 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549983 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549985 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549988 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549990 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549993 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.549997 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550000 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550004 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550006 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550009 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550011 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550014 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550017 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.554171 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550020 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550022 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550025 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550029 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550031 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550034 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550037 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550040 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550042 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550045 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550047 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550049 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550052 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550055 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550057 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550060 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550064 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550067 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550070 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550073 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.554737 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550076 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550078 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550081 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550084 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550087 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550090 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550093 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550096 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550098 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550101 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550103 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550105 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550108 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550110 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550113 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550116 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550119 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550121 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550124 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550126 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.555230 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550129 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550132 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550134 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550137 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550139 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550142 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550144 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550146 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550149 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550151 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550154 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550156 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550158 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550160 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550164 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550168 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550171 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550174 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550177 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.555773 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550179 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550182 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550184 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550187 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550190 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550192 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550195 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550198 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550200 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550203 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550206 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550209 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550211 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550215 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.550219 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:51.556231 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550358 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550363 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550366 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550369 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550371 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550373 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550376 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550378 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550381 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550383 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550385 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550388 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550390 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550393 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550395 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550398 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550400 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550403 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550405 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550407 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:01:51.556621 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550410 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550412 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550415 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550417 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550419 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550422 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550425 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550427 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550430 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550432 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550435 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550438 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550440 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550442 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550445 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550447 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550449 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550452 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550454 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550456 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:01:51.557103 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550459 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550461 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550463 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550466 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550468 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550470 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550473 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550475 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550477 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550480 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550482 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550485 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550487 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550489 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550492 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550496 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550499 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550501 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550504 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:01:51.557615 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550507 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550510 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550513 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550517 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550520 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550523 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550526 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550528 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550531 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550533 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550535 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550538 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550540 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550543 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550546 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550549 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550551 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550554 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550557 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:01:51.558079 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550559 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550561 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550564 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550566 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550568 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550571 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550573 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550575 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550578 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550580 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550582 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550585 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550587 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550590 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550592 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550594 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550597 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550600 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550602 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550605 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:01:51.558856 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:51.550607 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.550612 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.550707 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.553922 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.555075 2568 server.go:1019] "Starting client certificate rotation" Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.555212 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.555249 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:01:51.559515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.557384 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:01:51.561096 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.561080 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:01:51.571819 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.571802 2568 log.go:25] "Validated CRI v1 runtime API" Jun 10 01:01:51.574179 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.574164 2568 log.go:25] "Validated CRI v1 image API" Jun 10 01:01:51.574983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.574968 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 01:01:51.578677 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.578658 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f67c6c5-e9c7-4620-9f94-b1816d717787:/dev/nvme0n1p3 ba5fcc77-a1ef-4dd8-bbad-c13b5e7b42ea:/dev/nvme0n1p4] Jun 10 01:01:51.578724 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.578677 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 01:01:51.579700 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.579682 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:01:51.583812 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.583701 2568 manager.go:216] Machine: {Timestamp:2026-06-10 01:01:51.582569006 +0000 UTC m=+0.270714622 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094847 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a924f09b3b8368611d0d8795b1a68 SystemUUID:ec2a924f-09b3-b836-8611-d0d8795b1a68 BootID:11f8a9a6-4fe9-40d8-8101-7d2387da8982 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:c4:b8:7c:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:c4:b8:7c:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:51:05:e6:5c:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 01:01:51.583812 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.583805 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 01:01:51.583924 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.583891 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 01:01:51.585345 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.585320 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 01:01:51.585468 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.585349 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 01:01:51.586419 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.586409 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 01:01:51.586451 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.586421 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 01:01:51.586451 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.586428 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:01:51.587057 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.587046 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:01:51.587797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.587787 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 01:01:51.590422 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590410 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:01:51.590524 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590514 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 01:01:51.590566 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590542 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 10 01:01:51.590566 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590553 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 01:01:51.590566 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590562 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 01:01:51.590679 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590570 2568 kubelet.go:398] "Adding apiserver pod source" Jun 10 01:01:51.590679 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590579 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 01:01:51.591007 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.590897 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:01:51.591045 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.591017 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:01:51.592675 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.592659 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 01:01:51.595778 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.595764 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 01:01:51.595848 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.595794 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 01:01:51.596937 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596927 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596942 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596948 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596954 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596962 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596968 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596976 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 01:01:51.596980 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596981 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 01:01:51.597164 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596987 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 01:01:51.597164 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.596992 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 01:01:51.597164 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.597001 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 01:01:51.597164 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.597006 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 01:01:51.597612 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.597602 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 01:01:51.597612 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.597612 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 01:01:51.599238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.599220 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d4bvr" Jun 10 01:01:51.600567 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.600551 2568 server.go:1268] "Started kubelet" Jun 10 01:01:51.600654 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.600634 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 01:01:51.600701 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.600652 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 01:01:51.600837 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.600674 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 01:01:51.603791 ip-10-0-142-67 systemd[1]: Started Kubernetes Kubelet. Jun 10 01:01:51.607410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.605067 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d4bvr" Jun 10 01:01:51.607410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.605102 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 01:01:51.607410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.605269 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 10 01:01:51.611434 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.611409 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 01:01:51.611434 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.611408 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 01:01:51.611554 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.611416 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 01:01:51.612424 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.612404 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 01:01:51.612650 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.612540 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:51.612650 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.611637 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-67.ec2.internal.18b7928cebfb7dff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-67.ec2.internal,UID:ip-10-0-142-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-67.ec2.internal,},FirstTimestamp:2026-06-10 01:01:51.600524799 +0000 UTC m=+0.288670415,LastTimestamp:2026-06-10 01:01:51.600524799 +0000 UTC m=+0.288670415,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-67.ec2.internal,}" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.612927 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.612975 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613047 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613059 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613181 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 10 01:01:51.613273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613189 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613853 2568 factory.go:55] Registering systemd factory Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.613870 2568 factory.go:223] Registration of the systemd container factory successfully Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.614063 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614076 2568 factory.go:153] Registering CRI-O factory Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614088 2568 factory.go:223] Registration of the crio container factory successfully Jun 10 01:01:51.614138 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614140 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 01:01:51.614486 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614164 2568 factory.go:103] Registering Raw factory Jun 10 01:01:51.614486 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614177 2568 manager.go:1196] Started watching for new ooms in manager Jun 10 01:01:51.614608 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.614590 2568 manager.go:349] Starting recovery of all containers Jun 10 01:01:51.617924 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.617895 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:51.623026 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.623007 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-67.ec2.internal\" not found" node="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.624613 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.624600 2568 manager.go:354] Recovery completed Jun 10 01:01:51.628535 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.628524 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.630115 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630102 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.630165 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630131 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.630165 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630143 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.630741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630722 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 01:01:51.630814 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630741 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 01:01:51.630814 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630757 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.630814 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.630769 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:01:51.631415 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631397 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.631699 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631428 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.631787 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631709 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.631921 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631901 2568 policy_none.go:49] "None policy: Start" Jun 10 01:01:51.631978 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631947 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 01:01:51.631978 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.631962 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 01:01:51.632970 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.632953 2568 policy_none.go:47] "Start" Jun 10 01:01:51.669034 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669018 2568 manager.go:337] "Starting Device Plugin manager" Jun 10 01:01:51.669125 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.669093 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 01:01:51.669125 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669107 2568 server.go:87] "Starting device plugin registration server" Jun 10 01:01:51.669466 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669330 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 01:01:51.669466 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669342 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 01:01:51.669706 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669494 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 01:01:51.669706 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669582 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 01:01:51.669706 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.669591 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 01:01:51.670091 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.670070 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 01:01:51.670177 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.670116 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:51.682651 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.682627 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 01:01:51.683878 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.683861 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 01:01:51.683923 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.683909 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 01:01:51.683957 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.683929 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 01:01:51.683985 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.683968 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 01:01:51.685797 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.685782 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:51.770431 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.770402 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.771253 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.771240 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.771330 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.771266 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.771330 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.771281 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.771404 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.771340 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.779064 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.779042 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.779064 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.779064 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-67.ec2.internal\": node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:51.784959 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.784914 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal"] Jun 10 01:01:51.785022 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.784964 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.786519 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.786507 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.786559 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.786531 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.786559 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.786540 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.787754 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.787742 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.787886 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.787869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.787952 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.787895 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.788364 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788348 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.788439 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788373 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.788439 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788379 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.788439 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788400 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.788439 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788409 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.788439 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.788382 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.789429 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.789416 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.789465 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.789441 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:01:51.790052 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.790039 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:01:51.790110 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.790062 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:01:51.790110 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.790072 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:01:51.795599 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.795583 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:51.821894 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.821873 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-67.ec2.internal\" not found" node="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.826221 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.826205 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-67.ec2.internal\" not found" node="ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.896123 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.896106 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:51.914342 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.914319 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.914424 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.914353 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2daa11601870c184cfcbf1281d3c8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-67.ec2.internal\" (UID: \"2daa11601870c184cfcbf1281d3c8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.914424 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:51.914379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:51.997032 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:51.997005 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.015367 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2daa11601870c184cfcbf1281d3c8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-67.ec2.internal\" (UID: \"2daa11601870c184cfcbf1281d3c8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.015413 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.015413 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.015479 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.015479 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015445 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2daa11601870c184cfcbf1281d3c8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-67.ec2.internal\" (UID: \"2daa11601870c184cfcbf1281d3c8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.015479 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.015462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7bd4f6488a73339f42dd9a91533397e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal\" (UID: \"f7bd4f6488a73339f42dd9a91533397e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.097788 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.097734 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.126213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.126193 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.130658 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.130643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.198251 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.198221 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.298686 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.298660 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.399153 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.399103 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.499606 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.499584 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.555042 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.555021 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 01:01:52.555625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.555181 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:52.555625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.555182 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:01:52.600463 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:52.600438 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-67.ec2.internal\" not found" Jun 10 01:01:52.611628 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.611599 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:56:51 +0000 UTC" deadline="2028-03-21 09:18:25.871906442 +0000 UTC" Jun 10 01:01:52.611628 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.611626 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15608h16m33.260283638s" Jun 10 01:01:52.620123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.620104 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:52.654553 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:52.654488 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daa11601870c184cfcbf1281d3c8d4d.slice/crio-79635375af4c328477139cd63c2fb8e028f0c789fdbcb703b9d72f825d4cd5e0 WatchSource:0}: Error finding container 79635375af4c328477139cd63c2fb8e028f0c789fdbcb703b9d72f825d4cd5e0: Status 404 returned error can't find the container with id 79635375af4c328477139cd63c2fb8e028f0c789fdbcb703b9d72f825d4cd5e0 Jun 10 01:01:52.655142 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:52.655123 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bd4f6488a73339f42dd9a91533397e.slice/crio-74f402bb9cb2553b4bdd4a11ed15c7e3d36b1e282bf6321e797afa900d1c6afc WatchSource:0}: Error finding container 74f402bb9cb2553b4bdd4a11ed15c7e3d36b1e282bf6321e797afa900d1c6afc: Status 404 returned error can't find the container with id 74f402bb9cb2553b4bdd4a11ed15c7e3d36b1e282bf6321e797afa900d1c6afc Jun 10 01:01:52.659853 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.659834 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:01:52.687105 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.687067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" event={"ID":"f7bd4f6488a73339f42dd9a91533397e","Type":"ContainerStarted","Data":"74f402bb9cb2553b4bdd4a11ed15c7e3d36b1e282bf6321e797afa900d1c6afc"} Jun 10 01:01:52.688000 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.687975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" event={"ID":"2daa11601870c184cfcbf1281d3c8d4d","Type":"ContainerStarted","Data":"79635375af4c328477139cd63c2fb8e028f0c789fdbcb703b9d72f825d4cd5e0"} Jun 10 01:01:52.712881 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.712858 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.723010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.722989 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:52.725133 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.725120 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" Jun 10 01:01:52.730715 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.730701 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:01:52.873558 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:52.873532 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:53.591674 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.591646 2568 apiserver.go:52] "Watching apiserver" Jun 10 01:01:53.598818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.598791 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 01:01:53.599198 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.599177 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-7tqt9","openshift-multus/network-metrics-daemon-r64zg","openshift-network-diagnostics/network-check-target-d6chp","kube-system/konnectivity-agent-gv2h2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl","openshift-dns/node-resolver-sgkpn","openshift-multus/multus-8g9qj","openshift-network-operator/iptables-alerter-9zrt6","openshift-ovn-kubernetes/ovnkube-node-9tzsb","kube-system/global-pull-secret-syncer-hr9wq","kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dlvmp","openshift-image-registry/node-ca-9d8rm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal"] Jun 10 01:01:53.601853 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.601817 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.604033 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.603914 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.604033 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.603973 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.604202 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.604183 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cttd9\"" Jun 10 01:01:53.604354 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.604336 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 01:01:53.604435 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.604381 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.604488 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.604457 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 01:01:53.606216 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.606039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:53.606216 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.606046 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.606216 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.606109 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:01:53.606680 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.606656 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ss2ch\"" Jun 10 01:01:53.606787 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.606687 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 01:01:53.606845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.606816 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.608247 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.608228 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.610393 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.610374 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.610788 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.610773 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgh54\"" Jun 10 01:01:53.610941 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.610926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 01:01:53.611049 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.611034 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 01:01:53.612212 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.612194 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.612550 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.612531 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.612672 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.612646 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpcd7\"" Jun 10 01:01:53.612857 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.612651 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 01:01:53.613242 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.613057 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.613242 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.613174 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 01:01:53.615047 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.614855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.615047 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.614985 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.615552 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.615529 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.616695 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.616675 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bfh8\"" Jun 10 01:01:53.617067 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.617048 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 01:01:53.617626 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.617609 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j7frh\"" Jun 10 01:01:53.619942 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.618376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 01:01:53.619942 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.618879 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 01:01:53.619942 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.619060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.619942 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.619849 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.620141 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.620127 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 01:01:53.620598 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.620580 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.622014 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.621996 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 01:01:53.622085 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622040 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 01:01:53.622196 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622176 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t5jmc\"" Jun 10 01:01:53.622339 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622291 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.622427 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.622370 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:01:53.622494 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-multus\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.622494 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-kubelet\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.622494 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-multus-certs\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.622623 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvblt\" (UniqueName: \"kubernetes.io/projected/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-kube-api-access-nvblt\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.622623 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t26kl\" (UniqueName: \"kubernetes.io/projected/7997d564-5cbc-406b-bdcf-9d076c1cc199-kube-api-access-t26kl\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.622623 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-systemd-units\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.622761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-script-lib\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.622761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-host\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.622761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/339c9df8-4b90-4c3e-a5b8-a2c68954896c-konnectivity-ca\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.622761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622717 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.622761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-etc-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5bgb\" (UniqueName: \"kubernetes.io/projected/e2c2a1ff-923e-4c85-96e0-ebafce404d59-kube-api-access-t5bgb\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-os-release\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-socket-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.622983 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-sys-fs\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.622997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-netns\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-node-log\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-log-socket\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-system-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cnibin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-k8s-cni-cncf-io\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-netns\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-bin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-tmp-dir\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-env-overrides\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cni-binary-copy\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-socket-dir-parent\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-hostroot\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-conf-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-daemon-config\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrds\" (UniqueName: \"kubernetes.io/projected/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-kube-api-access-wjrds\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-serviceca\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-var-lib-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-hosts-file\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.623541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-slash\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-etc-kubernetes\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/339c9df8-4b90-4c3e-a5b8-a2c68954896c-agent-certs\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-registration-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-kubelet\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623666 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-systemd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623732 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-config\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-device-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpvk\" (UniqueName: \"kubernetes.io/projected/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-kube-api-access-wbpvk\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-ovn\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-bin\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-netd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.624090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.623950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovn-node-metrics-cert\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.625937 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.625918 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.626043 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.625975 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:01:53.626733 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.626709 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:01:53.628126 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.628106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.628608 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.628585 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:53.630457 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.630436 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.630896 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.630634 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ctk7h\"" Jun 10 01:01:53.630896 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.630699 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 01:01:53.630896 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.630891 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.631104 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.630914 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.633617 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.633596 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:01:53.633758 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.633737 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-658fx\"" Jun 10 01:01:53.634120 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.634103 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 01:01:53.648245 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.648227 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggjhx" Jun 10 01:01:53.655736 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.655716 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggjhx" Jun 10 01:01:53.714600 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.714564 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 01:01:53.724156 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-hosts-file\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.724156 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724150 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-slash\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-dbus\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-var-lib-kubelet\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724231 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-etc-kubernetes\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/339c9df8-4b90-4c3e-a5b8-a2c68954896c-agent-certs\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.724282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724241 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-hosts-file\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-etc-kubernetes\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724347 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-slash\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-kubelet\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovn-node-metrics-cert\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724487 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-kubelet\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724563 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724548 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-device-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.724697 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724521 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-device-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-ovn\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-netd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724811 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-ovn\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-systemd\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-netd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-sys\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-host\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.724977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-multus\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-kubelet\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-multus\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-multus-certs\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-kubelet\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-multus-certs\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t26kl\" (UniqueName: \"kubernetes.io/projected/7997d564-5cbc-406b-bdcf-9d076c1cc199-kube-api-access-t26kl\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-systemd-units\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-script-lib\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-host\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/339c9df8-4b90-4c3e-a5b8-a2c68954896c-konnectivity-ca\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-systemd-units\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-host\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5bgb\" (UniqueName: \"kubernetes.io/projected/e2c2a1ff-923e-4c85-96e0-ebafce404d59-kube-api-access-t5bgb\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-lib-modules\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-os-release\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-socket-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725582 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-sys-fs\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-node-log\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-log-socket\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.725852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725699 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-env-overrides\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysconfig\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-k8s-cni-cncf-io\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-netns\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-tmp-dir\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-cnibin\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-modprobe-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-conf\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-socket-dir-parent\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-script-lib\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-hostroot\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725959 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/339c9df8-4b90-4c3e-a5b8-a2c68954896c-konnectivity-ca\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725960 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-socket-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.725974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-conf-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrds\" (UniqueName: \"kubernetes.io/projected/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-kube-api-access-wjrds\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-serviceca\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.726363 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-sys-fs\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726067 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-os-release\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-kubelet-config\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-env-overrides\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726099 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-socket-dir-parent\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-hostroot\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726016 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-k8s-cni-cncf-io\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-conf-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-log-socket\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhp6q\" (UniqueName: \"kubernetes.io/projected/f76ae8f6-9394-4008-b82f-28e1b4728a12-kube-api-access-rhp6q\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726202 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-node-log\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726236 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-run-netns\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-tmp-dir\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-tmp\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-registration-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-systemd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.726866 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-config\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726423 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-registration-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-systemd\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpvk\" (UniqueName: \"kubernetes.io/projected/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-kube-api-access-wbpvk\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-bin\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-system-cni-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f12e98d1-77b9-40f2-8173-55eac40cac1d-iptables-alerter-script\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-cni-bin\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-tuned\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvblt\" (UniqueName: \"kubernetes.io/projected/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-kube-api-access-nvblt\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-kubernetes\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-etc-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726648 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-serviceca\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726659 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726714 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-etc-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.727556 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726718 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726760 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2d8b\" (UniqueName: \"kubernetes.io/projected/d1614a90-8db4-4e23-b855-546cb80ba0da-kube-api-access-l2d8b\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-run-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f12e98d1-77b9-40f2-8173-55eac40cac1d-host-slash\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqhn\" (UniqueName: \"kubernetes.io/projected/f12e98d1-77b9-40f2-8173-55eac40cac1d-kube-api-access-vlqhn\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-run\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovnkube-config\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-netns\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-system-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726940 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7997d564-5cbc-406b-bdcf-9d076c1cc199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726950 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cnibin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726960 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-host-run-netns\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726974 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-bin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cnibin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726990 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-system-cni-dir\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.726998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-os-release\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.728337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cni-binary-copy\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-host-var-lib-cni-bin\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727044 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-daemon-config\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-var-lib-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727091 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfngc\" (UniqueName: \"kubernetes.io/projected/32fef16b-e56b-4e60-a737-0d7bfb811e6b-kube-api-access-cfngc\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727137 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2c2a1ff-923e-4c85-96e0-ebafce404d59-var-lib-openvswitch\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-cni-binary-copy\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.727568 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-multus-daemon-config\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.729127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.728630 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2c2a1ff-923e-4c85-96e0-ebafce404d59-ovn-node-metrics-cert\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.732258 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.732238 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:53.732380 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.732264 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:53.732380 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.732298 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:53.732495 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.732393 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.232371887 +0000 UTC m=+2.920517507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:53.733473 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.733450 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5bgb\" (UniqueName: \"kubernetes.io/projected/e2c2a1ff-923e-4c85-96e0-ebafce404d59-kube-api-access-t5bgb\") pod \"ovnkube-node-9tzsb\" (UID: \"e2c2a1ff-923e-4c85-96e0-ebafce404d59\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.734230 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.734195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t26kl\" (UniqueName: \"kubernetes.io/projected/7997d564-5cbc-406b-bdcf-9d076c1cc199-kube-api-access-t26kl\") pod \"aws-ebs-csi-driver-node-cpstl\" (UID: \"7997d564-5cbc-406b-bdcf-9d076c1cc199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.734677 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.734651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrds\" (UniqueName: \"kubernetes.io/projected/e91ed3e2-7d70-48b6-a44a-cd2cf3a10621-kube-api-access-wjrds\") pod \"multus-8g9qj\" (UID: \"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621\") " pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.735126 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.735097 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpvk\" (UniqueName: \"kubernetes.io/projected/0ef5b667-cdc3-40b0-a6a2-e39bd06d4718-kube-api-access-wbpvk\") pod \"node-resolver-sgkpn\" (UID: \"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718\") " pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.735259 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.735244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvblt\" (UniqueName: \"kubernetes.io/projected/2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751-kube-api-access-nvblt\") pod \"node-ca-9d8rm\" (UID: \"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751\") " pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.735704 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.735682 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/339c9df8-4b90-4c3e-a5b8-a2c68954896c-agent-certs\") pod \"konnectivity-agent-gv2h2\" (UID: \"339c9df8-4b90-4c3e-a5b8-a2c68954896c\") " pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.828063 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828063 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828066 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2d8b\" (UniqueName: \"kubernetes.io/projected/d1614a90-8db4-4e23-b855-546cb80ba0da-kube-api-access-l2d8b\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f12e98d1-77b9-40f2-8173-55eac40cac1d-host-slash\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828116 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqhn\" (UniqueName: \"kubernetes.io/projected/f12e98d1-77b9-40f2-8173-55eac40cac1d-kube-api-access-vlqhn\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-run\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-os-release\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f12e98d1-77b9-40f2-8173-55eac40cac1d-host-slash\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfngc\" (UniqueName: \"kubernetes.io/projected/32fef16b-e56b-4e60-a737-0d7bfb811e6b-kube-api-access-cfngc\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828262 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-dbus\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-var-lib-kubelet\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-systemd\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-os-release\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-sys\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-host\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-run\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-lib-modules\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828558 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysconfig\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828589 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-cnibin\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828611 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-sys\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.828669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828613 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-dbus\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-modprobe-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828658 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-host\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-conf\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-var-lib-kubelet\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-kubelet-config\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-kubelet-config\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.828853 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-modprobe-d\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.828910 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.328892699 +0000 UTC m=+3.017038327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhp6q\" (UniqueName: \"kubernetes.io/projected/f76ae8f6-9394-4008-b82f-28e1b4728a12-kube-api-access-rhp6q\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.828956 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-tmp\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:53.828989 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:54.328976328 +0000 UTC m=+3.017121932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysctl-conf\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829021 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-sysconfig\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.829430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-system-cni-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829038 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-cnibin\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828906 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f12e98d1-77b9-40f2-8173-55eac40cac1d-iptables-alerter-script\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.828987 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-systemd\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829100 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-lib-modules\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829120 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-tuned\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f76ae8f6-9394-4008-b82f-28e1b4728a12-system-cni-dir\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-kubernetes\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-kubernetes\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829563 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f76ae8f6-9394-4008-b82f-28e1b4728a12-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.830026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.829588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f12e98d1-77b9-40f2-8173-55eac40cac1d-iptables-alerter-script\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.831332 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.831297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-etc-tuned\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.831563 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.831534 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fef16b-e56b-4e60-a737-0d7bfb811e6b-tmp\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.836642 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.836614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqhn\" (UniqueName: \"kubernetes.io/projected/f12e98d1-77b9-40f2-8173-55eac40cac1d-kube-api-access-vlqhn\") pod \"iptables-alerter-9zrt6\" (UID: \"f12e98d1-77b9-40f2-8173-55eac40cac1d\") " pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.837565 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.837346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2d8b\" (UniqueName: \"kubernetes.io/projected/d1614a90-8db4-4e23-b855-546cb80ba0da-kube-api-access-l2d8b\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:53.837565 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.837536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhp6q\" (UniqueName: \"kubernetes.io/projected/f76ae8f6-9394-4008-b82f-28e1b4728a12-kube-api-access-rhp6q\") pod \"multus-additional-cni-plugins-7tqt9\" (UID: \"f76ae8f6-9394-4008-b82f-28e1b4728a12\") " pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.837786 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.837766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfngc\" (UniqueName: \"kubernetes.io/projected/32fef16b-e56b-4e60-a737-0d7bfb811e6b-kube-api-access-cfngc\") pod \"tuned-dlvmp\" (UID: \"32fef16b-e56b-4e60-a737-0d7bfb811e6b\") " pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:53.914270 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.914208 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8g9qj" Jun 10 01:01:53.922370 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.922350 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9d8rm" Jun 10 01:01:53.930976 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.930959 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:01:53.937489 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.937472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" Jun 10 01:01:53.943947 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.943926 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sgkpn" Jun 10 01:01:53.951453 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.951429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:01:53.957003 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.956988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" Jun 10 01:01:53.964447 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.964428 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9zrt6" Jun 10 01:01:53.969008 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:53.968987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" Jun 10 01:01:54.063254 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.063233 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:01:54.332244 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.332170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:54.332244 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.332213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:54.332244 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.332232 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:54.332444 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332349 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:54.332444 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332349 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:54.332444 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332407 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:01:55.332387528 +0000 UTC m=+4.020533143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:54.332444 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332423 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:55.332414507 +0000 UTC m=+4.020560110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:54.332444 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332353 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:54.332602 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332452 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:54.332602 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332464 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:54.332602 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:54.332509 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:55.332494245 +0000 UTC m=+4.020639850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:54.463669 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.463468 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339c9df8_4b90_4c3e_a5b8_a2c68954896c.slice/crio-1328c360c1eb4384b205e9111ef7c845afc42b3f7f59f3658a617cf5bc63d494 WatchSource:0}: Error finding container 1328c360c1eb4384b205e9111ef7c845afc42b3f7f59f3658a617cf5bc63d494: Status 404 returned error can't find the container with id 1328c360c1eb4384b205e9111ef7c845afc42b3f7f59f3658a617cf5bc63d494 Jun 10 01:01:54.464363 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.464332 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76ae8f6_9394_4008_b82f_28e1b4728a12.slice/crio-fdaa38cf9b96c1d68ba450bda0e3b97bfc6fbb6b8b2482ff87c026d87fdc46bf WatchSource:0}: Error finding container fdaa38cf9b96c1d68ba450bda0e3b97bfc6fbb6b8b2482ff87c026d87fdc46bf: Status 404 returned error can't find the container with id fdaa38cf9b96c1d68ba450bda0e3b97bfc6fbb6b8b2482ff87c026d87fdc46bf Jun 10 01:01:54.466912 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.466785 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7997d564_5cbc_406b_bdcf_9d076c1cc199.slice/crio-2dd322ecba75aa450c680e86629fc38cb90c1df0f07d8f47daf88c945821e765 WatchSource:0}: Error finding container 2dd322ecba75aa450c680e86629fc38cb90c1df0f07d8f47daf88c945821e765: Status 404 returned error can't find the container with id 2dd322ecba75aa450c680e86629fc38cb90c1df0f07d8f47daf88c945821e765 Jun 10 01:01:54.470146 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.470111 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fef16b_e56b_4e60_a737_0d7bfb811e6b.slice/crio-96084508a1b501f545456ed6990611b77a203033403206622cbf077cc2a99cc3 WatchSource:0}: Error finding container 96084508a1b501f545456ed6990611b77a203033403206622cbf077cc2a99cc3: Status 404 returned error can't find the container with id 96084508a1b501f545456ed6990611b77a203033403206622cbf077cc2a99cc3 Jun 10 01:01:54.471359 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.471332 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12e98d1_77b9_40f2_8173_55eac40cac1d.slice/crio-4605fbd6dfd6a422d850088878c932f9e6fd2f4002ce50a4786fb73079295850 WatchSource:0}: Error finding container 4605fbd6dfd6a422d850088878c932f9e6fd2f4002ce50a4786fb73079295850: Status 404 returned error can't find the container with id 4605fbd6dfd6a422d850088878c932f9e6fd2f4002ce50a4786fb73079295850 Jun 10 01:01:54.475986 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.474836 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0a4d48_7d0c_4b61_b8a4_2b68c30d1751.slice/crio-60f9e3f687b25a2fe29df33b25ce2bad5d98205a0bc731975c980c240dfea2aa WatchSource:0}: Error finding container 60f9e3f687b25a2fe29df33b25ce2bad5d98205a0bc731975c980c240dfea2aa: Status 404 returned error can't find the container with id 60f9e3f687b25a2fe29df33b25ce2bad5d98205a0bc731975c980c240dfea2aa Jun 10 01:01:54.475986 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.475597 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c2a1ff_923e_4c85_96e0_ebafce404d59.slice/crio-e62b1d1e4bf1431b91a1ecf028671fe4748a942eb512a2e40985939783e55283 WatchSource:0}: Error finding container e62b1d1e4bf1431b91a1ecf028671fe4748a942eb512a2e40985939783e55283: Status 404 returned error can't find the container with id e62b1d1e4bf1431b91a1ecf028671fe4748a942eb512a2e40985939783e55283 Jun 10 01:01:54.476525 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.476501 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91ed3e2_7d70_48b6_a44a_cd2cf3a10621.slice/crio-907d3c3ffae4d194a826440032e4d5dd58dcd15143630304d1162b2604453348 WatchSource:0}: Error finding container 907d3c3ffae4d194a826440032e4d5dd58dcd15143630304d1162b2604453348: Status 404 returned error can't find the container with id 907d3c3ffae4d194a826440032e4d5dd58dcd15143630304d1162b2604453348 Jun 10 01:01:54.497975 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:01:54.497954 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef5b667_cdc3_40b0_a6a2_e39bd06d4718.slice/crio-ecab0c4511fb448098b3a55b6d8bf1ae8e75fa364dd2688c9dd627e1945779e8 WatchSource:0}: Error finding container ecab0c4511fb448098b3a55b6d8bf1ae8e75fa364dd2688c9dd627e1945779e8: Status 404 returned error can't find the container with id ecab0c4511fb448098b3a55b6d8bf1ae8e75fa364dd2688c9dd627e1945779e8 Jun 10 01:01:54.659170 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.659084 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:53 +0000 UTC" deadline="2027-12-04 07:45:25.328573135 +0000 UTC" Jun 10 01:01:54.659170 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.659124 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13014h43m30.669451019s" Jun 10 01:01:54.691904 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.691855 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8g9qj" event={"ID":"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621","Type":"ContainerStarted","Data":"907d3c3ffae4d194a826440032e4d5dd58dcd15143630304d1162b2604453348"} Jun 10 01:01:54.693058 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.693037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"e62b1d1e4bf1431b91a1ecf028671fe4748a942eb512a2e40985939783e55283"} Jun 10 01:01:54.694213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.694194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9zrt6" event={"ID":"f12e98d1-77b9-40f2-8173-55eac40cac1d","Type":"ContainerStarted","Data":"4605fbd6dfd6a422d850088878c932f9e6fd2f4002ce50a4786fb73079295850"} Jun 10 01:01:54.695272 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.695235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gv2h2" event={"ID":"339c9df8-4b90-4c3e-a5b8-a2c68954896c","Type":"ContainerStarted","Data":"1328c360c1eb4384b205e9111ef7c845afc42b3f7f59f3658a617cf5bc63d494"} Jun 10 01:01:54.697229 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.697173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" event={"ID":"2daa11601870c184cfcbf1281d3c8d4d","Type":"ContainerStarted","Data":"9560f64b05534ecf4998096898e0a5b6f306ac8fb8a66e02df8a1ce542cb8b68"} Jun 10 01:01:54.698733 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.698706 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sgkpn" event={"ID":"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718","Type":"ContainerStarted","Data":"ecab0c4511fb448098b3a55b6d8bf1ae8e75fa364dd2688c9dd627e1945779e8"} Jun 10 01:01:54.700052 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.700034 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9d8rm" event={"ID":"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751","Type":"ContainerStarted","Data":"60f9e3f687b25a2fe29df33b25ce2bad5d98205a0bc731975c980c240dfea2aa"} Jun 10 01:01:54.701265 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.701243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" event={"ID":"32fef16b-e56b-4e60-a737-0d7bfb811e6b","Type":"ContainerStarted","Data":"96084508a1b501f545456ed6990611b77a203033403206622cbf077cc2a99cc3"} Jun 10 01:01:54.702425 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.702401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" event={"ID":"7997d564-5cbc-406b-bdcf-9d076c1cc199","Type":"ContainerStarted","Data":"2dd322ecba75aa450c680e86629fc38cb90c1df0f07d8f47daf88c945821e765"} Jun 10 01:01:54.703634 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.703612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerStarted","Data":"fdaa38cf9b96c1d68ba450bda0e3b97bfc6fbb6b8b2482ff87c026d87fdc46bf"} Jun 10 01:01:54.712699 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:54.712661 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-67.ec2.internal" podStartSLOduration=2.712649043 podStartE2EDuration="2.712649043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:54.711809311 +0000 UTC m=+3.399954934" watchObservedRunningTime="2026-06-10 01:01:54.712649043 +0000 UTC m=+3.400794665" Jun 10 01:01:55.339189 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.339153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:55.339418 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.339222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:55.339418 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.339249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:55.339418 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339379 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:55.339725 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339438 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:57.339419658 +0000 UTC m=+6.027565284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:55.339828 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339810 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:55.339828 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339828 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:55.339943 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339841 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:55.339943 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339879 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:01:57.339866639 +0000 UTC m=+6.028012244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:55.339943 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339934 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:55.340115 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.339965 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:01:57.339954641 +0000 UTC m=+6.028100251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:55.659584 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.659492 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:56:53 +0000 UTC" deadline="2027-12-15 16:41:56.673055785 +0000 UTC" Jun 10 01:01:55.659584 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.659535 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13287h40m1.013525504s" Jun 10 01:01:55.684728 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.684698 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:55.684849 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.684826 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:01:55.687725 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.685194 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:55.687725 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.685288 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:01:55.687725 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.687564 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:55.687725 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:55.687665 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:01:55.721371 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.720756 2568 generic.go:356] "Generic (PLEG): container finished" podID="f7bd4f6488a73339f42dd9a91533397e" containerID="9ac0d94e037951c8378cdd8ca7a4943e35747beaeac707f1afdc590d0b4fd86a" exitCode=0 Jun 10 01:01:55.721371 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:55.721237 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" event={"ID":"f7bd4f6488a73339f42dd9a91533397e","Type":"ContainerDied","Data":"9ac0d94e037951c8378cdd8ca7a4943e35747beaeac707f1afdc590d0b4fd86a"} Jun 10 01:01:56.734787 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:56.734707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" event={"ID":"f7bd4f6488a73339f42dd9a91533397e","Type":"ContainerStarted","Data":"c3955a5fb23f4ec545a84fb1b018d6e75d43982ea49635c28913fc74145414a4"} Jun 10 01:01:56.753782 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:56.753726 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-67.ec2.internal" podStartSLOduration=4.753707396 podStartE2EDuration="4.753707396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:01:56.752196071 +0000 UTC m=+5.440341697" watchObservedRunningTime="2026-06-10 01:01:56.753707396 +0000 UTC m=+5.441853022" Jun 10 01:01:57.355271 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.355232 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:57.355493 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.355285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:57.355493 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.355352 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:57.355493 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.355484 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:01:57.355648 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.355502 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:01:57.355648 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.355515 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:57.355648 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.355570 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:01.355551604 +0000 UTC m=+10.043697213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:01:57.356007 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.355984 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:57.356082 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.356045 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:02:01.356029685 +0000 UTC m=+10.044175293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:01:57.356128 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.356104 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:57.356173 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.356137 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:01.356126152 +0000 UTC m=+10.044271758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:01:57.685475 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.685400 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:57.685609 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.685524 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:01:57.685820 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.685804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:57.685881 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.685870 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:01:57.686011 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:57.685999 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:57.686076 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:57.686056 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:01:59.686426 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:59.686392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:01:59.686892 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:59.686404 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:01:59.686892 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:59.686504 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:01:59.686892 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:59.686603 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:01:59.686892 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:01:59.686652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:01:59.686892 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:01:59.686735 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:01.388549 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.388512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.388562 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.388609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.388718 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.388732 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.388741 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:01.388990 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.388790 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.388776211 +0000 UTC m=+18.076921813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:01.389341 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.389139 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:01.389341 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.389175 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.389164752 +0000 UTC m=+18.077310354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:01.389341 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.389208 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:01.389341 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.389235 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.389224758 +0000 UTC m=+18.077370362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:01.685301 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.685220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:01.685460 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.685357 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:01.685635 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.685616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:01.685731 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.685714 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:01.685784 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:01.685741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:01.685900 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:01.685862 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:03.684548 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:03.684513 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:03.685067 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:03.684514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:03.685067 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:03.684523 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:03.685067 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:03.684689 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:03.685067 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:03.684775 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:03.685067 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:03.684834 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:05.685128 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:05.685091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:05.685635 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:05.685140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:05.685635 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:05.685096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:05.685635 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:05.685223 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:05.685635 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:05.685348 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:05.685635 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:05.685437 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:07.684389 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:07.684358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:07.684822 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:07.684362 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:07.684822 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:07.684489 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:07.684822 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:07.684583 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:07.684822 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:07.684362 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:07.684822 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:07.684677 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:09.451927 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.451894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:09.451927 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.451938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.451987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452080 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452115 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452114 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452133 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452145 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452156 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:02:25.452134577 +0000 UTC m=+34.140280183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452183 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:25.452164556 +0000 UTC m=+34.140310163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:09.452462 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.452202 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:25.452192642 +0000 UTC m=+34.140338249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:09.684398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.684364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:09.684552 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.684364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:09.684552 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.684480 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:09.684552 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:09.684504 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:09.684721 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.684559 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:09.684721 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:09.684675 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:11.685335 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:11.685439 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:11.685465 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:11.685557 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:11.685437 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:11.685754 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:11.685660 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:13.684833 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.684611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:13.685662 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.684611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:13.685662 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:13.684948 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:13.685662 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:13.684990 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:13.685662 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.684734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:13.685662 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:13.685068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:13.767252 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.767128 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sgkpn" event={"ID":"0ef5b667-cdc3-40b0-a6a2-e39bd06d4718","Type":"ContainerStarted","Data":"93d7f2c75422ce1e99a34031e006f22e68165640ad4d2124488e861ab19ce497"} Jun 10 01:02:13.768340 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.768300 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9d8rm" event={"ID":"2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751","Type":"ContainerStarted","Data":"d31f94a93d9307ebbb84fbb99f98dcb218a8914398ceaac505fb4007e2be6b78"} Jun 10 01:02:13.769906 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.769844 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" event={"ID":"32fef16b-e56b-4e60-a737-0d7bfb811e6b","Type":"ContainerStarted","Data":"0a0b00cf3bee773c289bb8f62cf45c66dee4b87d31b3235c4a21ead08ef31135"} Jun 10 01:02:13.771372 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.771351 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" event={"ID":"7997d564-5cbc-406b-bdcf-9d076c1cc199","Type":"ContainerStarted","Data":"1bdb29fa859bbb2a542ab729989c26152dde8810be5b5a39fee786371e002c68"} Jun 10 01:02:13.773088 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.773063 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="97392514bae40672947b983d6c9ba26e9c18a1c258c5e2842af767868bf7424a" exitCode=0 Jun 10 01:02:13.773185 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.773157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"97392514bae40672947b983d6c9ba26e9c18a1c258c5e2842af767868bf7424a"} Jun 10 01:02:13.776353 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.775149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8g9qj" event={"ID":"e91ed3e2-7d70-48b6-a44a-cd2cf3a10621","Type":"ContainerStarted","Data":"864e1dad1193c4143869a3e5493a3821d2721bc51f628b0aba9b8fe0a8be726c"} Jun 10 01:02:13.780953 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.780933 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:02:13.781269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.781248 2568 generic.go:356] "Generic (PLEG): container finished" podID="e2c2a1ff-923e-4c85-96e0-ebafce404d59" containerID="993b42dee31802ae8623c63ba9b9c29594380936902dff1c547775bc5a840d31" exitCode=1 Jun 10 01:02:13.781349 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.781335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"9cc41e1e2b4cd2035534559cccfe27cfdc7d0cdf4408e0ee2c341650a155c54c"} Jun 10 01:02:13.781405 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.781389 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerDied","Data":"993b42dee31802ae8623c63ba9b9c29594380936902dff1c547775bc5a840d31"} Jun 10 01:02:13.781456 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.781430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"c36126a689f1144c3a75ee814eb2b724283e439373d409b6b8903ca4119a6daa"} Jun 10 01:02:13.782616 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.782595 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gv2h2" event={"ID":"339c9df8-4b90-4c3e-a5b8-a2c68954896c","Type":"ContainerStarted","Data":"818d60097b22ae50d3092600a3b1e713edf1eb1b7a48460e86006cd3b0066fcc"} Jun 10 01:02:13.783330 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.783276 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sgkpn" podStartSLOduration=3.9927827430000002 podStartE2EDuration="22.783266423s" totalImagesPullingTime="18.79048368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.783026587 +0000 UTC m=+22.471172212" watchObservedRunningTime="2026-06-10 01:02:13.783266423 +0000 UTC m=+22.471412048" Jun 10 01:02:13.814934 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.814893 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gv2h2" podStartSLOduration=8.645645292 podStartE2EDuration="22.814882558s" totalImagesPullingTime="14.169237266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.814425016 +0000 UTC m=+22.502570640" watchObservedRunningTime="2026-06-10 01:02:13.814882558 +0000 UTC m=+22.503028182" Jun 10 01:02:13.817614 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.817595 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:02:13.818130 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.818115 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:02:13.831264 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.831234 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dlvmp" podStartSLOduration=4.032045785 podStartE2EDuration="22.831223574s" totalImagesPullingTime="18.799177789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.83089717 +0000 UTC m=+22.519042796" watchObservedRunningTime="2026-06-10 01:02:13.831223574 +0000 UTC m=+22.519369198" Jun 10 01:02:13.851172 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.851137 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8g9qj" podStartSLOduration=4.056128366 podStartE2EDuration="22.851126712s" totalImagesPullingTime="18.794998346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.850847461 +0000 UTC m=+22.538993083" watchObservedRunningTime="2026-06-10 01:02:13.851126712 +0000 UTC m=+22.539272338" Jun 10 01:02:13.863603 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:13.863569 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9d8rm" podStartSLOduration=4.230865255 podStartE2EDuration="22.863557738s" totalImagesPullingTime="18.632692483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:13.863467096 +0000 UTC m=+22.551612722" watchObservedRunningTime="2026-06-10 01:02:13.863557738 +0000 UTC m=+22.551703365" Jun 10 01:02:14.787753 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.787726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:02:14.788182 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.788156 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"d39f47aad2b7c47d4dbd4711df7f5e40b86e76596c5b7fe3249c2967588eb4f6"} Jun 10 01:02:14.788269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.788248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"581c81811bccc528b223098e6c4300fd9797d62a1e4b5fc9f62e059980fa20dc"} Jun 10 01:02:14.788397 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.788327 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"661e3a5671238ffecf929c889ebbba01545e7bd40ba1b3743641d1af990418ff"} Jun 10 01:02:14.789789 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.789765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9zrt6" event={"ID":"f12e98d1-77b9-40f2-8173-55eac40cac1d","Type":"ContainerStarted","Data":"3e92a099784b7abec383a2e28e8e7fd672f12314c874ff06def16bd8dfdf67d7"} Jun 10 01:02:14.790475 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.790430 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:02:14.790940 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.790922 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gv2h2" Jun 10 01:02:14.803541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:14.803496 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9zrt6" podStartSLOduration=5.128396115 podStartE2EDuration="23.803482979s" totalImagesPullingTime="18.675086864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:14.803030641 +0000 UTC m=+23.491176266" watchObservedRunningTime="2026-06-10 01:02:14.803482979 +0000 UTC m=+23.491628604" Jun 10 01:02:15.176060 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.176022 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 01:02:15.685173 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.685137 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:15.685340 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.685140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:15.685340 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:15.685274 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:15.685340 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.685145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:15.685469 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:15.685370 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:15.685469 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:15.685429 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:15.690054 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.689973 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T01:02:15.176047681Z","UUID":"55fa12ae-31b2-47c8-b55b-435684a4002d","Handler":null,"Name":"","Endpoint":""} Jun 10 01:02:15.691515 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.691497 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 01:02:15.691615 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.691529 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 01:02:15.794989 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:15.794959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" event={"ID":"7997d564-5cbc-406b-bdcf-9d076c1cc199","Type":"ContainerStarted","Data":"d99a77bed2c45a9c75ec2c727241ceba79d3a05ca6e72b6c3968314702af23ba"} Jun 10 01:02:16.799727 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:16.799466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" event={"ID":"7997d564-5cbc-406b-bdcf-9d076c1cc199","Type":"ContainerStarted","Data":"040bc1707e76694bd69bc28679ab994b60c34686ae6f492bacd4fd17c7c410ca"} Jun 10 01:02:16.803029 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:16.803003 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:02:16.803493 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:16.803469 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"55cc1681e6aa6070d397dcc0264c892898f540b709d5e0e60efdcfb07188babd"} Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:17.684861 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:17.684875 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:17.684889 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:17.684996 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:17.685075 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:17.685350 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:17.685157 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:18.810105 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.809859 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="75f6a828791901ee25d11840b3853e85c33d3785815945a94f68bb8b6ec9e013" exitCode=0 Jun 10 01:02:18.810888 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.809946 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"75f6a828791901ee25d11840b3853e85c33d3785815945a94f68bb8b6ec9e013"} Jun 10 01:02:18.813569 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.813553 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:02:18.813892 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.813863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"6cad0566a7b04ba0159f3beeae3225ab5c9f29c85fdd81d60ef3760534570265"} Jun 10 01:02:18.814122 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.814101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:18.814222 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.814164 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:18.814283 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.814260 2568 scope.go:117] "RemoveContainer" containerID="993b42dee31802ae8623c63ba9b9c29594380936902dff1c547775bc5a840d31" Jun 10 01:02:18.829478 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.829436 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpstl" podStartSLOduration=6.893810484 podStartE2EDuration="27.829422537s" totalImagesPullingTime="20.935612053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:16.815652869 +0000 UTC m=+25.503798495" watchObservedRunningTime="2026-06-10 01:02:18.829422537 +0000 UTC m=+27.517568216" Jun 10 01:02:18.831195 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.831175 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:18.831593 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:18.831576 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:19.684928 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.684906 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:19.684928 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.684920 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:19.685051 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.684907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:19.685051 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:19.685016 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:19.685122 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:19.685068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:19.685167 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:19.685135 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:19.818579 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.818542 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="1c152709eedd95fe2d42de2e362cebd886408e839012960416bc7251cca65111" exitCode=0 Jun 10 01:02:19.819010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.818619 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"1c152709eedd95fe2d42de2e362cebd886408e839012960416bc7251cca65111"} Jun 10 01:02:19.823845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.823826 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:02:19.824287 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.824260 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" event={"ID":"e2c2a1ff-923e-4c85-96e0-ebafce404d59","Type":"ContainerStarted","Data":"08f479954d50e517f938681be360376011c117e25b59c31ec9765bfeac0caf8e"} Jun 10 01:02:19.824645 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.824628 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:19.864878 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:19.864729 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" podStartSLOduration=10.007369595 podStartE2EDuration="28.864714794s" totalImagesPullingTime="18.857345199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:19.86337594 +0000 UTC m=+28.551521567" watchObservedRunningTime="2026-06-10 01:02:19.864714794 +0000 UTC m=+28.552860418" Jun 10 01:02:20.064647 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.064616 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6chp"] Jun 10 01:02:20.064819 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.064731 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:20.064876 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:20.064847 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:20.065388 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.065368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r64zg"] Jun 10 01:02:20.065473 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.065445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:20.065533 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:20.065517 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:20.074731 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.074676 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hr9wq"] Jun 10 01:02:20.074802 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.074748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:20.074835 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:20.074808 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:20.828880 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.828851 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="d11f00d950bc0ac3c8c22da80ab33ce4b848ca8ceb3167cb6bad447e785bc612" exitCode=0 Jun 10 01:02:20.829326 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:20.828926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"d11f00d950bc0ac3c8c22da80ab33ce4b848ca8ceb3167cb6bad447e785bc612"} Jun 10 01:02:21.685222 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:21.685184 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:21.685420 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:21.685271 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:21.685420 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:21.685333 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:21.685420 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:21.685343 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:21.685420 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:21.685398 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:21.685621 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:21.685454 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:23.684859 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:23.684822 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:23.684859 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:23.684854 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:23.685555 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:23.684821 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:23.685555 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:23.684948 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:23.685555 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:23.685061 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:23.685555 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:23.685165 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:25.484113 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.484055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:25.484113 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.484086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484178 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.484203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484228 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret podName:e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.484214694 +0000 UTC m=+66.172360297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret") pod "global-pull-secret-syncer-hr9wq" (UID: "e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484179 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484281 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484299 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484326 2568 projected.go:196] Error preparing data for projected volume kube-api-access-q2qwq for pod openshift-network-diagnostics/network-check-target-d6chp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484299 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.484285127 +0000 UTC m=+66.172430731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:25.484594 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.484382 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq podName:f6dbd567-74a8-4d94-be65-34b4487c7d99 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.484371379 +0000 UTC m=+66.172516982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2qwq" (UniqueName: "kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq") pod "network-check-target-d6chp" (UID: "f6dbd567-74a8-4d94-be65-34b4487c7d99") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:25.684541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.684518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:25.684666 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.684520 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:25.684666 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.684618 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr9wq" podUID="e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2" Jun 10 01:02:25.684756 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.684520 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:25.684793 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.684682 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6chp" podUID="f6dbd567-74a8-4d94-be65-34b4487c7d99" Jun 10 01:02:25.684793 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:25.684756 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:02:25.843455 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.843426 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="817c1c653427602f4557d496a1235c964e5cf407ab1770d9c9183dd7a1e92fb8" exitCode=0 Jun 10 01:02:25.843579 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:25.843478 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"817c1c653427602f4557d496a1235c964e5cf407ab1770d9c9183dd7a1e92fb8"} Jun 10 01:02:26.148411 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.148209 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-67.ec2.internal" event="NodeReady" Jun 10 01:02:26.148540 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.148455 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 01:02:26.193409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.193386 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jrrjw"] Jun 10 01:02:26.198493 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.198477 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qhrxg"] Jun 10 01:02:26.198613 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.198598 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.200949 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.200928 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:02:26.201056 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.200935 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 01:02:26.201056 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.200936 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 01:02:26.205624 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.205086 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jrrjw"] Jun 10 01:02:26.205624 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.205176 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.205624 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.205585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhrxg"] Jun 10 01:02:26.207426 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.207409 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 01:02:26.207531 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.207456 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 01:02:26.207531 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.207504 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9gnps\"" Jun 10 01:02:26.207754 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.207737 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 01:02:26.290630 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290609 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a684fa9-c13a-400c-984f-a035a7fbd8ef-config-volume\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.290728 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290664 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4pw\" (UniqueName: \"kubernetes.io/projected/5a684fa9-c13a-400c-984f-a035a7fbd8ef-kube-api-access-zm4pw\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.290772 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.290845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdx66\" (UniqueName: \"kubernetes.io/projected/8fa17a04-7e68-44da-b233-e1f7ec0391bd-kube-api-access-tdx66\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.290845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a684fa9-c13a-400c-984f-a035a7fbd8ef-tmp-dir\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.290845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.290803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa17a04-7e68-44da-b233-e1f7ec0391bd-cert\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.391894 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.391871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a684fa9-c13a-400c-984f-a035a7fbd8ef-config-volume\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.392032 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.391920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4pw\" (UniqueName: \"kubernetes.io/projected/5a684fa9-c13a-400c-984f-a035a7fbd8ef-kube-api-access-zm4pw\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.392032 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.391940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.392032 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:26.392022 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:26.392193 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.392041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdx66\" (UniqueName: \"kubernetes.io/projected/8fa17a04-7e68-44da-b233-e1f7ec0391bd-kube-api-access-tdx66\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.392193 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:26.392061 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:26.892049588 +0000 UTC m=+35.580195190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:26.392193 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.392081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a684fa9-c13a-400c-984f-a035a7fbd8ef-tmp-dir\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.392193 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.392097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa17a04-7e68-44da-b233-e1f7ec0391bd-cert\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.392396 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.392359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a684fa9-c13a-400c-984f-a035a7fbd8ef-tmp-dir\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.392458 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.392440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a684fa9-c13a-400c-984f-a035a7fbd8ef-config-volume\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.396279 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.396262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fa17a04-7e68-44da-b233-e1f7ec0391bd-cert\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.401682 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.401624 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdx66\" (UniqueName: \"kubernetes.io/projected/8fa17a04-7e68-44da-b233-e1f7ec0391bd-kube-api-access-tdx66\") pod \"ingress-canary-qhrxg\" (UID: \"8fa17a04-7e68-44da-b233-e1f7ec0391bd\") " pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.401869 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.401850 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4pw\" (UniqueName: \"kubernetes.io/projected/5a684fa9-c13a-400c-984f-a035a7fbd8ef-kube-api-access-zm4pw\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.514635 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.514617 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qhrxg" Jun 10 01:02:26.683605 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.683531 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qhrxg"] Jun 10 01:02:26.687614 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:02:26.687593 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa17a04_7e68_44da_b233_e1f7ec0391bd.slice/crio-86d1fe9d918ae821ccb487df03a8fd3608403109fe136279cbfa74b8415ee65a WatchSource:0}: Error finding container 86d1fe9d918ae821ccb487df03a8fd3608403109fe136279cbfa74b8415ee65a: Status 404 returned error can't find the container with id 86d1fe9d918ae821ccb487df03a8fd3608403109fe136279cbfa74b8415ee65a Jun 10 01:02:26.848842 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.848801 2568 generic.go:356] "Generic (PLEG): container finished" podID="f76ae8f6-9394-4008-b82f-28e1b4728a12" containerID="5ef80879561ff691d48767459c6fa3fa9894c892044eced47db64c8c7f9e83c2" exitCode=0 Jun 10 01:02:26.849026 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.848859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerDied","Data":"5ef80879561ff691d48767459c6fa3fa9894c892044eced47db64c8c7f9e83c2"} Jun 10 01:02:26.850006 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.849981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhrxg" event={"ID":"8fa17a04-7e68-44da-b233-e1f7ec0391bd","Type":"ContainerStarted","Data":"86d1fe9d918ae821ccb487df03a8fd3608403109fe136279cbfa74b8415ee65a"} Jun 10 01:02:26.895238 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:26.895218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:26.895390 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:26.895372 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:26.895488 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:26.895437 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:27.895418759 +0000 UTC m=+36.583564380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:27.684330 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.684140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:27.684965 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.684140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:27.684965 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.684177 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:27.687865 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687816 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:27.687865 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687834 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:27.687865 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687866 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:02:27.688087 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:27.688087 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687823 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:02:27.688087 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.687835 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:27.856577 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.856546 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" event={"ID":"f76ae8f6-9394-4008-b82f-28e1b4728a12","Type":"ContainerStarted","Data":"115705c91b489ac17f4c342c380b94d317dd2bceb303415dc65dc12aafe2aed0"} Jun 10 01:02:27.876458 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.876414 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7tqt9" podStartSLOduration=8.247830991 podStartE2EDuration="36.876393639s" totalImagesPullingTime="28.628562648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:27.874768315 +0000 UTC m=+36.562913940" watchObservedRunningTime="2026-06-10 01:02:27.876393639 +0000 UTC m=+36.564539265" Jun 10 01:02:27.900960 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:27.900923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:27.901092 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:27.901030 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:27.901092 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:27.901084 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:29.901069352 +0000 UTC m=+38.589214955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:29.862254 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:29.862176 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qhrxg" event={"ID":"8fa17a04-7e68-44da-b233-e1f7ec0391bd","Type":"ContainerStarted","Data":"3b2203fafbab83190d36bf015cd689b174088454e32a10ee3cac50011d6600f2"} Jun 10 01:02:29.876117 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:29.876065 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qhrxg" podStartSLOduration=1.5991476009999999 podStartE2EDuration="3.876049043s" totalImagesPullingTime="2.276901442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:29.875960586 +0000 UTC m=+38.564106222" watchObservedRunningTime="2026-06-10 01:02:29.876049043 +0000 UTC m=+38.564194669" Jun 10 01:02:29.915226 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:29.915187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:29.915388 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:29.915284 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:29.915388 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:29.915356 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:33.915343102 +0000 UTC m=+42.603488704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:33.935995 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:33.935963 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:33.936520 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:33.936079 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:33.936520 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:33.936132 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:41.936115074 +0000 UTC m=+50.624260680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:41.985432 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:41.985268 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:41.985896 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:41.985868 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:41.985986 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:41.985968 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:02:57.985943924 +0000 UTC m=+66.674089542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:02:46.779335 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.779281 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj"] Jun 10 01:02:46.782649 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.782626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:46.785217 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.785184 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 01:02:46.786048 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.786025 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 01:02:46.786161 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.786046 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 01:02:46.786161 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.786128 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 01:02:46.792140 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.792121 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj"] Jun 10 01:02:46.799103 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.799082 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc"] Jun 10 01:02:46.800747 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.800733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.803075 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.803056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 01:02:46.803885 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.803863 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 01:02:46.803885 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.803876 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 01:02:46.804049 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.803868 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 01:02:46.812409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.812389 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc"] Jun 10 01:02:46.914993 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.914970 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d741de15-21a4-45e3-a0c2-72f427ec4ac2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.914998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vnk\" (UniqueName: \"kubernetes.io/projected/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-kube-api-access-d2vnk\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:46.915091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflzr\" (UniqueName: \"kubernetes.io/projected/d741de15-21a4-45e3-a0c2-72f427ec4ac2-kube-api-access-rflzr\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-tmp\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:46.915282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915117 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:46.915282 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:46.915167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.016294 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.016393 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d741de15-21a4-45e3-a0c2-72f427ec4ac2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.016393 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vnk\" (UniqueName: \"kubernetes.io/projected/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-kube-api-access-d2vnk\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.016488 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflzr\" (UniqueName: \"kubernetes.io/projected/d741de15-21a4-45e3-a0c2-72f427ec4ac2-kube-api-access-rflzr\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.016616 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.016669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.016669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.016749 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-tmp\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.016749 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.016717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.017173 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.017146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d741de15-21a4-45e3-a0c2-72f427ec4ac2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.017272 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.017152 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-tmp\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.020283 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.020252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.020386 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.020294 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-ca\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.020431 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.020390 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.020531 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.020510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.020657 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.020638 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d741de15-21a4-45e3-a0c2-72f427ec4ac2-hub\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.025384 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.025067 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vnk\" (UniqueName: \"kubernetes.io/projected/970338b6-5c86-4e9b-85b5-d3d1e9c8403d-kube-api-access-d2vnk\") pod \"klusterlet-addon-workmgr-75c7f5b96f-vp8jj\" (UID: \"970338b6-5c86-4e9b-85b5-d3d1e9c8403d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.025483 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.025451 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rflzr\" (UniqueName: \"kubernetes.io/projected/d741de15-21a4-45e3-a0c2-72f427ec4ac2-kube-api-access-rflzr\") pod \"cluster-proxy-proxy-agent-77f47b96c5-p5dbc\" (UID: \"d741de15-21a4-45e3-a0c2-72f427ec4ac2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.093188 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.093162 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:47.122406 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.122382 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:02:47.238646 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.238614 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj"] Jun 10 01:02:47.241863 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:02:47.241839 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970338b6_5c86_4e9b_85b5_d3d1e9c8403d.slice/crio-3b2dd3d76883d99d2b4209f73010a80cfb963da640a25c12307ff8dbb43d6a81 WatchSource:0}: Error finding container 3b2dd3d76883d99d2b4209f73010a80cfb963da640a25c12307ff8dbb43d6a81: Status 404 returned error can't find the container with id 3b2dd3d76883d99d2b4209f73010a80cfb963da640a25c12307ff8dbb43d6a81 Jun 10 01:02:47.276532 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.276507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc"] Jun 10 01:02:47.278913 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:02:47.278888 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd741de15_21a4_45e3_a0c2_72f427ec4ac2.slice/crio-22c2dea9f6b8f601779012f6f834fd1dd65e9276ec45e45ea010eb7074ce7ad8 WatchSource:0}: Error finding container 22c2dea9f6b8f601779012f6f834fd1dd65e9276ec45e45ea010eb7074ce7ad8: Status 404 returned error can't find the container with id 22c2dea9f6b8f601779012f6f834fd1dd65e9276ec45e45ea010eb7074ce7ad8 Jun 10 01:02:47.902989 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.902949 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerStarted","Data":"22c2dea9f6b8f601779012f6f834fd1dd65e9276ec45e45ea010eb7074ce7ad8"} Jun 10 01:02:47.904069 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:47.904047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerStarted","Data":"3b2dd3d76883d99d2b4209f73010a80cfb963da640a25c12307ff8dbb43d6a81"} Jun 10 01:02:50.840398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:50.840368 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tzsb" Jun 10 01:02:53.924443 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.924402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerStarted","Data":"a9550628bf8e6fa53e75d07487501f32c93c7a3cd7e4c910a998695d26d7de73"} Jun 10 01:02:53.924443 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.924448 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerStarted","Data":"30b4f0f4eab983cbef59ba54fd739255672f16a75d0d21bc0001a993a42c2053"} Jun 10 01:02:53.924940 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.924466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerStarted","Data":"3a2a473e840c830723c555647a26ddcbb9f3a24aad3bf7b0e61185ad66aab866"} Jun 10 01:02:53.925893 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.925871 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerStarted","Data":"e8ce00d68717d23efde7d43f3e3c1fd0fcd5b4a2966c2bcce5b01f4206c29345"} Jun 10 01:02:53.926015 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.926000 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:53.927778 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.927756 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:02:53.941567 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.941529 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" podStartSLOduration=1.7848361270000002 podStartE2EDuration="7.941517748s" totalImagesPullingTime="6.156681621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:53.940150686 +0000 UTC m=+62.628296323" watchObservedRunningTime="2026-06-10 01:02:53.941517748 +0000 UTC m=+62.629663372" Jun 10 01:02:53.958535 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:53.958496 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" podStartSLOduration=1.8316515820000001 podStartE2EDuration="7.958486511s" totalImagesPullingTime="6.126834929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:53.958204971 +0000 UTC m=+62.646350595" watchObservedRunningTime="2026-06-10 01:02:53.958486511 +0000 UTC m=+62.646632162" Jun 10 01:02:57.500728 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.500685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:02:57.500728 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.500727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:57.501179 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.500768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:57.503567 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.503544 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:57.503664 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.503646 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:57.503723 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.503654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:57.511534 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:57.511514 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:02:57.511612 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:57.511581 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:04:01.511559441 +0000 UTC m=+130.199705049 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : secret "metrics-daemon-secret" not found Jun 10 01:02:57.513440 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.513426 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:57.513761 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.513744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2-original-pull-secret\") pod \"global-pull-secret-syncer-hr9wq\" (UID: \"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2\") " pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:57.524337 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.524297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qwq\" (UniqueName: \"kubernetes.io/projected/f6dbd567-74a8-4d94-be65-34b4487c7d99-kube-api-access-q2qwq\") pod \"network-check-target-d6chp\" (UID: \"f6dbd567-74a8-4d94-be65-34b4487c7d99\") " pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:57.701916 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.701883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr9wq" Jun 10 01:02:57.708802 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.708779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:02:57.717827 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.717804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:02:57.831444 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.831413 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hr9wq"] Jun 10 01:02:57.834786 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:02:57.834755 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c05fb1_8afc_4b5d_9bdf_31367bbb4fb2.slice/crio-53d7f2470c88306f2db70eb2727c495beadf79d671f6477a01534c0868724208 WatchSource:0}: Error finding container 53d7f2470c88306f2db70eb2727c495beadf79d671f6477a01534c0868724208: Status 404 returned error can't find the container with id 53d7f2470c88306f2db70eb2727c495beadf79d671f6477a01534c0868724208 Jun 10 01:02:57.845498 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.845475 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6chp"] Jun 10 01:02:57.848731 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:02:57.848710 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dbd567_74a8_4d94_be65_34b4487c7d99.slice/crio-cdcc84731f45f43f3e14c0aeb5accb87cc2774ae89382b95dca3b0fdc8bb8354 WatchSource:0}: Error finding container cdcc84731f45f43f3e14c0aeb5accb87cc2774ae89382b95dca3b0fdc8bb8354: Status 404 returned error can't find the container with id cdcc84731f45f43f3e14c0aeb5accb87cc2774ae89382b95dca3b0fdc8bb8354 Jun 10 01:02:57.936259 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.936224 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6chp" event={"ID":"f6dbd567-74a8-4d94-be65-34b4487c7d99","Type":"ContainerStarted","Data":"cdcc84731f45f43f3e14c0aeb5accb87cc2774ae89382b95dca3b0fdc8bb8354"} Jun 10 01:02:57.937331 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:57.937289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hr9wq" event={"ID":"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2","Type":"ContainerStarted","Data":"53d7f2470c88306f2db70eb2727c495beadf79d671f6477a01534c0868724208"} Jun 10 01:02:58.004944 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:02:58.004868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:02:58.005060 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:58.004993 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:58.005060 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:02:58.005057 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:03:30.005038167 +0000 UTC m=+98.693183773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:03:02.954062 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:02.954013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hr9wq" event={"ID":"e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2","Type":"ContainerStarted","Data":"865c93dc7a1fd64f28a08325b70ec2331cb312c6a41ba2185729adf20ff56220"} Jun 10 01:03:02.955424 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:02.955391 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6chp" event={"ID":"f6dbd567-74a8-4d94-be65-34b4487c7d99","Type":"ContainerStarted","Data":"87bfbc1bb2ebfa06e7f6474a7d85e9d0cfb071c7e443bf8d9846924ce4c074a1"} Jun 10 01:03:02.955542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:02.955456 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:03:02.979656 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:02.979610 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hr9wq" podStartSLOduration=67.680498818 podStartE2EDuration="1m11.979597234s" totalImagesPullingTime="4.299098416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:02.967437978 +0000 UTC m=+71.655583603" watchObservedRunningTime="2026-06-10 01:03:02.979597234 +0000 UTC m=+71.667742858" Jun 10 01:03:02.980080 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:02.980055 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d6chp" podStartSLOduration=67.698615383 podStartE2EDuration="1m11.980046367s" totalImagesPullingTime="4.281430984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:02.979010441 +0000 UTC m=+71.667156065" watchObservedRunningTime="2026-06-10 01:03:02.980046367 +0000 UTC m=+71.668191970" Jun 10 01:03:30.018773 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:30.018685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:03:30.019159 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:03:30.018790 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:03:30.019159 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:03:30.018840 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:04:34.018826974 +0000 UTC m=+162.706972581 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:03:33.960090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:03:33.960055 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d6chp" Jun 10 01:04:01.521373 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:01.521336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:04:01.521860 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:01.521442 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:04:01.521860 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:01.521497 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:06:03.521482104 +0000 UTC m=+252.209627707 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : secret "metrics-daemon-secret" not found Jun 10 01:04:29.208562 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:29.208523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jrrjw" podUID="5a684fa9-c13a-400c-984f-a035a7fbd8ef" Jun 10 01:04:30.201115 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:30.201087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:04:30.695677 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:30.695634 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:04:34.027319 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:34.027226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:04:34.027774 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:34.027351 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:04:34.027774 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:04:34.027413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls podName:5a684fa9-c13a-400c-984f-a035a7fbd8ef nodeName:}" failed. No retries permitted until 2026-06-10 01:06:36.027398236 +0000 UTC m=+284.715543839 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls") pod "dns-default-jrrjw" (UID: "5a684fa9-c13a-400c-984f-a035a7fbd8ef") : secret "dns-default-metrics-tls" not found Jun 10 01:04:45.684996 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:45.684956 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:04:53.926485 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:53.926431 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" podUID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 10 01:04:54.275491 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:54.275395 2568 generic.go:356] "Generic (PLEG): container finished" podID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" containerID="e8ce00d68717d23efde7d43f3e3c1fd0fcd5b4a2966c2bcce5b01f4206c29345" exitCode=1 Jun 10 01:04:54.275491 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:54.275442 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerDied","Data":"e8ce00d68717d23efde7d43f3e3c1fd0fcd5b4a2966c2bcce5b01f4206c29345"} Jun 10 01:04:54.275822 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:54.275805 2568 scope.go:117] "RemoveContainer" containerID="e8ce00d68717d23efde7d43f3e3c1fd0fcd5b4a2966c2bcce5b01f4206c29345" Jun 10 01:04:55.280175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:55.280136 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerStarted","Data":"a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca"} Jun 10 01:04:55.280609 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:55.280453 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:04:55.281066 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:04:55.281045 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:05:56.003527 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:05:56.003494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sgkpn_0ef5b667-cdc3-40b0-a6a2-e39bd06d4718/dns-node-resolver/0.log" Jun 10 01:05:57.012675 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:05:57.012642 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9d8rm_2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751/node-ca/0.log" Jun 10 01:05:58.004240 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:05:58.004213 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhrxg_8fa17a04-7e68-44da-b233-e1f7ec0391bd/serve-healthcheck-canary/0.log" Jun 10 01:06:03.523665 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:03.523576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:06:03.524127 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:03.523719 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:06:03.524127 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:03.523789 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs podName:d1614a90-8db4-4e23-b855-546cb80ba0da nodeName:}" failed. No retries permitted until 2026-06-10 01:08:05.523773994 +0000 UTC m=+374.211919596 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs") pod "network-metrics-daemon-r64zg" (UID: "d1614a90-8db4-4e23-b855-546cb80ba0da") : secret "metrics-daemon-secret" not found Jun 10 01:06:14.663029 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.662994 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rw6jw"] Jun 10 01:06:14.665876 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.665859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.668336 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.668287 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 01:06:14.668478 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.668296 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pvxg\"" Jun 10 01:06:14.669203 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.669182 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 01:06:14.669344 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.669223 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 01:06:14.669417 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.669191 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 01:06:14.676426 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.676403 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rw6jw"] Jun 10 01:06:14.794846 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.794806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/723f969f-ed87-4dc5-9e96-333146a65ae8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.795010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.794880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9mlt\" (UniqueName: \"kubernetes.io/projected/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-api-access-k9mlt\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.795010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.794899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/723f969f-ed87-4dc5-9e96-333146a65ae8-crio-socket\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.795010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.794924 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/723f969f-ed87-4dc5-9e96-333146a65ae8-data-volume\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.795010 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.794938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895605 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/723f969f-ed87-4dc5-9e96-333146a65ae8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895744 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9mlt\" (UniqueName: \"kubernetes.io/projected/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-api-access-k9mlt\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895744 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/723f969f-ed87-4dc5-9e96-333146a65ae8-crio-socket\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895744 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/723f969f-ed87-4dc5-9e96-333146a65ae8-data-volume\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895744 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.895948 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.895738 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/723f969f-ed87-4dc5-9e96-333146a65ae8-crio-socket\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.896077 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.896057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/723f969f-ed87-4dc5-9e96-333146a65ae8-data-volume\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.896249 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.896232 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.898188 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.898166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/723f969f-ed87-4dc5-9e96-333146a65ae8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.903638 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.903617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9mlt\" (UniqueName: \"kubernetes.io/projected/723f969f-ed87-4dc5-9e96-333146a65ae8-kube-api-access-k9mlt\") pod \"insights-runtime-extractor-rw6jw\" (UID: \"723f969f-ed87-4dc5-9e96-333146a65ae8\") " pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:14.978756 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:14.978700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rw6jw" Jun 10 01:06:15.096798 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:15.096768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rw6jw"] Jun 10 01:06:15.099855 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:06:15.099829 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723f969f_ed87_4dc5_9e96_333146a65ae8.slice/crio-4f69c8177c5401d8e1429e79dfe164d2a5f1879a370a7796cdf75cd9cfb0ee83 WatchSource:0}: Error finding container 4f69c8177c5401d8e1429e79dfe164d2a5f1879a370a7796cdf75cd9cfb0ee83: Status 404 returned error can't find the container with id 4f69c8177c5401d8e1429e79dfe164d2a5f1879a370a7796cdf75cd9cfb0ee83 Jun 10 01:06:15.511183 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:15.511145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rw6jw" event={"ID":"723f969f-ed87-4dc5-9e96-333146a65ae8","Type":"ContainerStarted","Data":"fa8e579cd42788be38fd11d625fc600e2ba9d63903dfca535f76ef845cb10848"} Jun 10 01:06:15.511364 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:15.511197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rw6jw" event={"ID":"723f969f-ed87-4dc5-9e96-333146a65ae8","Type":"ContainerStarted","Data":"4f69c8177c5401d8e1429e79dfe164d2a5f1879a370a7796cdf75cd9cfb0ee83"} Jun 10 01:06:16.516534 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:16.516498 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rw6jw" event={"ID":"723f969f-ed87-4dc5-9e96-333146a65ae8","Type":"ContainerStarted","Data":"539511e567edcc8a460f5c72234ca8191100161edde12e7d5fc32e9c387f418e"} Jun 10 01:06:17.520864 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:17.520786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rw6jw" event={"ID":"723f969f-ed87-4dc5-9e96-333146a65ae8","Type":"ContainerStarted","Data":"694d83ab4824c173d3839a31374d865b9cf2f6064477a1e3d448a8657f2c00b3"} Jun 10 01:06:17.538835 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:17.538786 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rw6jw" podStartSLOduration=1.54495738 podStartE2EDuration="3.53877087s" totalImagesPullingTime="1.99381349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:17.538462035 +0000 UTC m=+266.226607659" watchObservedRunningTime="2026-06-10 01:06:17.53877087 +0000 UTC m=+266.226916494" Jun 10 01:06:21.222252 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.222222 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8h94m"] Jun 10 01:06:21.225354 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.225335 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.227791 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.227759 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 01:06:21.227889 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.227814 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zxxpm\"" Jun 10 01:06:21.228469 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.228441 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 01:06:21.228469 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.228459 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 01:06:21.228659 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.228507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 01:06:21.228659 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.228463 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 01:06:21.228765 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.228755 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 01:06:21.339398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-root\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l24z\" (UniqueName: \"kubernetes.io/projected/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-kube-api-access-8l24z\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-textfile\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-metrics-client-ca\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339734 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-wtmp\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339734 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.339734 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.339672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-sys\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440386 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-sys\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440514 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-sys\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440514 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-root\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440517 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l24z\" (UniqueName: \"kubernetes.io/projected/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-kube-api-access-8l24z\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-textfile\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-metrics-client-ca\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440625 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440606 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440828 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-root\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440828 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440828 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-wtmp\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440828 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.440828 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:21.440750 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 01:06:21.441088 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:21.440837 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls podName:d21e8ec7-b175-4e9a-934e-5b9c167b7e65 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.940816505 +0000 UTC m=+270.628962112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls") pod "node-exporter-8h94m" (UID: "d21e8ec7-b175-4e9a-934e-5b9c167b7e65") : secret "node-exporter-tls" not found Jun 10 01:06:21.441088 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440845 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-wtmp\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.441088 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.440958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-textfile\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.441213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.441161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-metrics-client-ca\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.441213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.441208 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-accelerators-collector-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.443139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.443118 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.448362 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.448304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l24z\" (UniqueName: \"kubernetes.io/projected/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-kube-api-access-8l24z\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.944628 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.944594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:21.947011 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:21.946992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d21e8ec7-b175-4e9a-934e-5b9c167b7e65-node-exporter-tls\") pod \"node-exporter-8h94m\" (UID: \"d21e8ec7-b175-4e9a-934e-5b9c167b7e65\") " pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:22.134913 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:22.134875 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8h94m" Jun 10 01:06:22.146141 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:06:22.146118 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21e8ec7_b175_4e9a_934e_5b9c167b7e65.slice/crio-580f3d54afde80be0c8c38a9370f713d8c2a0f49cb800eaabf818c69db885308 WatchSource:0}: Error finding container 580f3d54afde80be0c8c38a9370f713d8c2a0f49cb800eaabf818c69db885308: Status 404 returned error can't find the container with id 580f3d54afde80be0c8c38a9370f713d8c2a0f49cb800eaabf818c69db885308 Jun 10 01:06:22.536598 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:22.536566 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8h94m" event={"ID":"d21e8ec7-b175-4e9a-934e-5b9c167b7e65","Type":"ContainerStarted","Data":"580f3d54afde80be0c8c38a9370f713d8c2a0f49cb800eaabf818c69db885308"} Jun 10 01:06:23.541140 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:23.541052 2568 generic.go:356] "Generic (PLEG): container finished" podID="d21e8ec7-b175-4e9a-934e-5b9c167b7e65" containerID="7b66ac4a67c62570756872a192bf5213c3580caeb75f6a70b180d637862d1f4e" exitCode=0 Jun 10 01:06:23.541140 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:23.541108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8h94m" event={"ID":"d21e8ec7-b175-4e9a-934e-5b9c167b7e65","Type":"ContainerDied","Data":"7b66ac4a67c62570756872a192bf5213c3580caeb75f6a70b180d637862d1f4e"} Jun 10 01:06:24.546264 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:24.546232 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8h94m" event={"ID":"d21e8ec7-b175-4e9a-934e-5b9c167b7e65","Type":"ContainerStarted","Data":"227c8361a852b06daba188ac838376403569e0240b6b76fa8b0ce140f2ab14f8"} Jun 10 01:06:24.546608 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:24.546280 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8h94m" event={"ID":"d21e8ec7-b175-4e9a-934e-5b9c167b7e65","Type":"ContainerStarted","Data":"bcf7ed46978333b9e02d583c725d9495d4793a616443218eccebbd0d1673f303"} Jun 10 01:06:24.564399 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:24.564355 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8h94m" podStartSLOduration=2.579879011 podStartE2EDuration="3.564341811s" totalImagesPullingTime="913.369182ms" totalInitContainerRuntime="71.093618ms" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:24.562682561 +0000 UTC m=+273.250828187" watchObservedRunningTime="2026-06-10 01:06:24.564341811 +0000 UTC m=+273.252487435" Jun 10 01:06:25.992245 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:25.992214 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw"] Jun 10 01:06:25.995178 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:25.995162 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:25.997484 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:25.997465 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 01:06:25.997577 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:25.997484 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kmxcz\"" Jun 10 01:06:26.003807 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.003784 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw"] Jun 10 01:06:26.070289 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.070267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zgl\" (UniqueName: \"kubernetes.io/projected/25984b69-184d-46ae-8de5-ba02dd6ebee8-kube-api-access-f2zgl\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.070409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.070322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25984b69-184d-46ae-8de5-ba02dd6ebee8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.171395 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.171365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zgl\" (UniqueName: \"kubernetes.io/projected/25984b69-184d-46ae-8de5-ba02dd6ebee8-kube-api-access-f2zgl\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.171503 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.171421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25984b69-184d-46ae-8de5-ba02dd6ebee8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.173944 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.173920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/25984b69-184d-46ae-8de5-ba02dd6ebee8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.178675 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.178653 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zgl\" (UniqueName: \"kubernetes.io/projected/25984b69-184d-46ae-8de5-ba02dd6ebee8-kube-api-access-f2zgl\") pod \"monitoring-plugin-76b68cc874-kfhxw\" (UID: \"25984b69-184d-46ae-8de5-ba02dd6ebee8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.303434 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.303376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:26.421846 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.421819 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw"] Jun 10 01:06:26.425451 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:06:26.425429 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25984b69_184d_46ae_8de5_ba02dd6ebee8.slice/crio-058c6bfe2cb3be2e22e50bf3940a24ef7f38d82c734f13f7e6a5000cf345d380 WatchSource:0}: Error finding container 058c6bfe2cb3be2e22e50bf3940a24ef7f38d82c734f13f7e6a5000cf345d380: Status 404 returned error can't find the container with id 058c6bfe2cb3be2e22e50bf3940a24ef7f38d82c734f13f7e6a5000cf345d380 Jun 10 01:06:26.554616 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:26.554545 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" event={"ID":"25984b69-184d-46ae-8de5-ba02dd6ebee8","Type":"ContainerStarted","Data":"058c6bfe2cb3be2e22e50bf3940a24ef7f38d82c734f13f7e6a5000cf345d380"} Jun 10 01:06:29.564651 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:29.564615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" event={"ID":"25984b69-184d-46ae-8de5-ba02dd6ebee8","Type":"ContainerStarted","Data":"f4e426039e22069f0c63b86639d4012afa13b549999ef599897c3f7e93f46a3e"} Jun 10 01:06:29.565090 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:29.564786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:29.569269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:29.569247 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" Jun 10 01:06:29.579130 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:29.579092 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kfhxw" podStartSLOduration=2.273083851 podStartE2EDuration="4.579080532s" totalImagesPullingTime="2.305996681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:29.578505106 +0000 UTC m=+278.266650742" watchObservedRunningTime="2026-06-10 01:06:29.579080532 +0000 UTC m=+278.267226157" Jun 10 01:06:33.201891 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:33.201845 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jrrjw" podUID="5a684fa9-c13a-400c-984f-a035a7fbd8ef" Jun 10 01:06:33.577299 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:33.577272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:36.040602 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.040559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:36.043016 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.042995 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a684fa9-c13a-400c-984f-a035a7fbd8ef-metrics-tls\") pod \"dns-default-jrrjw\" (UID: \"5a684fa9-c13a-400c-984f-a035a7fbd8ef\") " pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:36.280212 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.280181 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:06:36.288999 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.288982 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:36.418261 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.418140 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jrrjw"] Jun 10 01:06:36.420545 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:06:36.420518 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a684fa9_c13a_400c_984f_a035a7fbd8ef.slice/crio-d9dbb2e638c83d5196f943f0d7322abf8a1c458b9ad40cdd79e0c14e73fd08f0 WatchSource:0}: Error finding container d9dbb2e638c83d5196f943f0d7322abf8a1c458b9ad40cdd79e0c14e73fd08f0: Status 404 returned error can't find the container with id d9dbb2e638c83d5196f943f0d7322abf8a1c458b9ad40cdd79e0c14e73fd08f0 Jun 10 01:06:36.586874 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:36.586845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrrjw" event={"ID":"5a684fa9-c13a-400c-984f-a035a7fbd8ef","Type":"ContainerStarted","Data":"d9dbb2e638c83d5196f943f0d7322abf8a1c458b9ad40cdd79e0c14e73fd08f0"} Jun 10 01:06:38.595510 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:38.595478 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrrjw" event={"ID":"5a684fa9-c13a-400c-984f-a035a7fbd8ef","Type":"ContainerStarted","Data":"655293daf460467503ba7a36f15067935cda3b486b9704fe3f573ef8ff7aff43"} Jun 10 01:06:38.595903 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:38.595528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jrrjw" event={"ID":"5a684fa9-c13a-400c-984f-a035a7fbd8ef","Type":"ContainerStarted","Data":"da4d4471a6d3f01f4d61142a50f6bbdbc6e815369674dceafb570d992036226d"} Jun 10 01:06:38.595903 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:38.595625 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:38.611614 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:38.611569 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jrrjw" podStartSLOduration=251.223023683 podStartE2EDuration="4m12.611555658s" totalImagesPullingTime="1.388531975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:38.6100479 +0000 UTC m=+287.298193526" watchObservedRunningTime="2026-06-10 01:06:38.611555658 +0000 UTC m=+287.299701299" Jun 10 01:06:42.435360 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.435326 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-88f4x"] Jun 10 01:06:42.438564 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.438546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:06:42.440844 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.440815 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 01:06:42.440976 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.440930 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 01:06:42.441084 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.441064 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-85zrd\"" Jun 10 01:06:42.448285 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.448261 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-88f4x"] Jun 10 01:06:42.590127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.590097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ghn\" (UniqueName: \"kubernetes.io/projected/48ec5b35-bd6a-43f9-bbc6-7ba58920c08a-kube-api-access-46ghn\") pod \"downloads-6657875f97-88f4x\" (UID: \"48ec5b35-bd6a-43f9-bbc6-7ba58920c08a\") " pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:06:42.691338 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.691242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ghn\" (UniqueName: \"kubernetes.io/projected/48ec5b35-bd6a-43f9-bbc6-7ba58920c08a-kube-api-access-46ghn\") pod \"downloads-6657875f97-88f4x\" (UID: \"48ec5b35-bd6a-43f9-bbc6-7ba58920c08a\") " pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:06:42.700045 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.700018 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ghn\" (UniqueName: \"kubernetes.io/projected/48ec5b35-bd6a-43f9-bbc6-7ba58920c08a-kube-api-access-46ghn\") pod \"downloads-6657875f97-88f4x\" (UID: \"48ec5b35-bd6a-43f9-bbc6-7ba58920c08a\") " pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:06:42.747763 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.747724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:06:42.869069 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:42.868992 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-88f4x"] Jun 10 01:06:42.871467 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:06:42.871440 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ec5b35_bd6a_43f9_bbc6_7ba58920c08a.slice/crio-7f634845a5882fd2b83faef0a31f8153dc56155d6b975c4857f6eaa3ed6cf2b5 WatchSource:0}: Error finding container 7f634845a5882fd2b83faef0a31f8153dc56155d6b975c4857f6eaa3ed6cf2b5: Status 404 returned error can't find the container with id 7f634845a5882fd2b83faef0a31f8153dc56155d6b975c4857f6eaa3ed6cf2b5 Jun 10 01:06:43.612581 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:43.612548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-88f4x" event={"ID":"48ec5b35-bd6a-43f9-bbc6-7ba58920c08a","Type":"ContainerStarted","Data":"7f634845a5882fd2b83faef0a31f8153dc56155d6b975c4857f6eaa3ed6cf2b5"} Jun 10 01:06:48.601484 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:48.601453 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jrrjw" Jun 10 01:06:48.686361 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:48.686323 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r64zg" podUID="d1614a90-8db4-4e23-b855-546cb80ba0da" Jun 10 01:06:51.634669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:51.634639 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:06:51.635103 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:51.634811 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:06:51.642478 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:51.642457 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 01:06:54.650940 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:54.650856 2568 generic.go:356] "Generic (PLEG): container finished" podID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" containerID="a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca" exitCode=1 Jun 10 01:06:54.650940 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:54.650894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerDied","Data":"a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca"} Jun 10 01:06:54.651452 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:54.650968 2568 scope.go:117] "RemoveContainer" containerID="e8ce00d68717d23efde7d43f3e3c1fd0fcd5b4a2966c2bcce5b01f4206c29345" Jun 10 01:06:54.651452 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:54.651243 2568 scope.go:117] "RemoveContainer" containerID="a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca" Jun 10 01:06:54.651452 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:54.651436 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75c7f5b96f-vp8jj_open-cluster-management-agent-addon(970338b6-5c86-4e9b-85b5-d3d1e9c8403d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" podUID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" Jun 10 01:06:55.281326 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:55.281281 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:06:55.656644 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:55.656620 2568 scope.go:117] "RemoveContainer" containerID="a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca" Jun 10 01:06:55.657020 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:55.656771 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75c7f5b96f-vp8jj_open-cluster-management-agent-addon(970338b6-5c86-4e9b-85b5-d3d1e9c8403d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" podUID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" Jun 10 01:06:57.094161 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:57.094116 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:06:57.094646 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:06:57.094531 2568 scope.go:117] "RemoveContainer" containerID="a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca" Jun 10 01:06:57.094746 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:06:57.094716 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75c7f5b96f-vp8jj_open-cluster-management-agent-addon(970338b6-5c86-4e9b-85b5-d3d1e9c8403d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" podUID="970338b6-5c86-4e9b-85b5-d3d1e9c8403d" Jun 10 01:07:02.684770 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:02.684730 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:07:03.689220 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:03.689187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-88f4x" event={"ID":"48ec5b35-bd6a-43f9-bbc6-7ba58920c08a","Type":"ContainerStarted","Data":"d8e55e0a10da7e4e15b83536f74f7e3f13b118087c9a49df91deabbce59a45b6"} Jun 10 01:07:03.689614 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:03.689239 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:07:03.704430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:03.704378 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-88f4x" podStartSLOduration=1.6196931380000001 podStartE2EDuration="21.704358969s" totalImagesPullingTime="20.084665831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:03.702553392 +0000 UTC m=+312.390699019" watchObservedRunningTime="2026-06-10 01:07:03.704358969 +0000 UTC m=+312.392504594" Jun 10 01:07:03.704905 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:03.704878 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-88f4x" Jun 10 01:07:07.123669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:07.123624 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" podUID="d741de15-21a4-45e3-a0c2-72f427ec4ac2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 01:07:11.689236 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:11.689203 2568 scope.go:117] "RemoveContainer" containerID="a493e3f9e49de3085031f22130fcfea6f83dcd704bf99abc78cc88d8f3dfb7ca" Jun 10 01:07:12.717549 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:12.717512 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" event={"ID":"970338b6-5c86-4e9b-85b5-d3d1e9c8403d","Type":"ContainerStarted","Data":"c9eff284abbb2eafd3fcd8eef0d69ec58f1d6b06cd11824dcb33ad54dedee6fb"} Jun 10 01:07:12.718017 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:12.717773 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:07:12.719379 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:12.719358 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c7f5b96f-vp8jj" Jun 10 01:07:17.124080 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:17.124037 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" podUID="d741de15-21a4-45e3-a0c2-72f427ec4ac2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 01:07:18.386126 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:18.386097 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kfhxw_25984b69-184d-46ae-8de5-ba02dd6ebee8/monitoring-plugin/0.log" Jun 10 01:07:18.583586 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:18.583561 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/init-textfile/0.log" Jun 10 01:07:18.784385 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:18.784300 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/node-exporter/0.log" Jun 10 01:07:18.983410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:18.983376 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/kube-rbac-proxy/0.log" Jun 10 01:07:25.186029 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:25.185983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-88f4x_48ec5b35-bd6a-43f9-bbc6-7ba58920c08a/download-server/0.log" Jun 10 01:07:25.983334 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:25.983291 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhrxg_8fa17a04-7e68-44da-b233-e1f7ec0391bd/serve-healthcheck-canary/0.log" Jun 10 01:07:27.124062 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.124023 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" podUID="d741de15-21a4-45e3-a0c2-72f427ec4ac2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 01:07:27.124527 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.124106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" Jun 10 01:07:27.124679 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.124642 2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a9550628bf8e6fa53e75d07487501f32c93c7a3cd7e4c910a998695d26d7de73"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 01:07:27.124811 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.124703 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" podUID="d741de15-21a4-45e3-a0c2-72f427ec4ac2" containerName="service-proxy" containerID="cri-o://a9550628bf8e6fa53e75d07487501f32c93c7a3cd7e4c910a998695d26d7de73" gracePeriod=30 Jun 10 01:07:27.768684 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.768652 2568 generic.go:356] "Generic (PLEG): container finished" podID="d741de15-21a4-45e3-a0c2-72f427ec4ac2" containerID="a9550628bf8e6fa53e75d07487501f32c93c7a3cd7e4c910a998695d26d7de73" exitCode=2 Jun 10 01:07:27.768839 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.768713 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerDied","Data":"a9550628bf8e6fa53e75d07487501f32c93c7a3cd7e4c910a998695d26d7de73"} Jun 10 01:07:27.768839 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:07:27.768747 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77f47b96c5-p5dbc" event={"ID":"d741de15-21a4-45e3-a0c2-72f427ec4ac2","Type":"ContainerStarted","Data":"b83aa7fa8340a4cf97b3389928fb2f4da1ad94a813d69d389defe1d83a9bb5e5"} Jun 10 01:08:05.564636 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.564536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:08:05.566958 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.566938 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1614a90-8db4-4e23-b855-546cb80ba0da-metrics-certs\") pod \"network-metrics-daemon-r64zg\" (UID: \"d1614a90-8db4-4e23-b855-546cb80ba0da\") " pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:08:05.688359 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.688332 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:08:05.696420 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.696404 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r64zg" Jun 10 01:08:05.817692 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.817615 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r64zg"] Jun 10 01:08:05.820443 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:08:05.820419 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1614a90_8db4_4e23_b855_546cb80ba0da.slice/crio-610055d120350a2f31fd2f2b9031d000d01c26137d7d62255b0254be9084331e WatchSource:0}: Error finding container 610055d120350a2f31fd2f2b9031d000d01c26137d7d62255b0254be9084331e: Status 404 returned error can't find the container with id 610055d120350a2f31fd2f2b9031d000d01c26137d7d62255b0254be9084331e Jun 10 01:08:05.822276 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.822260 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:08:05.894272 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:05.894239 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r64zg" event={"ID":"d1614a90-8db4-4e23-b855-546cb80ba0da","Type":"ContainerStarted","Data":"610055d120350a2f31fd2f2b9031d000d01c26137d7d62255b0254be9084331e"} Jun 10 01:08:06.898903 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:06.898829 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r64zg" event={"ID":"d1614a90-8db4-4e23-b855-546cb80ba0da","Type":"ContainerStarted","Data":"689e9fa45b45f26c4ea36856089e0d6e5ae22a94d20384eca200587ac5c84ca6"} Jun 10 01:08:06.898903 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:06.898879 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r64zg" event={"ID":"d1614a90-8db4-4e23-b855-546cb80ba0da","Type":"ContainerStarted","Data":"08fa51d92f89aeab0bdd5393aac353dc4846f237636accb83a6fabcf79706be1"} Jun 10 01:08:06.914762 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:08:06.914720 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r64zg" podStartSLOduration=375.089984879 podStartE2EDuration="6m15.914705323s" totalImagesPullingTime="824.720444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:08:06.91350451 +0000 UTC m=+375.601650136" watchObservedRunningTime="2026-06-10 01:08:06.914705323 +0000 UTC m=+375.602850947" Jun 10 01:10:36.356404 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.356322 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xvck9"] Jun 10 01:10:36.361338 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.358972 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.361845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.361820 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 01:10:36.362571 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.362540 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5g4nq\"" Jun 10 01:10:36.362694 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.362590 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 01:10:36.366819 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.366793 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xvck9"] Jun 10 01:10:36.416008 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.415984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgqr\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-kube-api-access-qwgqr\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.416105 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.416014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.516433 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.516408 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.516514 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.516472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgqr\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-kube-api-access-qwgqr\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.524077 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.524048 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.524547 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.524529 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgqr\" (UniqueName: \"kubernetes.io/projected/59782760-2ee4-4e4a-853b-9555c6c6ff09-kube-api-access-qwgqr\") pod \"cert-manager-cainjector-5d99449ffd-xvck9\" (UID: \"59782760-2ee4-4e4a-853b-9555c6c6ff09\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.670994 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.670925 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" Jun 10 01:10:36.792553 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:36.792532 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xvck9"] Jun 10 01:10:36.794827 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:10:36.794795 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59782760_2ee4_4e4a_853b_9555c6c6ff09.slice/crio-87d0eb2d91dd8c227ab819532f37b817034fe1db261e374bfbc3823717c9667a WatchSource:0}: Error finding container 87d0eb2d91dd8c227ab819532f37b817034fe1db261e374bfbc3823717c9667a: Status 404 returned error can't find the container with id 87d0eb2d91dd8c227ab819532f37b817034fe1db261e374bfbc3823717c9667a Jun 10 01:10:37.388698 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:37.388666 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" event={"ID":"59782760-2ee4-4e4a-853b-9555c6c6ff09","Type":"ContainerStarted","Data":"87d0eb2d91dd8c227ab819532f37b817034fe1db261e374bfbc3823717c9667a"} Jun 10 01:10:41.403968 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:41.403932 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" event={"ID":"59782760-2ee4-4e4a-853b-9555c6c6ff09","Type":"ContainerStarted","Data":"a5c7a50eef0466b6b157e3d2296568a593f563654a283e0d88eb5bddc6cd6df2"} Jun 10 01:10:41.418591 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:41.418546 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xvck9" podStartSLOduration=1.279141289 podStartE2EDuration="5.418532356s" totalImagesPullingTime="4.139391067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:41.417464148 +0000 UTC m=+530.105609773" watchObservedRunningTime="2026-06-10 01:10:41.418532356 +0000 UTC m=+530.106677980" Jun 10 01:10:47.395251 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.395218 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb"] Jun 10 01:10:47.397148 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.397131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.400260 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.400225 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 01:10:47.400409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.400230 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:10:47.400409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.400231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-z6hhp\"" Jun 10 01:10:47.405890 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.405860 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb"] Jun 10 01:10:47.482183 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.482156 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bbbedbd-d820-4bc1-a794-9091050d1ca0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.482284 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.482188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjgdx\" (UniqueName: \"kubernetes.io/projected/8bbbedbd-d820-4bc1-a794-9091050d1ca0-kube-api-access-hjgdx\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.583376 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.583355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bbbedbd-d820-4bc1-a794-9091050d1ca0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.583482 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.583390 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjgdx\" (UniqueName: \"kubernetes.io/projected/8bbbedbd-d820-4bc1-a794-9091050d1ca0-kube-api-access-hjgdx\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.583767 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.583746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bbbedbd-d820-4bc1-a794-9091050d1ca0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.591845 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.591814 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjgdx\" (UniqueName: \"kubernetes.io/projected/8bbbedbd-d820-4bc1-a794-9091050d1ca0-kube-api-access-hjgdx\") pod \"openshift-lws-operator-fd8ccff4c-znsjb\" (UID: \"8bbbedbd-d820-4bc1-a794-9091050d1ca0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.706537 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.706468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" Jun 10 01:10:47.829048 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:47.829020 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb"] Jun 10 01:10:47.832519 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:10:47.832494 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bbbedbd_d820_4bc1_a794_9091050d1ca0.slice/crio-5e65cfbd593ae76501bbe6928101f8ebf76cc4d8f03ac0fe74432c591199aecb WatchSource:0}: Error finding container 5e65cfbd593ae76501bbe6928101f8ebf76cc4d8f03ac0fe74432c591199aecb: Status 404 returned error can't find the container with id 5e65cfbd593ae76501bbe6928101f8ebf76cc4d8f03ac0fe74432c591199aecb Jun 10 01:10:48.429385 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:48.429346 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" event={"ID":"8bbbedbd-d820-4bc1-a794-9091050d1ca0","Type":"ContainerStarted","Data":"5e65cfbd593ae76501bbe6928101f8ebf76cc4d8f03ac0fe74432c591199aecb"} Jun 10 01:10:51.443323 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:51.443280 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" event={"ID":"8bbbedbd-d820-4bc1-a794-9091050d1ca0","Type":"ContainerStarted","Data":"09a474619f60f831513d0d456daad2507d4c67c03724eba9fa38f70f74e677a9"} Jun 10 01:10:51.461379 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:10:51.461328 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-znsjb" podStartSLOduration=1.052316109 podStartE2EDuration="4.461296222s" totalImagesPullingTime="3.408980113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:10:51.460361795 +0000 UTC m=+540.148507421" watchObservedRunningTime="2026-06-10 01:10:51.461296222 +0000 UTC m=+540.149441846" Jun 10 01:11:09.501279 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.501242 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k"] Jun 10 01:11:09.503508 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.503487 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.508386 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.508363 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 01:11:09.508566 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.508547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 01:11:09.508655 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.508565 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 01:11:09.508655 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.508630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 01:11:09.508748 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.508728 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kdln6\"" Jun 10 01:11:09.531940 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.531917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k"] Jun 10 01:11:09.628934 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.628912 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncf8\" (UniqueName: \"kubernetes.io/projected/8452d81e-ef89-4c06-ad60-846bda3ff61c-kube-api-access-xncf8\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.629068 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.628942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.629068 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.628969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.629068 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.628987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.629200 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.629074 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730052 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730066 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xncf8\" (UniqueName: \"kubernetes.io/projected/8452d81e-ef89-4c06-ad60-846bda3ff61c-kube-api-access-xncf8\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.730529 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.730501 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.732511 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.732485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8452d81e-ef89-4c06-ad60-846bda3ff61c-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.732837 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.732817 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.732905 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.732833 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8452d81e-ef89-4c06-ad60-846bda3ff61c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.738149 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.738127 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncf8\" (UniqueName: \"kubernetes.io/projected/8452d81e-ef89-4c06-ad60-846bda3ff61c-kube-api-access-xncf8\") pod \"opendatahub-operator-controller-manager-7f47d5f68-49q6k\" (UID: \"8452d81e-ef89-4c06-ad60-846bda3ff61c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.813161 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.813140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:09.941506 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:09.941484 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k"] Jun 10 01:11:09.943861 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:09.943831 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8452d81e_ef89_4c06_ad60_846bda3ff61c.slice/crio-4d878de974f778cfeaa623bc2ea27d402446f49931f1c618c1b11d48196de6a5 WatchSource:0}: Error finding container 4d878de974f778cfeaa623bc2ea27d402446f49931f1c618c1b11d48196de6a5: Status 404 returned error can't find the container with id 4d878de974f778cfeaa623bc2ea27d402446f49931f1c618c1b11d48196de6a5 Jun 10 01:11:10.513273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:10.513196 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" event={"ID":"8452d81e-ef89-4c06-ad60-846bda3ff61c","Type":"ContainerStarted","Data":"4d878de974f778cfeaa623bc2ea27d402446f49931f1c618c1b11d48196de6a5"} Jun 10 01:11:13.525353 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:13.525295 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" event={"ID":"8452d81e-ef89-4c06-ad60-846bda3ff61c","Type":"ContainerStarted","Data":"e6582d26591302ac0abfef219625049beade3017f7733d4722e0a56dbdda3220"} Jun 10 01:11:14.530726 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:14.530691 2568 generic.go:356] "Generic (PLEG): container finished" podID="8452d81e-ef89-4c06-ad60-846bda3ff61c" containerID="e6582d26591302ac0abfef219625049beade3017f7733d4722e0a56dbdda3220" exitCode=0 Jun 10 01:11:14.531103 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:14.530761 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" event={"ID":"8452d81e-ef89-4c06-ad60-846bda3ff61c","Type":"ContainerDied","Data":"e6582d26591302ac0abfef219625049beade3017f7733d4722e0a56dbdda3220"} Jun 10 01:11:15.536436 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:15.536395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" event={"ID":"8452d81e-ef89-4c06-ad60-846bda3ff61c","Type":"ContainerStarted","Data":"885824075a63a3d4607b47938c5370fb9b244f1be312208670edb3104f007d5a"} Jun 10 01:11:15.536835 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:15.536514 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:15.558007 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:15.557963 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" podStartSLOduration=2.379632144 podStartE2EDuration="6.557948524s" totalImagesPullingTime="3.213911603s" totalInitContainerRuntime="964.404777ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:15.556245532 +0000 UTC m=+564.244391156" watchObservedRunningTime="2026-06-10 01:11:15.557948524 +0000 UTC m=+564.246094150" Jun 10 01:11:26.542257 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:26.542226 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-49q6k" Jun 10 01:11:28.919506 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.919471 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-rqmgt"] Jun 10 01:11:28.928231 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.928211 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:28.930460 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.930440 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 01:11:28.931152 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.931133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 01:11:28.931152 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.931139 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 01:11:28.931298 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.931251 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 01:11:28.941233 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:28.941214 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-rqmgt"] Jun 10 01:11:29.059647 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.059624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxzn\" (UniqueName: \"kubernetes.io/projected/884640d0-7beb-4756-8375-8eb63f8cf88a-kube-api-access-8zxzn\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.059793 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.059654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884640d0-7beb-4756-8375-8eb63f8cf88a-tmp\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.059793 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.059680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884640d0-7beb-4756-8375-8eb63f8cf88a-tls-certs\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.160112 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.160083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxzn\" (UniqueName: \"kubernetes.io/projected/884640d0-7beb-4756-8375-8eb63f8cf88a-kube-api-access-8zxzn\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.160112 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.160116 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884640d0-7beb-4756-8375-8eb63f8cf88a-tmp\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.160409 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.160143 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884640d0-7beb-4756-8375-8eb63f8cf88a-tls-certs\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.162574 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.162539 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/884640d0-7beb-4756-8375-8eb63f8cf88a-tmp\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.162685 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.162627 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884640d0-7beb-4756-8375-8eb63f8cf88a-tls-certs\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.170997 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.170936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxzn\" (UniqueName: \"kubernetes.io/projected/884640d0-7beb-4756-8375-8eb63f8cf88a-kube-api-access-8zxzn\") pod \"kube-auth-proxy-845757977d-rqmgt\" (UID: \"884640d0-7beb-4756-8375-8eb63f8cf88a\") " pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.236671 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.236640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" Jun 10 01:11:29.372839 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.372813 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-845757977d-rqmgt"] Jun 10 01:11:29.374667 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:29.374627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884640d0_7beb_4756_8375_8eb63f8cf88a.slice/crio-dd3e1e2a960ffefcb761136de8d6cc3697f0c1da494132d52a01cae29bec7726 WatchSource:0}: Error finding container dd3e1e2a960ffefcb761136de8d6cc3697f0c1da494132d52a01cae29bec7726: Status 404 returned error can't find the container with id dd3e1e2a960ffefcb761136de8d6cc3697f0c1da494132d52a01cae29bec7726 Jun 10 01:11:29.412546 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.412524 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gsxtm"] Jun 10 01:11:29.416587 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.416569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.420535 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.420517 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 01:11:29.420631 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.420619 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-glxtq\"" Jun 10 01:11:29.433541 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.433514 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gsxtm"] Jun 10 01:11:29.562433 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.562404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47e0e359-8512-4468-b0e5-1c801b529098-cert\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.562433 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.562433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dds\" (UniqueName: \"kubernetes.io/projected/47e0e359-8512-4468-b0e5-1c801b529098-kube-api-access-v6dds\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.586589 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.586548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" event={"ID":"884640d0-7beb-4756-8375-8eb63f8cf88a","Type":"ContainerStarted","Data":"dd3e1e2a960ffefcb761136de8d6cc3697f0c1da494132d52a01cae29bec7726"} Jun 10 01:11:29.663764 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.663734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47e0e359-8512-4468-b0e5-1c801b529098-cert\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.663868 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.663765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dds\" (UniqueName: \"kubernetes.io/projected/47e0e359-8512-4468-b0e5-1c801b529098-kube-api-access-v6dds\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.666260 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.666240 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47e0e359-8512-4468-b0e5-1c801b529098-cert\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.674891 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.674848 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dds\" (UniqueName: \"kubernetes.io/projected/47e0e359-8512-4468-b0e5-1c801b529098-kube-api-access-v6dds\") pod \"odh-model-controller-6dc94f689f-gsxtm\" (UID: \"47e0e359-8512-4468-b0e5-1c801b529098\") " pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.726382 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.726358 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:29.855342 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:29.855301 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-gsxtm"] Jun 10 01:11:29.857288 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:29.857251 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e0e359_8512_4468_b0e5_1c801b529098.slice/crio-513b9372f3b63245107e391fe79c4866174177b698536263c0052aec8fcf356a WatchSource:0}: Error finding container 513b9372f3b63245107e391fe79c4866174177b698536263c0052aec8fcf356a: Status 404 returned error can't find the container with id 513b9372f3b63245107e391fe79c4866174177b698536263c0052aec8fcf356a Jun 10 01:11:30.098145 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.098118 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6x97b"] Jun 10 01:11:30.101227 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.101206 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.103289 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.103266 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 01:11:30.112641 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.112619 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6x97b"] Jun 10 01:11:30.268562 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.268491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zzq\" (UniqueName: \"kubernetes.io/projected/28146625-c2f6-4375-8e49-3df6be6a74d6-kube-api-access-t8zzq\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.268562 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.268550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28146625-c2f6-4375-8e49-3df6be6a74d6-tls-certs\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.369635 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.369547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28146625-c2f6-4375-8e49-3df6be6a74d6-tls-certs\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.369783 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.369643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zzq\" (UniqueName: \"kubernetes.io/projected/28146625-c2f6-4375-8e49-3df6be6a74d6-kube-api-access-t8zzq\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.372811 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.372759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28146625-c2f6-4375-8e49-3df6be6a74d6-tls-certs\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.380765 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.380739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zzq\" (UniqueName: \"kubernetes.io/projected/28146625-c2f6-4375-8e49-3df6be6a74d6-kube-api-access-t8zzq\") pod \"model-serving-api-5dd488fc48-6x97b\" (UID: \"28146625-c2f6-4375-8e49-3df6be6a74d6\") " pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.414489 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.414418 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:30.579755 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.578329 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-6x97b"] Jun 10 01:11:30.584021 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:30.583990 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28146625_c2f6_4375_8e49_3df6be6a74d6.slice/crio-916a24a923bec7b9ad678b8b217ae6655dd86bb825bb953a97ccb596336311e8 WatchSource:0}: Error finding container 916a24a923bec7b9ad678b8b217ae6655dd86bb825bb953a97ccb596336311e8: Status 404 returned error can't find the container with id 916a24a923bec7b9ad678b8b217ae6655dd86bb825bb953a97ccb596336311e8 Jun 10 01:11:30.594557 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.594482 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" event={"ID":"47e0e359-8512-4468-b0e5-1c801b529098","Type":"ContainerStarted","Data":"513b9372f3b63245107e391fe79c4866174177b698536263c0052aec8fcf356a"} Jun 10 01:11:30.596186 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:30.596164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" event={"ID":"28146625-c2f6-4375-8e49-3df6be6a74d6","Type":"ContainerStarted","Data":"916a24a923bec7b9ad678b8b217ae6655dd86bb825bb953a97ccb596336311e8"} Jun 10 01:11:34.615692 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.615646 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" event={"ID":"884640d0-7beb-4756-8375-8eb63f8cf88a","Type":"ContainerStarted","Data":"b410bf426e5d7a408fc132d0da7120171df4fa12b0868302d813587c001c02c9"} Jun 10 01:11:34.618101 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.617800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" event={"ID":"47e0e359-8512-4468-b0e5-1c801b529098","Type":"ContainerStarted","Data":"6c934b80ecb43f1777c4b9cca2b3f158ce6efbf6ac5606dc04206774573d940d"} Jun 10 01:11:34.618222 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.618161 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:34.620664 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.620633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" event={"ID":"28146625-c2f6-4375-8e49-3df6be6a74d6","Type":"ContainerStarted","Data":"7a246281b87e1cfe04c2e5418eda5a81d486ff631ffa56b9d14547f47d0f6f98"} Jun 10 01:11:34.620782 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.620769 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:34.637571 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.637528 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-845757977d-rqmgt" podStartSLOduration=2.339641404 podStartE2EDuration="6.63751493s" totalImagesPullingTime="4.297873526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:34.636984082 +0000 UTC m=+583.325129707" watchObservedRunningTime="2026-06-10 01:11:34.63751493 +0000 UTC m=+583.325660555" Jun 10 01:11:34.653689 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.653556 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" podStartSLOduration=1.060383774 podStartE2EDuration="4.653542303s" totalImagesPullingTime="3.593158529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:34.651975021 +0000 UTC m=+583.340120645" watchObservedRunningTime="2026-06-10 01:11:34.653542303 +0000 UTC m=+583.341687924" Jun 10 01:11:34.668332 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:34.668274 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" podStartSLOduration=1.818284024 podStartE2EDuration="5.668260795s" totalImagesPullingTime="3.849976771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:34.667160671 +0000 UTC m=+583.355306297" watchObservedRunningTime="2026-06-10 01:11:34.668260795 +0000 UTC m=+583.356406419" Jun 10 01:11:39.680416 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.680370 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bm7s7"] Jun 10 01:11:39.682388 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.682370 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.684811 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.684787 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qm9v6\"" Jun 10 01:11:39.685003 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.684990 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 01:11:39.690494 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.690471 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6"] Jun 10 01:11:39.692507 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.692475 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bm7s7"] Jun 10 01:11:39.692617 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.692578 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:39.695160 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.695139 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 01:11:39.695765 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.695744 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wvvtq\"" Jun 10 01:11:39.709841 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.709810 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6"] Jun 10 01:11:39.744264 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.744238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:39.744383 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.744279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7msv\" (UniqueName: \"kubernetes.io/projected/4203e659-e0d5-40d6-a783-68521aaaca11-kube-api-access-j7msv\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.744383 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.744303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.744455 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.744419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxl7\" (UniqueName: \"kubernetes.io/projected/788b0c28-ac1f-42d5-8ca5-99f682b14372-kube-api-access-rcxl7\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:39.845088 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.845065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7msv\" (UniqueName: \"kubernetes.io/projected/4203e659-e0d5-40d6-a783-68521aaaca11-kube-api-access-j7msv\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.845177 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.845098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.845177 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.845122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxl7\" (UniqueName: \"kubernetes.io/projected/788b0c28-ac1f-42d5-8ca5-99f682b14372-kube-api-access-rcxl7\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:39.845177 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.845146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:39.845365 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:11:39.845210 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 10 01:11:39.845365 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:11:39.845222 2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 10 01:11:39.845365 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:11:39.845276 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert podName:4203e659-e0d5-40d6-a783-68521aaaca11 nodeName:}" failed. No retries permitted until 2026-06-10 01:11:40.345260075 +0000 UTC m=+589.033405677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert") pod "kserve-controller-manager-69fc866d76-bm7s7" (UID: "4203e659-e0d5-40d6-a783-68521aaaca11") : secret "kserve-webhook-server-cert" not found Jun 10 01:11:39.845365 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:11:39.845289 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert podName:788b0c28-ac1f-42d5-8ca5-99f682b14372 nodeName:}" failed. No retries permitted until 2026-06-10 01:11:40.345283473 +0000 UTC m=+589.033429076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert") pod "llmisvc-controller-manager-864bfd7bc9-pfff6" (UID: "788b0c28-ac1f-42d5-8ca5-99f682b14372") : secret "llmisvc-webhook-server-cert" not found Jun 10 01:11:39.854887 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.854866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7msv\" (UniqueName: \"kubernetes.io/projected/4203e659-e0d5-40d6-a783-68521aaaca11-kube-api-access-j7msv\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:39.859762 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:39.859741 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxl7\" (UniqueName: \"kubernetes.io/projected/788b0c28-ac1f-42d5-8ca5-99f682b14372-kube-api-access-rcxl7\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:40.348963 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.348928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:40.349127 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.348985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:40.351513 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.351484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/788b0c28-ac1f-42d5-8ca5-99f682b14372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pfff6\" (UID: \"788b0c28-ac1f-42d5-8ca5-99f682b14372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:40.351513 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.351501 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4203e659-e0d5-40d6-a783-68521aaaca11-cert\") pod \"kserve-controller-manager-69fc866d76-bm7s7\" (UID: \"4203e659-e0d5-40d6-a783-68521aaaca11\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:40.594376 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.594349 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:40.607418 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.607396 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:40.736746 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.736719 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bm7s7"] Jun 10 01:11:40.739322 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:40.739280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4203e659_e0d5_40d6_a783_68521aaaca11.slice/crio-d5b5d88f1e9de3aa0862ae225210d1235072f045c877471caf1e878ab60617f4 WatchSource:0}: Error finding container d5b5d88f1e9de3aa0862ae225210d1235072f045c877471caf1e878ab60617f4: Status 404 returned error can't find the container with id d5b5d88f1e9de3aa0862ae225210d1235072f045c877471caf1e878ab60617f4 Jun 10 01:11:40.753244 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:40.753222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6"] Jun 10 01:11:40.756397 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:40.756371 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod788b0c28_ac1f_42d5_8ca5_99f682b14372.slice/crio-6cd4dbe6ff6df608e5e0f7c75d30cc20f738597cc7be3b86e1a303d2cebdb882 WatchSource:0}: Error finding container 6cd4dbe6ff6df608e5e0f7c75d30cc20f738597cc7be3b86e1a303d2cebdb882: Status 404 returned error can't find the container with id 6cd4dbe6ff6df608e5e0f7c75d30cc20f738597cc7be3b86e1a303d2cebdb882 Jun 10 01:11:41.652216 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:41.652182 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" event={"ID":"4203e659-e0d5-40d6-a783-68521aaaca11","Type":"ContainerStarted","Data":"d5b5d88f1e9de3aa0862ae225210d1235072f045c877471caf1e878ab60617f4"} Jun 10 01:11:41.653496 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:41.653463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" event={"ID":"788b0c28-ac1f-42d5-8ca5-99f682b14372","Type":"ContainerStarted","Data":"6cd4dbe6ff6df608e5e0f7c75d30cc20f738597cc7be3b86e1a303d2cebdb882"} Jun 10 01:11:44.667805 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.667765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" event={"ID":"788b0c28-ac1f-42d5-8ca5-99f682b14372","Type":"ContainerStarted","Data":"cdf973fefea7ac63b64ecd1171b70862aaabae5fac949ec566aac0e367d582a0"} Jun 10 01:11:44.668247 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.667867 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:11:44.669341 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.669299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" event={"ID":"4203e659-e0d5-40d6-a783-68521aaaca11","Type":"ContainerStarted","Data":"2d8c70cd6d4db194347cad3ca2b01f1e3848e9874bb9ff430318983eaeb18781"} Jun 10 01:11:44.669449 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.669434 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:11:44.685174 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.685128 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" podStartSLOduration=2.345939473 podStartE2EDuration="5.685115833s" totalImagesPullingTime="3.33917636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:44.684096436 +0000 UTC m=+593.372242063" watchObservedRunningTime="2026-06-10 01:11:44.685115833 +0000 UTC m=+593.373261484" Jun 10 01:11:44.700893 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:44.700854 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" podStartSLOduration=2.347011652 podStartE2EDuration="5.700842815s" totalImagesPullingTime="3.353831163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:44.699381743 +0000 UTC m=+593.387527369" watchObservedRunningTime="2026-06-10 01:11:44.700842815 +0000 UTC m=+593.388988671" Jun 10 01:11:45.626984 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:45.626954 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-gsxtm" Jun 10 01:11:45.629120 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:45.629097 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-6x97b" Jun 10 01:11:48.898087 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.898058 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j"] Jun 10 01:11:48.905825 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.905804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:48.908430 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.908407 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 01:11:48.908689 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.908671 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-kkjkp\"" Jun 10 01:11:48.908788 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.908772 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 01:11:48.918320 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:48.918288 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j"] Jun 10 01:11:49.002269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.002243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6pp\" (UniqueName: \"kubernetes.io/projected/aeba33ad-36e6-43f9-87db-e0e69bedac9d-kube-api-access-gj6pp\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.002412 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.002287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aeba33ad-36e6-43f9-87db-e0e69bedac9d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.102818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.102788 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6pp\" (UniqueName: \"kubernetes.io/projected/aeba33ad-36e6-43f9-87db-e0e69bedac9d-kube-api-access-gj6pp\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.102943 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.102831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aeba33ad-36e6-43f9-87db-e0e69bedac9d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.105537 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.105517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/aeba33ad-36e6-43f9-87db-e0e69bedac9d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.114586 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.114564 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6pp\" (UniqueName: \"kubernetes.io/projected/aeba33ad-36e6-43f9-87db-e0e69bedac9d-kube-api-access-gj6pp\") pod \"servicemesh-operator3-57f65f65fb-g6k7j\" (UID: \"aeba33ad-36e6-43f9-87db-e0e69bedac9d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.215023 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.214963 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:49.375277 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.375254 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j"] Jun 10 01:11:49.377691 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:11:49.377655 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeba33ad_36e6_43f9_87db_e0e69bedac9d.slice/crio-534a71b949ee006dd65f9342b9168952991f06f0ad1441c361378fa0410edf2c WatchSource:0}: Error finding container 534a71b949ee006dd65f9342b9168952991f06f0ad1441c361378fa0410edf2c: Status 404 returned error can't find the container with id 534a71b949ee006dd65f9342b9168952991f06f0ad1441c361378fa0410edf2c Jun 10 01:11:49.690942 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:49.690907 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" event={"ID":"aeba33ad-36e6-43f9-87db-e0e69bedac9d","Type":"ContainerStarted","Data":"534a71b949ee006dd65f9342b9168952991f06f0ad1441c361378fa0410edf2c"} Jun 10 01:11:51.668119 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:51.668091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:11:51.668607 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:51.668535 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:11:53.708918 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:53.708886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" event={"ID":"aeba33ad-36e6-43f9-87db-e0e69bedac9d","Type":"ContainerStarted","Data":"7a84005104451cc593221f8231e28c4a47c380079926d9b4dc44722afefb67af"} Jun 10 01:11:53.709387 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:53.709025 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:11:53.736886 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:11:53.736832 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" podStartSLOduration=2.297747935 podStartE2EDuration="5.736814266s" totalImagesPullingTime="3.439066331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:53.73459047 +0000 UTC m=+602.422736111" watchObservedRunningTime="2026-06-10 01:11:53.736814266 +0000 UTC m=+602.424959896" Jun 10 01:12:04.707239 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.707159 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-nlr4j"] Jun 10 01:12:04.727271 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.727242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-nlr4j"] Jun 10 01:12:04.727415 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.727344 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-g6k7j" Jun 10 01:12:04.727543 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.727525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.730404 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.730386 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 01:12:04.730542 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.730457 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lfr5s\"" Jun 10 01:12:04.814386 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.814354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-redirect-config\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.814558 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.814435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxst\" (UniqueName: \"kubernetes.io/projected/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-kube-api-access-6fxst\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.914727 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.914693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxst\" (UniqueName: \"kubernetes.io/projected/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-kube-api-access-6fxst\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.914876 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.914744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-redirect-config\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.915490 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.915464 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-redirect-config\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:04.923201 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:04.923176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxst\" (UniqueName: \"kubernetes.io/projected/963d4511-d6c6-4c7d-ae1b-d3951e67f63c-kube-api-access-6fxst\") pod \"dashboard-redirect-c8c9c9665-nlr4j\" (UID: \"963d4511-d6c6-4c7d-ae1b-d3951e67f63c\") " pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:05.038966 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:05.038895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" Jun 10 01:12:05.179899 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:05.179864 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-nlr4j"] Jun 10 01:12:05.183145 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:12:05.183120 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963d4511_d6c6_4c7d_ae1b_d3951e67f63c.slice/crio-e843581cb50da86496f5fd8341506a78909fb885e59c4886db68c035b28ec81e WatchSource:0}: Error finding container e843581cb50da86496f5fd8341506a78909fb885e59c4886db68c035b28ec81e: Status 404 returned error can't find the container with id e843581cb50da86496f5fd8341506a78909fb885e59c4886db68c035b28ec81e Jun 10 01:12:05.757271 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:05.757234 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" event={"ID":"963d4511-d6c6-4c7d-ae1b-d3951e67f63c","Type":"ContainerStarted","Data":"e843581cb50da86496f5fd8341506a78909fb885e59c4886db68c035b28ec81e"} Jun 10 01:12:10.778400 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:10.778356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" event={"ID":"963d4511-d6c6-4c7d-ae1b-d3951e67f63c","Type":"ContainerStarted","Data":"dd47f9e5e79f7f827af0671552e2a16befc103dc56cbe3e9022c047f7860a197"} Jun 10 01:12:10.793458 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:10.793404 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-c8c9c9665-nlr4j" podStartSLOduration=2.169362551 podStartE2EDuration="6.793383194s" totalImagesPullingTime="4.624020643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:10.792892179 +0000 UTC m=+619.481037807" watchObservedRunningTime="2026-06-10 01:12:10.793383194 +0000 UTC m=+619.481528818" Jun 10 01:12:15.675029 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:15.674991 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pfff6" Jun 10 01:12:15.678142 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:15.678125 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bm7s7" Jun 10 01:12:19.066874 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.066842 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl"] Jun 10 01:12:19.072757 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.072733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.074928 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.074897 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 01:12:19.075097 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.074979 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 01:12:19.075168 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.075143 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 01:12:19.075530 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.075253 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gb4gv\"" Jun 10 01:12:19.075530 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.075294 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 01:12:19.087003 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.086980 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl"] Jun 10 01:12:19.121016 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.120994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121125 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121125 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hzw\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-kube-api-access-w6hzw\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121223 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121223 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121223 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.121406 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.121227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe4841c-f92c-47be-b6de-47b32194f57a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222298 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe4841c-f92c-47be-b6de-47b32194f57a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222440 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222334 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222440 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222440 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hzw\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-kube-api-access-w6hzw\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222632 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222632 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222499 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.222632 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.223019 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.222997 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.225083 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.225055 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe4841c-f92c-47be-b6de-47b32194f57a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.225178 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.225115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.225239 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.225220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.225451 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.225433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/afe4841c-f92c-47be-b6de-47b32194f57a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.229710 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.229687 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.230103 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.230083 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hzw\" (UniqueName: \"kubernetes.io/projected/afe4841c-f92c-47be-b6de-47b32194f57a-kube-api-access-w6hzw\") pod \"istiod-openshift-gateway-75c67f8887-khzbl\" (UID: \"afe4841c-f92c-47be-b6de-47b32194f57a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.381906 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.381819 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:19.513895 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.513862 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl"] Jun 10 01:12:19.516354 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:12:19.516303 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe4841c_f92c_47be_b6de_47b32194f57a.slice/crio-1e8e0d80961b48437e4759add819afd9c7db3eaf41b6600af90d633219f8a93b WatchSource:0}: Error finding container 1e8e0d80961b48437e4759add819afd9c7db3eaf41b6600af90d633219f8a93b: Status 404 returned error can't find the container with id 1e8e0d80961b48437e4759add819afd9c7db3eaf41b6600af90d633219f8a93b Jun 10 01:12:19.816445 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:19.816409 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" event={"ID":"afe4841c-f92c-47be-b6de-47b32194f57a","Type":"ContainerStarted","Data":"1e8e0d80961b48437e4759add819afd9c7db3eaf41b6600af90d633219f8a93b"} Jun 10 01:12:22.482383 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:22.482338 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 01:12:22.482629 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:22.482427 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jun 10 01:12:22.831563 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:22.831528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" event={"ID":"afe4841c-f92c-47be-b6de-47b32194f57a","Type":"ContainerStarted","Data":"e8b958d9b9e754b5e893c0548cb152368f1c7f730538c0b05ba09a0403df9ac1"} Jun 10 01:12:22.831734 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:22.831654 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:12:22.852245 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:22.852192 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" podStartSLOduration=0.888448694 podStartE2EDuration="3.852171929s" totalImagesPullingTime="2.963723235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:22.849673539 +0000 UTC m=+631.537819186" watchObservedRunningTime="2026-06-10 01:12:22.852171929 +0000 UTC m=+631.540317555" Jun 10 01:12:23.837554 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:23.837510 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-khzbl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 01:12:23.837924 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:23.837582 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" podUID="afe4841c-f92c-47be-b6de-47b32194f57a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:12:26.837679 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:12:26.837653 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-khzbl" Jun 10 01:13:10.821134 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.821101 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz"] Jun 10 01:13:10.824395 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.824379 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:10.826684 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.826659 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 01:13:10.826810 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.826765 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:13:10.827507 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.827484 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jhtgq\"" Jun 10 01:13:10.827616 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.827484 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:13:10.835195 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.835173 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz"] Jun 10 01:13:10.890962 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.890931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrv7\" (UniqueName: \"kubernetes.io/projected/0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa-kube-api-access-mmrv7\") pod \"dns-operator-controller-manager-864dd78c4c-qc7fz\" (UID: \"0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:10.991323 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:10.991281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrv7\" (UniqueName: \"kubernetes.io/projected/0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa-kube-api-access-mmrv7\") pod \"dns-operator-controller-manager-864dd78c4c-qc7fz\" (UID: \"0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:11.002555 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:11.002532 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrv7\" (UniqueName: \"kubernetes.io/projected/0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa-kube-api-access-mmrv7\") pod \"dns-operator-controller-manager-864dd78c4c-qc7fz\" (UID: \"0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:11.134618 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:11.134561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:11.262630 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:11.262600 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz"] Jun 10 01:13:11.266011 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:13:11.265982 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2d2fbf_4b8b_4b76_b7ef_21f6ba836baa.slice/crio-c2b171c48796486eeac3ff72899801a38c718f04f052d2a31d18c6fa5710182c WatchSource:0}: Error finding container c2b171c48796486eeac3ff72899801a38c718f04f052d2a31d18c6fa5710182c: Status 404 returned error can't find the container with id c2b171c48796486eeac3ff72899801a38c718f04f052d2a31d18c6fa5710182c Jun 10 01:13:11.268053 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:11.268035 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:13:12.037008 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:12.036969 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" event={"ID":"0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa","Type":"ContainerStarted","Data":"c2b171c48796486eeac3ff72899801a38c718f04f052d2a31d18c6fa5710182c"} Jun 10 01:13:13.420126 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.420089 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr"] Jun 10 01:13:13.424124 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.424101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:13.426718 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.426699 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qtbhh\"" Jun 10 01:13:13.436118 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.436092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr"] Jun 10 01:13:13.508187 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.508161 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbhw\" (UniqueName: \"kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw\") pod \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" (UID: \"926566a7-bfc5-4401-b7f5-2b1ca86d523c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:13.609186 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.609155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbhw\" (UniqueName: \"kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw\") pod \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" (UID: \"926566a7-bfc5-4401-b7f5-2b1ca86d523c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:13.617084 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.617064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbhw\" (UniqueName: \"kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw\") pod \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" (UID: \"926566a7-bfc5-4401-b7f5-2b1ca86d523c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:13.737670 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.737606 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:13.863784 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:13.863761 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr"] Jun 10 01:13:13.866158 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:13:13.866123 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926566a7_bfc5_4401_b7f5_2b1ca86d523c.slice/crio-3c1889b9525d828c4046e6bf02cb93e96272cba8eaec68b8047315de11a45ec1 WatchSource:0}: Error finding container 3c1889b9525d828c4046e6bf02cb93e96272cba8eaec68b8047315de11a45ec1: Status 404 returned error can't find the container with id 3c1889b9525d828c4046e6bf02cb93e96272cba8eaec68b8047315de11a45ec1 Jun 10 01:13:14.047416 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:14.047339 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" event={"ID":"0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa","Type":"ContainerStarted","Data":"7976d46a15465c532165838890616414890198505173021f7f9df214e839747a"} Jun 10 01:13:14.047546 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:14.047518 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:14.048590 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:14.048567 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" event={"ID":"926566a7-bfc5-4401-b7f5-2b1ca86d523c","Type":"ContainerStarted","Data":"3c1889b9525d828c4046e6bf02cb93e96272cba8eaec68b8047315de11a45ec1"} Jun 10 01:13:17.067355 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:17.067326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" event={"ID":"926566a7-bfc5-4401-b7f5-2b1ca86d523c","Type":"ContainerStarted","Data":"10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe"} Jun 10 01:13:17.067750 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:17.067425 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:17.083416 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:17.083372 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" podStartSLOduration=1.17355084 podStartE2EDuration="4.083356811s" totalImagesPullingTime="2.909805971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:17.082007517 +0000 UTC m=+685.770153143" watchObservedRunningTime="2026-06-10 01:13:17.083356811 +0000 UTC m=+685.771502436" Jun 10 01:13:17.084094 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:17.084052 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" podStartSLOduration=4.842494163 podStartE2EDuration="7.084041865s" totalImagesPullingTime="2.241547702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:14.062608276 +0000 UTC m=+682.750753902" watchObservedRunningTime="2026-06-10 01:13:17.084041865 +0000 UTC m=+685.772187553" Jun 10 01:13:25.058728 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:25.058696 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qc7fz" Jun 10 01:13:27.855410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.855379 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr"] Jun 10 01:13:27.855821 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.855597 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" containerName="manager" containerID="cri-o://10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe" gracePeriod=2 Jun 10 01:13:27.857717 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.857692 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:27.868999 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.868976 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr"] Jun 10 01:13:27.878506 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:27.878473 2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"926566a7-bfc5-4401-b7f5-2b1ca86d523c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-dxfkr\": pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:27.880322 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:27.880282 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" is forbidden: User \"system:node:ip-10-0-142-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-67.ec2.internal' and this object" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:27.882783 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.882758 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk"] Jun 10 01:13:27.883103 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.883086 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" containerName="manager" Jun 10 01:13:27.883175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.883105 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" containerName="manager" Jun 10 01:13:27.883227 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.883208 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" containerName="manager" Jun 10 01:13:27.886101 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.886083 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:27.888138 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:27.888110 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" is forbidden: User \"system:node:ip-10-0-142-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-67.ec2.internal' and this object" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:27.897080 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.897054 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk"] Jun 10 01:13:27.904175 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:27.904152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxx4g\" (UniqueName: \"kubernetes.io/projected/5488b00a-42d3-4d5f-a8c1-a02469513845-kube-api-access-vxx4g\") pod \"limitador-operator-controller-manager-859d7b78bd-zs9vk\" (UID: \"5488b00a-42d3-4d5f-a8c1-a02469513845\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:28.005661 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.005621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxx4g\" (UniqueName: \"kubernetes.io/projected/5488b00a-42d3-4d5f-a8c1-a02469513845-kube-api-access-vxx4g\") pod \"limitador-operator-controller-manager-859d7b78bd-zs9vk\" (UID: \"5488b00a-42d3-4d5f-a8c1-a02469513845\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:28.013775 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.013751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxx4g\" (UniqueName: \"kubernetes.io/projected/5488b00a-42d3-4d5f-a8c1-a02469513845-kube-api-access-vxx4g\") pod \"limitador-operator-controller-manager-859d7b78bd-zs9vk\" (UID: \"5488b00a-42d3-4d5f-a8c1-a02469513845\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:28.119263 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.119199 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:28.120353 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.120328 2568 generic.go:356] "Generic (PLEG): container finished" podID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" containerID="10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe" exitCode=0 Jun 10 01:13:28.120353 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.120353 2568 scope.go:117] "RemoveContainer" containerID="10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe" Jun 10 01:13:28.121249 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:28.121202 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" is forbidden: User \"system:node:ip-10-0-142-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-67.ec2.internal' and this object" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:28.129124 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.129105 2568 scope.go:117] "RemoveContainer" containerID="10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe" Jun 10 01:13:28.129411 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:28.129387 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe\": container with ID starting with 10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe not found: ID does not exist" containerID="10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe" Jun 10 01:13:28.129477 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.129423 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe"} err="failed to get container status \"10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe\": rpc error: code = NotFound desc = could not find container \"10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe\": container with ID starting with 10b0bcd3e5ad6c440b3839930a0c66778545410b0bb054476833cf45776caebe not found: ID does not exist" Jun 10 01:13:28.209742 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.209721 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhbhw\" (UniqueName: \"kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw\") pod \"926566a7-bfc5-4401-b7f5-2b1ca86d523c\" (UID: \"926566a7-bfc5-4401-b7f5-2b1ca86d523c\") " Jun 10 01:13:28.211921 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.211898 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw" (OuterVolumeSpecName: "kube-api-access-zhbhw") pod "926566a7-bfc5-4401-b7f5-2b1ca86d523c" (UID: "926566a7-bfc5-4401-b7f5-2b1ca86d523c"). InnerVolumeSpecName "kube-api-access-zhbhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:28.243046 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.243024 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:28.311039 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.311012 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhbhw\" (UniqueName: \"kubernetes.io/projected/926566a7-bfc5-4401-b7f5-2b1ca86d523c-kube-api-access-zhbhw\") on node \"ip-10-0-142-67.ec2.internal\" DevicePath \"\"" Jun 10 01:13:28.376978 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:28.376954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk"] Jun 10 01:13:28.379371 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:13:28.379346 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5488b00a_42d3_4d5f_a8c1_a02469513845.slice/crio-b4bbb76d9c8b37f0adcca2a7c9d83aecbb54cadef35c4d74a6203f6a81c222ca WatchSource:0}: Error finding container b4bbb76d9c8b37f0adcca2a7c9d83aecbb54cadef35c4d74a6203f6a81c222ca: Status 404 returned error can't find the container with id b4bbb76d9c8b37f0adcca2a7c9d83aecbb54cadef35c4d74a6203f6a81c222ca Jun 10 01:13:29.126231 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.126187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" event={"ID":"5488b00a-42d3-4d5f-a8c1-a02469513845","Type":"ContainerStarted","Data":"b1bc23dd19b6c0f4e0d3c708ebe9ba2a2e6d10702635c7216d14dfe491aa517d"} Jun 10 01:13:29.126668 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.126253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" event={"ID":"5488b00a-42d3-4d5f-a8c1-a02469513845","Type":"ContainerStarted","Data":"b4bbb76d9c8b37f0adcca2a7c9d83aecbb54cadef35c4d74a6203f6a81c222ca"} Jun 10 01:13:29.126668 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.126285 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:13:29.127234 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.127213 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:29.144347 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.144287 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" podStartSLOduration=2.144272652 podStartE2EDuration="2.144272652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:29.143501587 +0000 UTC m=+697.831647213" watchObservedRunningTime="2026-06-10 01:13:29.144272652 +0000 UTC m=+697.832418276" Jun 10 01:13:29.145630 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:29.145605 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" is forbidden: User \"system:node:ip-10-0-142-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-67.ec2.internal' and this object" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:29.147658 ip-10-0-142-67 kubenswrapper[2568]: E0610 01:13:29.147631 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dxfkr\" is forbidden: User \"system:node:ip-10-0-142-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-67.ec2.internal' and this object" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxfkr" Jun 10 01:13:29.690081 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:29.690052 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="926566a7-bfc5-4401-b7f5-2b1ca86d523c" path="/var/lib/kubelet/pods/926566a7-bfc5-4401-b7f5-2b1ca86d523c/volumes" Jun 10 01:13:40.133794 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:13:40.133707 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zs9vk" Jun 10 01:14:19.818408 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.818374 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:14:19.821570 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.821548 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.823813 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.823792 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 01:14:19.823911 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.823889 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wpg6d\"" Jun 10 01:14:19.830947 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.830922 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:14:19.854029 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.854003 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:14:19.873820 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.873796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd2n\" (UniqueName: \"kubernetes.io/projected/417cc025-1874-4ccb-9560-40e6c9aee771-kube-api-access-fwd2n\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.873902 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.873835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/417cc025-1874-4ccb-9560-40e6c9aee771-config-file\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.974294 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.974269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd2n\" (UniqueName: \"kubernetes.io/projected/417cc025-1874-4ccb-9560-40e6c9aee771-kube-api-access-fwd2n\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.974411 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.974339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/417cc025-1874-4ccb-9560-40e6c9aee771-config-file\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.974947 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.974929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/417cc025-1874-4ccb-9560-40e6c9aee771-config-file\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:19.981453 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:19.981435 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd2n\" (UniqueName: \"kubernetes.io/projected/417cc025-1874-4ccb-9560-40e6c9aee771-kube-api-access-fwd2n\") pod \"limitador-limitador-54d6d988d5-krkxv\" (UID: \"417cc025-1874-4ccb-9560-40e6c9aee771\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:20.132561 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:20.132502 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:20.261301 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:20.261278 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:14:20.263503 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:14:20.263468 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417cc025_1874_4ccb_9560_40e6c9aee771.slice/crio-3631d3c783a8240b473901ddbcb95d8f10b2571dd2183d39d4d55732ea772505 WatchSource:0}: Error finding container 3631d3c783a8240b473901ddbcb95d8f10b2571dd2183d39d4d55732ea772505: Status 404 returned error can't find the container with id 3631d3c783a8240b473901ddbcb95d8f10b2571dd2183d39d4d55732ea772505 Jun 10 01:14:20.345466 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:20.345438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" event={"ID":"417cc025-1874-4ccb-9560-40e6c9aee771","Type":"ContainerStarted","Data":"3631d3c783a8240b473901ddbcb95d8f10b2571dd2183d39d4d55732ea772505"} Jun 10 01:14:23.360237 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:23.360200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" event={"ID":"417cc025-1874-4ccb-9560-40e6c9aee771","Type":"ContainerStarted","Data":"5f671e388a0db2c7a340851410e758f12a543abb9fa5110253c60efc28ff3cda"} Jun 10 01:14:23.360663 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:23.360325 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:14:23.376826 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:23.376780 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" podStartSLOduration=1.834508574 podStartE2EDuration="4.376766933s" totalImagesPullingTime="2.542258359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:23.37453641 +0000 UTC m=+752.062682065" watchObservedRunningTime="2026-06-10 01:14:23.376766933 +0000 UTC m=+752.064912558" Jun 10 01:14:34.365621 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:14:34.365593 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-krkxv" Jun 10 01:16:24.453674 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:16:24.453638 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:16:51.693075 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:16:51.693043 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:16:51.695586 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:16:51.695565 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:17:26.551733 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:26.551698 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:17:33.630824 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:33.630786 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:17:39.049251 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.049221 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr"] Jun 10 01:17:39.052539 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.052521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.054964 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.054939 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 01:17:39.056116 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.055883 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 01:17:39.056116 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.055961 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m7fhg\"" Jun 10 01:17:39.056116 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.056045 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 01:17:39.061626 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.061603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr"] Jun 10 01:17:39.085264 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.085398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.085398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2h28\" (UniqueName: \"kubernetes.io/projected/70194a78-aa38-4609-aa02-bdf6636847aa-kube-api-access-x2h28\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.085475 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.085475 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.085539 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.085508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70194a78-aa38-4609-aa02-bdf6636847aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186736 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186699 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186736 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186981 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2h28\" (UniqueName: \"kubernetes.io/projected/70194a78-aa38-4609-aa02-bdf6636847aa-kube-api-access-x2h28\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186981 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186981 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186823 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.186981 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.186859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70194a78-aa38-4609-aa02-bdf6636847aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.187178 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.187153 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.187217 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.187166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.187217 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.187205 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.189341 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.189302 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70194a78-aa38-4609-aa02-bdf6636847aa-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.189607 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.189590 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70194a78-aa38-4609-aa02-bdf6636847aa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.194174 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.194151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2h28\" (UniqueName: \"kubernetes.io/projected/70194a78-aa38-4609-aa02-bdf6636847aa-kube-api-access-x2h28\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr\" (UID: \"70194a78-aa38-4609-aa02-bdf6636847aa\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.364054 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.364009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:17:39.493381 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.493252 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr"] Jun 10 01:17:39.495990 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:17:39.495958 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70194a78_aa38_4609_aa02_bdf6636847aa.slice/crio-7df6f5c04448b65362f44fc6138c366d464bb0eff2c5536bffcdbcc65e972a67 WatchSource:0}: Error finding container 7df6f5c04448b65362f44fc6138c366d464bb0eff2c5536bffcdbcc65e972a67: Status 404 returned error can't find the container with id 7df6f5c04448b65362f44fc6138c366d464bb0eff2c5536bffcdbcc65e972a67 Jun 10 01:17:39.626782 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:39.626699 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:17:40.237715 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:40.237680 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" event={"ID":"70194a78-aa38-4609-aa02-bdf6636847aa","Type":"ContainerStarted","Data":"7df6f5c04448b65362f44fc6138c366d464bb0eff2c5536bffcdbcc65e972a67"} Jun 10 01:17:43.252587 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:43.252501 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" event={"ID":"70194a78-aa38-4609-aa02-bdf6636847aa","Type":"ContainerStarted","Data":"a620925e7c1e7b8a75ce42b364cd688b9ee791adca7a8e4cb896ed220e3aec0c"} Jun 10 01:17:57.330513 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:17:57.330476 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:18:00.565819 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.565777 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc"] Jun 10 01:18:00.588628 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.588598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc"] Jun 10 01:18:00.588856 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.588700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.590870 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.590849 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 01:18:00.664087 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.664227 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.664227 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwzpk\" (UniqueName: \"kubernetes.io/projected/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kube-api-access-kwzpk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.664391 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2cb8-2aa9-4499-8c15-290004a2a809-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.664391 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.664391 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.664361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.764989 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.764953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwzpk\" (UniqueName: \"kubernetes.io/projected/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kube-api-access-kwzpk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2cb8-2aa9-4499-8c15-290004a2a809-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765123 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765115 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765580 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765557 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765681 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765605 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.765681 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.765627 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.767537 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.767518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cfb2cb8-2aa9-4499-8c15-290004a2a809-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.767678 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.767660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2cb8-2aa9-4499-8c15-290004a2a809-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.772508 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.772485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwzpk\" (UniqueName: \"kubernetes.io/projected/5cfb2cb8-2aa9-4499-8c15-290004a2a809-kube-api-access-kwzpk\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc\" (UID: \"5cfb2cb8-2aa9-4499-8c15-290004a2a809\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:00.899176 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:00.899105 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:01.030658 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:01.030630 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc"] Jun 10 01:18:01.033134 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:18:01.033101 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfb2cb8_2aa9_4499_8c15_290004a2a809.slice/crio-8674ad4c7a19bda593fd510cca97bbb39f34ec17136308162635f0b1cd40cdfd WatchSource:0}: Error finding container 8674ad4c7a19bda593fd510cca97bbb39f34ec17136308162635f0b1cd40cdfd: Status 404 returned error can't find the container with id 8674ad4c7a19bda593fd510cca97bbb39f34ec17136308162635f0b1cd40cdfd Jun 10 01:18:01.332577 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:01.332545 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:18:01.336735 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:01.336707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" event={"ID":"5cfb2cb8-2aa9-4499-8c15-290004a2a809","Type":"ContainerStarted","Data":"cca01b306835d39ca5640ddcc03fcbd0703df14cee9dced74e44362df8c93f59"} Jun 10 01:18:01.336850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:01.336763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" event={"ID":"5cfb2cb8-2aa9-4499-8c15-290004a2a809","Type":"ContainerStarted","Data":"8674ad4c7a19bda593fd510cca97bbb39f34ec17136308162635f0b1cd40cdfd"} Jun 10 01:18:05.959669 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:05.959596 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45"] Jun 10 01:18:05.964506 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:05.964480 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:05.966619 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:05.966595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 01:18:05.972793 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:05.972771 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45"] Jun 10 01:18:06.106701 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.106844 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba11ef28-f70c-483a-8ef4-94120e84fc92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.106844 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpzw\" (UniqueName: \"kubernetes.io/projected/ba11ef28-f70c-483a-8ef4-94120e84fc92-kube-api-access-fxpzw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.106844 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.106960 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.106960 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.106918 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.207996 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.207965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.207998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba11ef28-f70c-483a-8ef4-94120e84fc92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpzw\" (UniqueName: \"kubernetes.io/projected/ba11ef28-f70c-483a-8ef4-94120e84fc92-kube-api-access-fxpzw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208139 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208446 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208577 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208552 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.208636 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.208578 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.210487 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.210443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba11ef28-f70c-483a-8ef4-94120e84fc92-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.210741 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.210721 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba11ef28-f70c-483a-8ef4-94120e84fc92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.215185 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.215162 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpzw\" (UniqueName: \"kubernetes.io/projected/ba11ef28-f70c-483a-8ef4-94120e84fc92-kube-api-access-fxpzw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jnw45\" (UID: \"ba11ef28-f70c-483a-8ef4-94120e84fc92\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.275197 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.275163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:06.412782 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.412759 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45"] Jun 10 01:18:06.415125 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:18:06.415102 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba11ef28_f70c_483a_8ef4_94120e84fc92.slice/crio-d3c6d7e340a7a632958d9210c9fef133c3b5417932c89b1c734897d31068749f WatchSource:0}: Error finding container d3c6d7e340a7a632958d9210c9fef133c3b5417932c89b1c734897d31068749f: Status 404 returned error can't find the container with id d3c6d7e340a7a632958d9210c9fef133c3b5417932c89b1c734897d31068749f Jun 10 01:18:06.743837 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:06.743760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:18:07.367899 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:07.367870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" event={"ID":"ba11ef28-f70c-483a-8ef4-94120e84fc92","Type":"ContainerStarted","Data":"8ac43d79b8d0305b299118cf41285d1fef6999617335c2a8bf83cba3122669a5"} Jun 10 01:18:07.368342 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:07.367918 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" event={"ID":"ba11ef28-f70c-483a-8ef4-94120e84fc92","Type":"ContainerStarted","Data":"d3c6d7e340a7a632958d9210c9fef133c3b5417932c89b1c734897d31068749f"} Jun 10 01:18:07.369277 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:07.369249 2568 generic.go:356] "Generic (PLEG): container finished" podID="5cfb2cb8-2aa9-4499-8c15-290004a2a809" containerID="cca01b306835d39ca5640ddcc03fcbd0703df14cee9dced74e44362df8c93f59" exitCode=0 Jun 10 01:18:07.369369 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:07.369299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" event={"ID":"5cfb2cb8-2aa9-4499-8c15-290004a2a809","Type":"ContainerDied","Data":"cca01b306835d39ca5640ddcc03fcbd0703df14cee9dced74e44362df8c93f59"} Jun 10 01:18:08.376680 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:08.376641 2568 generic.go:356] "Generic (PLEG): container finished" podID="ba11ef28-f70c-483a-8ef4-94120e84fc92" containerID="8ac43d79b8d0305b299118cf41285d1fef6999617335c2a8bf83cba3122669a5" exitCode=0 Jun 10 01:18:08.377018 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:08.376721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" event={"ID":"ba11ef28-f70c-483a-8ef4-94120e84fc92","Type":"ContainerDied","Data":"8ac43d79b8d0305b299118cf41285d1fef6999617335c2a8bf83cba3122669a5"} Jun 10 01:18:09.383769 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:09.383737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" event={"ID":"5cfb2cb8-2aa9-4499-8c15-290004a2a809","Type":"ContainerStarted","Data":"768aedacd16860292e284b5af805e77184be88313efc72d68789f792229ccc37"} Jun 10 01:18:09.385292 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:09.385269 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" event={"ID":"ba11ef28-f70c-483a-8ef4-94120e84fc92","Type":"ContainerStarted","Data":"3e95d8616af6cf33ede486c61aefde0469d56d9c89e578604ab828db596c00b5"} Jun 10 01:18:09.405526 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:09.405479 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" podStartSLOduration=2.418885632 podStartE2EDuration="9.405460389s" totalImagesPullingTime="1.036165301s" totalInitContainerRuntime="5.950409456s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:09.403984947 +0000 UTC m=+978.092130572" watchObservedRunningTime="2026-06-10 01:18:09.405460389 +0000 UTC m=+978.093606015" Jun 10 01:18:09.422630 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:09.422591 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" podStartSLOduration=2.584448235 podStartE2EDuration="4.422577603s" totalImagesPullingTime="213.063282ms" totalInitContainerRuntime="1.625066086s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:09.420748378 +0000 UTC m=+978.108894028" watchObservedRunningTime="2026-06-10 01:18:09.422577603 +0000 UTC m=+978.110723227" Jun 10 01:18:10.899842 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:10.899810 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:10.900240 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:10.899860 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:10.912289 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:10.912264 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:11.406748 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:11.406715 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc" Jun 10 01:18:16.275657 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:16.275614 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:16.275657 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:16.275669 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:16.288065 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:16.288037 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:18:16.429075 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:18:16.429042 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jnw45" Jun 10 01:19:25.744269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:25.744238 2568 generic.go:356] "Generic (PLEG): container finished" podID="70194a78-aa38-4609-aa02-bdf6636847aa" containerID="a620925e7c1e7b8a75ce42b364cd688b9ee791adca7a8e4cb896ed220e3aec0c" exitCode=0 Jun 10 01:19:25.744646 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:25.744330 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" event={"ID":"70194a78-aa38-4609-aa02-bdf6636847aa","Type":"ContainerDied","Data":"a620925e7c1e7b8a75ce42b364cd688b9ee791adca7a8e4cb896ed220e3aec0c"} Jun 10 01:19:25.744916 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:25.744901 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:19:26.750849 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:26.750815 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" event={"ID":"70194a78-aa38-4609-aa02-bdf6636847aa","Type":"ContainerStarted","Data":"3780f1017b1fb48f66eb9d764cb39430ba465375f56cc9755b36ada04d932250"} Jun 10 01:19:26.773634 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:26.773589 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" podStartSLOduration=1.6482164940000001 podStartE2EDuration="1m47.773573908s" totalImagesPullingTime="3.618461015s" totalInitContainerRuntime="1m42.506896399s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:26.771240974 +0000 UTC m=+1055.459386599" watchObservedRunningTime="2026-06-10 01:19:26.773573908 +0000 UTC m=+1055.461719580" Jun 10 01:19:29.364553 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:29.364516 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:19:29.364925 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:29.364605 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:19:29.377092 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:29.377068 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:19:29.774092 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:29.774026 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr" Jun 10 01:19:39.834543 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:39.834469 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:19:49.928810 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:49.928776 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:19:59.131839 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:19:59.131808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:20:09.128580 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:20:09.128534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:20:18.429296 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:20:18.429264 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:20:28.523202 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:20:28.523167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:01.034518 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:01.034479 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:04.333721 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:04.333640 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:09.838125 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:09.838095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:12.440547 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:12.440515 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:41.034441 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:41.034408 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:21:51.719327 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:51.719277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:21:51.722919 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:51.722892 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:21:57.222924 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:21:57.222882 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:22:35.233281 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:22:35.233199 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:22:52.428756 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:22:52.428721 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:23:06.632150 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:23:06.632114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:23:22.531576 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:23:22.531540 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:24:00.523270 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:24:00.523234 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:24:03.530567 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:24:03.530482 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:24:25.734874 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:24:25.734838 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:24:35.224920 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:24:35.224883 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:24:51.436745 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:24:51.436709 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:25:00.232640 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:25:00.232601 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:25:17.232079 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:25:17.232041 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:25:25.632912 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:25:25.632880 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:25:58.130789 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:25:58.130706 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:07.131850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:07.131808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:15.433269 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:15.433233 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:23.330960 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:23.330921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:31.724801 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:31.724770 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:40.035260 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:40.035222 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:42.828490 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:42.828455 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:48.828501 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:48.828464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:26:51.745513 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:51.745482 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:26:51.751553 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:51.751533 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:26:59.826675 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:26:59.826641 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:27:37.430816 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:27:37.430781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:27:39.430863 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:27:39.430828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:27:47.726454 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:27:47.726416 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:27:51.524917 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:27:51.524880 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:27:59.026076 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:27:59.026035 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:06.728433 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:06.728378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:16.728078 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:16.728045 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:24.630410 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:24.630372 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:33.631740 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:33.631666 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:37.725597 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:37.725566 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:42.233048 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:42.233014 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:28:51.534478 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:28:51.534448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:00.129292 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:00.129253 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:09.523536 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:09.523497 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:17.928872 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:17.928836 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:27.128041 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:27.128009 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:34.530019 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:34.529980 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:43.834318 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:43.834282 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:29:51.232837 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:29:51.232801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:30:01.426354 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:30:01.426294 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:30:09.224787 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:30:09.224705 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:31:51.771973 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:31:51.771940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:31:51.777903 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:31:51.777884 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:32:29.224590 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:32:29.224557 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:32:32.729443 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:32:32.729403 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:32:57.524472 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:32:57.524439 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:02.226605 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:02.226569 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:11.636152 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:11.636110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:22.530821 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:22.530782 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:30.830098 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:30.830063 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:41.625876 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:41.625837 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:33:50.439656 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:33:50.439617 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:34:01.226546 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:34:01.226507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:34:10.732097 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:34:10.732058 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:34:20.227763 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:34:20.227726 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:34:29.431002 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:34:29.430964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:34:33.226779 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:34:33.226690 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:35:02.429887 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:35:02.429854 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:35:45.026757 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:35:45.026727 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:35:52.927923 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:35:52.927893 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:02.325193 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:02.325164 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:11.421770 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:11.421737 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:19.435726 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:19.435688 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:30.324424 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:30.324387 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:38.837194 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:38.837157 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:44.636627 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:44.636596 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:36:51.797939 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:51.797907 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:36:51.805065 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:51.805047 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:36:53.027670 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:36:53.027639 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:00.824091 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:00.824049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:09.930778 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:09.930736 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:20.133190 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:20.133150 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:38.735380 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:38.735287 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:47.033148 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:47.033112 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:37:55.033711 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:37:55.033679 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:03.226095 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:03.226052 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:20.631821 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:20.631782 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:29.629412 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:29.629372 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:38.028488 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:38.028453 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:46.630661 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:46.630624 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:38:55.527882 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:38:55.527846 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:03.938852 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:03.938773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:14.034571 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:14.034533 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:25.329088 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:25.329057 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:36.377417 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:36.377381 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:48.432192 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:48.432153 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:39:57.331666 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:39:57.331635 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:03.231856 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:03.231824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:13.229738 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:13.229700 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:19.624827 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:19.624786 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:36.133373 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:36.133259 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:45.126898 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:45.126865 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:53.828286 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:53.828248 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:40:59.628543 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:40:59.628511 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:41:23.226655 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:41:23.226620 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:41:36.723608 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:41:36.723568 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krkxv"] Jun 10 01:41:51.824588 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:41:51.824534 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:41:51.832619 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:41:51.832596 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:42:14.149864 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.149836 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c9c9665-nlr4j_963d4511-d6c6-4c7d-ae1b-d3951e67f63c/nginx/0.log" Jun 10 01:42:14.374860 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.374832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bm7s7_4203e659-e0d5-40d6-a783-68521aaaca11/manager/0.log" Jun 10 01:42:14.496187 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.496097 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pfff6_788b0c28-ac1f-42d5-8ca5-99f682b14372/manager/0.log" Jun 10 01:42:14.714855 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.714828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6x97b_28146625-c2f6-4375-8e49-3df6be6a74d6/server/0.log" Jun 10 01:42:14.839356 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.839335 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-gsxtm_47e0e359-8512-4468-b0e5-1c801b529098/manager/0.log" Jun 10 01:42:14.948033 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.948008 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-49q6k_8452d81e-ef89-4c06-ad60-846bda3ff61c/copy-manifests/0.log" Jun 10 01:42:14.954713 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:14.954688 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-49q6k_8452d81e-ef89-4c06-ad60-846bda3ff61c/manager/0.log" Jun 10 01:42:16.642397 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:16.642367 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qc7fz_0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa/manager/0.log" Jun 10 01:42:17.095817 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:17.095792 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-krkxv_417cc025-1874-4ccb-9560-40e6c9aee771/limitador/0.log" Jun 10 01:42:17.215700 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:17.215671 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zs9vk_5488b00a-42d3-4d5f-a8c1-a02469513845/manager/0.log" Jun 10 01:42:17.670481 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:17.670447 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-khzbl_afe4841c-f92c-47be-b6de-47b32194f57a/discovery/0.log" Jun 10 01:42:17.895273 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:17.895242 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-rqmgt_884640d0-7beb-4756-8375-8eb63f8cf88a/kube-auth-proxy/0.log" Jun 10 01:42:18.911021 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:18.910994 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr_70194a78-aa38-4609-aa02-bdf6636847aa/main/0.log" Jun 10 01:42:18.917213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:18.917193 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-b48xr_70194a78-aa38-4609-aa02-bdf6636847aa/storage-initializer/0.log" Jun 10 01:42:19.143288 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:19.143252 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc_5cfb2cb8-2aa9-4499-8c15-290004a2a809/storage-initializer/0.log" Jun 10 01:42:19.150268 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:19.150222 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mzfzc_5cfb2cb8-2aa9-4499-8c15-290004a2a809/main/0.log" Jun 10 01:42:19.258676 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:19.258606 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jnw45_ba11ef28-f70c-483a-8ef4-94120e84fc92/storage-initializer/0.log" Jun 10 01:42:19.265630 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:19.265605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jnw45_ba11ef28-f70c-483a-8ef4-94120e84fc92/main/0.log" Jun 10 01:42:26.666593 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:26.666562 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hr9wq_e6c05fb1-8afc-4b5d-9bdf-31367bbb4fb2/global-pull-secret-syncer/0.log" Jun 10 01:42:26.791922 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:26.791894 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gv2h2_339c9df8-4b90-4c3e-a5b8-a2c68954896c/konnectivity-agent/0.log" Jun 10 01:42:26.891610 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:26.891585 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-67.ec2.internal_2daa11601870c184cfcbf1281d3c8d4d/haproxy/0.log" Jun 10 01:42:30.868479 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:30.868418 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-g6k7j_aeba33ad-36e6-43f9-87db-e0e69bedac9d/sail-operator/0.log" Jun 10 01:42:32.208714 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:32.208684 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qc7fz_0d2d2fbf-4b8b-4b76-b7ef-21f6ba836baa/manager/0.log" Jun 10 01:42:32.349067 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:32.349014 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-krkxv_417cc025-1874-4ccb-9560-40e6c9aee771/limitador/0.log" Jun 10 01:42:32.448883 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:32.448852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zs9vk_5488b00a-42d3-4d5f-a8c1-a02469513845/manager/0.log" Jun 10 01:42:34.325235 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:34.325204 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kfhxw_25984b69-184d-46ae-8de5-ba02dd6ebee8/monitoring-plugin/0.log" Jun 10 01:42:34.357982 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:34.357933 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/node-exporter/0.log" Jun 10 01:42:34.376463 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:34.376443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/kube-rbac-proxy/0.log" Jun 10 01:42:34.396935 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:34.396918 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8h94m_d21e8ec7-b175-4e9a-934e-5b9c167b7e65/init-textfile/0.log" Jun 10 01:42:38.023971 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.023914 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-88f4x_48ec5b35-bd6a-43f9-bbc6-7ba58920c08a/download-server/0.log" Jun 10 01:42:38.975044 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.975010 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct"] Jun 10 01:42:38.978398 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.978376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:38.981114 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.981083 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"openshift-service-ca.crt\"" Jun 10 01:42:38.981215 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.981147 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kdsff\"/\"default-dockercfg-zj2n9\"" Jun 10 01:42:38.981934 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.981920 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"kube-root-ca.crt\"" Jun 10 01:42:38.989360 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:38.989337 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct"] Jun 10 01:42:39.089505 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.089479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-podres\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.089818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.089514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-lib-modules\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.089818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.089532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrckl\" (UniqueName: \"kubernetes.io/projected/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-kube-api-access-mrckl\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.089818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.089552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-sys\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.089818 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.089593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-proc\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190722 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-podres\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-lib-modules\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190750 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrckl\" (UniqueName: \"kubernetes.io/projected/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-kube-api-access-mrckl\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-sys\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190822 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-sys\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-proc\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.190850 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190847 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-podres\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.191190 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-proc\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.191190 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.190871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-lib-modules\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.198216 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.198185 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrckl\" (UniqueName: \"kubernetes.io/projected/e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3-kube-api-access-mrckl\") pod \"perf-node-gather-daemonset-62rct\" (UID: \"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.288770 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.288675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:39.419948 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:39.419926 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct"] Jun 10 01:42:39.421684 ip-10-0-142-67 kubenswrapper[2568]: W0610 01:42:39.421657 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode244a68c_ffe2_42e2_bc6c_f67ce2f5c1f3.slice/crio-98ae9b7674a7746b99a5b40237c41ea9628439cd440f502494ebee35f53b6e8e WatchSource:0}: Error finding container 98ae9b7674a7746b99a5b40237c41ea9628439cd440f502494ebee35f53b6e8e: Status 404 returned error can't find the container with id 98ae9b7674a7746b99a5b40237c41ea9628439cd440f502494ebee35f53b6e8e Jun 10 01:42:40.048353 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.048293 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jrrjw_5a684fa9-c13a-400c-984f-a035a7fbd8ef/dns/0.log" Jun 10 01:42:40.068918 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.068876 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jrrjw_5a684fa9-c13a-400c-984f-a035a7fbd8ef/kube-rbac-proxy/0.log" Jun 10 01:42:40.122617 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.122592 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sgkpn_0ef5b667-cdc3-40b0-a6a2-e39bd06d4718/dns-node-resolver/0.log" Jun 10 01:42:40.148454 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.148425 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" event={"ID":"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3","Type":"ContainerStarted","Data":"acb8b6b12516dc2a49967b1763fd5e1e6a99baa640c3677d313b6fe5506b09ff"} Jun 10 01:42:40.148551 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.148472 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" event={"ID":"e244a68c-ffe2-42e2-bc6c-f67ce2f5c1f3","Type":"ContainerStarted","Data":"98ae9b7674a7746b99a5b40237c41ea9628439cd440f502494ebee35f53b6e8e"} Jun 10 01:42:40.148551 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.148503 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:40.162665 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.162618 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" podStartSLOduration=2.162600577 podStartE2EDuration="2.162600577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:42:40.16146278 +0000 UTC m=+2448.849608405" watchObservedRunningTime="2026-06-10 01:42:40.162600577 +0000 UTC m=+2448.850746203" Jun 10 01:42:40.730402 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:40.730374 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9d8rm_2a0a4d48-7d0c-4b61-b8a4-2b68c30d1751/node-ca/0.log" Jun 10 01:42:41.848855 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:41.848823 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-khzbl_afe4841c-f92c-47be-b6de-47b32194f57a/discovery/0.log" Jun 10 01:42:41.926242 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:41.926207 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-rqmgt_884640d0-7beb-4756-8375-8eb63f8cf88a/kube-auth-proxy/0.log" Jun 10 01:42:42.783055 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:42.783028 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qhrxg_8fa17a04-7e68-44da-b233-e1f7ec0391bd/serve-healthcheck-canary/0.log" Jun 10 01:42:43.441400 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:43.441368 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rw6jw_723f969f-ed87-4dc5-9e96-333146a65ae8/kube-rbac-proxy/0.log" Jun 10 01:42:43.461931 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:43.461907 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rw6jw_723f969f-ed87-4dc5-9e96-333146a65ae8/exporter/0.log" Jun 10 01:42:43.483078 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:43.483053 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rw6jw_723f969f-ed87-4dc5-9e96-333146a65ae8/extractor/0.log" Jun 10 01:42:45.654469 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:45.654430 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c9c9665-nlr4j_963d4511-d6c6-4c7d-ae1b-d3951e67f63c/nginx/0.log" Jun 10 01:42:45.710030 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:45.710006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bm7s7_4203e659-e0d5-40d6-a783-68521aaaca11/manager/0.log" Jun 10 01:42:45.860892 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:45.860862 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pfff6_788b0c28-ac1f-42d5-8ca5-99f682b14372/manager/0.log" Jun 10 01:42:45.961215 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:45.961130 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-6x97b_28146625-c2f6-4375-8e49-3df6be6a74d6/server/0.log" Jun 10 01:42:46.035213 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:46.035180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-gsxtm_47e0e359-8512-4468-b0e5-1c801b529098/manager/0.log" Jun 10 01:42:46.063514 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:46.063493 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-49q6k_8452d81e-ef89-4c06-ad60-846bda3ff61c/manager/0.log" Jun 10 01:42:46.083163 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:46.083142 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-49q6k_8452d81e-ef89-4c06-ad60-846bda3ff61c/copy-manifests/0.log" Jun 10 01:42:46.165146 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:46.165124 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-62rct" Jun 10 01:42:47.888241 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:47.888172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-znsjb_8bbbedbd-d820-4bc1-a794-9091050d1ca0/openshift-lws-operator/0.log" Jun 10 01:42:52.479024 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:52.478992 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-khzbl_afe4841c-f92c-47be-b6de-47b32194f57a/discovery/0.log" Jun 10 01:42:52.508204 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:52.508180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-rqmgt_884640d0-7beb-4756-8375-8eb63f8cf88a/kube-auth-proxy/0.log" Jun 10 01:42:53.883085 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:53.883057 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-khzbl_afe4841c-f92c-47be-b6de-47b32194f57a/discovery/0.log" Jun 10 01:42:53.906792 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:53.906768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-rqmgt_884640d0-7beb-4756-8375-8eb63f8cf88a/kube-auth-proxy/0.log" Jun 10 01:42:54.954528 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:54.954500 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8g9qj_e91ed3e2-7d70-48b6-a44a-cd2cf3a10621/kube-multus/0.log" Jun 10 01:42:55.148674 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.148597 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/kube-multus-additional-cni-plugins/0.log" Jun 10 01:42:55.170434 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.170414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/egress-router-binary-copy/0.log" Jun 10 01:42:55.190955 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.190931 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/cni-plugins/0.log" Jun 10 01:42:55.212192 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.212173 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/bond-cni-plugin/0.log" Jun 10 01:42:55.232463 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.232448 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/routeoverride-cni/0.log" Jun 10 01:42:55.253148 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.253117 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/whereabouts-cni-bincopy/0.log" Jun 10 01:42:55.274591 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.274569 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tqt9_f76ae8f6-9394-4008-b82f-28e1b4728a12/whereabouts-cni/0.log" Jun 10 01:42:55.571063 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.571025 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r64zg_d1614a90-8db4-4e23-b855-546cb80ba0da/network-metrics-daemon/0.log" Jun 10 01:42:55.589486 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.589464 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r64zg_d1614a90-8db4-4e23-b855-546cb80ba0da/kube-rbac-proxy/0.log" Jun 10 01:42:55.760483 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.760451 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-khzbl_afe4841c-f92c-47be-b6de-47b32194f57a/discovery/0.log" Jun 10 01:42:55.785746 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:55.785718 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-845757977d-rqmgt_884640d0-7beb-4756-8375-8eb63f8cf88a/kube-auth-proxy/0.log" Jun 10 01:42:56.629518 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.629487 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-controller/0.log" Jun 10 01:42:56.648009 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.647981 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/0.log" Jun 10 01:42:56.648228 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.648216 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovn-acl-logging/1.log" Jun 10 01:42:56.673422 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.673388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/kube-rbac-proxy-node/0.log" Jun 10 01:42:56.699404 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.699373 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 01:42:56.716992 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.716967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/northd/0.log" Jun 10 01:42:56.741012 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.740987 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/nbdb/0.log" Jun 10 01:42:56.764482 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.764455 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/sbdb/0.log" Jun 10 01:42:56.835218 ip-10-0-142-67 kubenswrapper[2568]: I0610 01:42:56.835196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tzsb_e2c2a1ff-923e-4c85-96e0-ebafce404d59/ovnkube-controller/0.log"