Jun 09 09:49:53.536466 ip-10-0-138-235 systemd[1]: Starting Kubernetes Kubelet... Jun 09 09:49:53.965939 ip-10-0-138-235 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:49:53.965939 ip-10-0-138-235 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 09:49:53.965939 ip-10-0-138-235 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:49:53.965939 ip-10-0-138-235 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 09:49:53.965939 ip-10-0-138-235 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 09:49:53.966927 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.966838 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 09:49:53.971893 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971878 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.971893 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971893 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971897 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971901 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971904 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971908 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971912 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971915 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971919 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971922 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971925 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971928 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971937 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971940 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971943 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971946 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971949 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971952 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971955 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971957 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971960 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.971963 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971963 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971965 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971968 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971971 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971974 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971977 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971979 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971982 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971985 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971987 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971990 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971992 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971994 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.971997 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972000 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972002 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972005 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972007 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972010 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972013 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.972461 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972015 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972018 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972020 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972023 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972026 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972029 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972031 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972034 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972036 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972039 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972041 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972044 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972046 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972049 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972052 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972055 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972057 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972060 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972063 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972079 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.972940 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972082 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972085 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972087 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972090 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972092 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972095 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972098 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972101 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972104 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972106 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972109 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972112 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972115 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972118 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972121 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972124 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972126 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972129 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972132 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972135 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.973436 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972137 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972140 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972142 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972145 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972149 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972153 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972157 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972162 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972168 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972171 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972174 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972176 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972179 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972182 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972185 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972188 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972191 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972924 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.973911 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972931 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972935 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972937 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972940 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972943 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972946 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972949 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972952 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972954 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972957 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972960 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972963 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972966 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972969 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972972 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972974 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972977 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972979 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972982 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972985 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.974377 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972987 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972990 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972994 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.972998 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973000 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973003 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973006 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973009 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973012 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973014 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973017 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973019 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973022 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973024 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973027 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973029 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973032 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973034 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973037 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973039 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.974872 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973042 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973044 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973047 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973049 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973053 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973056 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973059 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973062 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973064 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973083 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973086 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973090 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973093 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973095 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973098 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973100 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973103 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973106 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973109 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973112 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.975394 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973114 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973117 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973120 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973122 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973125 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973127 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973130 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973133 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973135 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973138 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973141 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973143 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973146 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973148 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973151 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973155 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973157 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973160 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973165 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973169 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.975894 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973172 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973175 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973177 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973180 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973183 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973185 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973188 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973190 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973195 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973197 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973200 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973203 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973206 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973209 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973212 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973215 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973217 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973220 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973594 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973598 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.976389 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973601 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973603 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973606 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973609 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973611 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973614 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973617 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973620 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973624 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973627 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973630 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973633 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973636 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973638 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973641 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973644 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973646 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973649 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973651 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973654 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.976912 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973657 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973660 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973662 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973665 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973667 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973670 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973673 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973675 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973678 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973680 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973685 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973688 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973692 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973694 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973697 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973700 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973702 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973705 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973709 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.977426 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973711 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973714 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973717 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973720 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973723 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973725 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973728 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973730 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973733 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973735 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973738 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973741 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973744 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973746 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973749 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973751 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973754 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973756 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973758 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973762 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.977919 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973764 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973767 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973770 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973772 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973775 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973777 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973780 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973782 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973785 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973787 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973790 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973793 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973796 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973798 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973806 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973808 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973811 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973814 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973816 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973819 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.978411 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973821 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973824 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973828 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973831 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973834 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973837 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973841 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973843 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973846 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973849 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973852 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973855 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973857 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973860 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973862 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973865 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973868 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.973870 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973943 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973960 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 09:49:53.978898 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973965 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973970 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973974 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973977 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973981 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973986 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973990 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973994 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.973997 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974001 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974004 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974007 2561 flags.go:64] FLAG: --cgroup-root="" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974010 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974013 2561 flags.go:64] FLAG: --client-ca-file="" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974016 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974019 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974024 2561 flags.go:64] FLAG: --cluster-domain="" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974027 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974030 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974033 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974036 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974040 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974043 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974046 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 09:49:53.979523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974049 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974052 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974055 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974058 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974061 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974064 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974082 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974085 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974088 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974091 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974096 2561 flags.go:64] FLAG: --enable-server="true" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974099 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974103 2561 flags.go:64] FLAG: --event-burst="100" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974106 2561 flags.go:64] FLAG: --event-qps="50" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974110 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974114 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974117 2561 flags.go:64] FLAG: --eviction-hard="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974120 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974124 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974127 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974130 2561 flags.go:64] FLAG: --eviction-soft="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974133 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974135 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974138 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974141 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 09:49:53.980304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974144 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974147 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974150 2561 flags.go:64] FLAG: --feature-gates="" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974153 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974157 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974160 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974163 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974166 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974169 2561 flags.go:64] FLAG: --help="false" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974172 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-235.ec2.internal" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974175 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974178 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974181 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974184 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974187 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974190 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974193 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974197 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974200 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974203 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974206 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974210 2561 flags.go:64] FLAG: --kube-reserved="" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974213 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974216 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 09:49:53.981434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974219 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974221 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974225 2561 flags.go:64] FLAG: --lock-file="" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974227 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974230 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974233 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974239 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974242 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974244 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974247 2561 flags.go:64] FLAG: --logging-format="text" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974250 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974254 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974256 2561 flags.go:64] FLAG: --manifest-url="" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974259 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974263 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974266 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974270 2561 flags.go:64] FLAG: --max-pods="110" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974273 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974276 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974279 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974282 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974285 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974288 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974291 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974298 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 09:49:53.982417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974302 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974305 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974308 2561 flags.go:64] FLAG: --pod-cidr="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974311 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974316 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974320 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974323 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974326 2561 flags.go:64] FLAG: --port="10250" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974330 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974332 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070092bebc0949761" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974336 2561 flags.go:64] FLAG: --qos-reserved="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974339 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974342 2561 flags.go:64] FLAG: --register-node="true" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974345 2561 flags.go:64] FLAG: --register-with-taints="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974349 2561 flags.go:64] FLAG: --registry-burst="10" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974351 2561 flags.go:64] FLAG: --registry-qps="5" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974354 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974357 2561 flags.go:64] FLAG: --reserved-memory="" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974360 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974364 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974367 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974370 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974372 2561 flags.go:64] FLAG: --runonce="false" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974375 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974379 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 09:49:53.983251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974382 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974384 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974387 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974390 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974394 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974397 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974399 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974403 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974406 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974409 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974412 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974414 2561 flags.go:64] FLAG: --system-cgroups="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974418 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974423 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974426 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974429 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974433 2561 flags.go:64] FLAG: --tls-min-version="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974436 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974439 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974442 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974445 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974447 2561 flags.go:64] FLAG: --v="2" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974451 2561 flags.go:64] FLAG: --version="false" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974455 2561 flags.go:64] FLAG: --vmodule="" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974459 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 09:49:53.983874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974462 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974575 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974579 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974582 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974586 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974590 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974593 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974596 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974599 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974601 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974604 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974607 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974610 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974613 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974617 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974620 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974624 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974627 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974630 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.984506 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974633 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974636 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974639 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974642 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974645 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974648 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974651 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974654 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974657 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974660 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974663 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974666 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974668 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974671 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974673 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974676 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974678 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974681 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974683 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974686 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.984983 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974688 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974691 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974693 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974696 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974698 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974701 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974704 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974708 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974711 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974713 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974716 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974718 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974721 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974723 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974726 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974728 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974731 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974734 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974736 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.985487 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974739 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974742 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974744 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974747 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974749 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974752 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974754 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974757 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974759 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974761 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974764 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974766 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974769 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974771 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974774 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974776 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974779 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974781 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974784 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974787 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.985951 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974790 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974793 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974796 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974798 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974801 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974803 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974806 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974808 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974812 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974815 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974819 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974822 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974824 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974827 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974833 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974835 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974838 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974840 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974843 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974845 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.986460 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974848 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.974851 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.974856 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.983149 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.983164 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.984098 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.984106 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984165 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984171 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984176 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984179 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984182 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984185 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984190 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.986950 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984193 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984195 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984198 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984200 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984203 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984206 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984210 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984214 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984217 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984220 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984223 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984226 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984229 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984231 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984235 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984238 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984241 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984244 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984247 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.987434 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984249 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984253 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984258 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984261 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984264 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984266 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984269 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984272 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984274 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984277 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984280 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984282 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984285 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984287 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984290 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984293 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984295 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984297 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984300 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984305 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.987935 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984308 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984310 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984313 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984316 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984318 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984321 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984324 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984328 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984331 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984334 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984338 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984341 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984343 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984346 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984350 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984353 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984356 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984358 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984361 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984363 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.988433 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984366 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984368 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984371 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984373 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984376 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984378 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984381 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984383 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984386 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984389 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984392 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984394 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984397 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984401 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984404 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984407 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984409 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984412 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984415 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984417 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.988926 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984420 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984422 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984425 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984427 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984430 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984433 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984435 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984438 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984440 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984443 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984445 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984448 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.984453 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984567 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984573 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 09:49:53.989422 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984576 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984579 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984582 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984585 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984588 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984591 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984594 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984596 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984599 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984601 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984604 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984607 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984610 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984613 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984615 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984618 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984621 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984624 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984627 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 09:49:53.989794 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984631 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984634 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984636 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984639 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984642 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984645 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984647 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984650 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984652 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984655 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984657 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984660 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984662 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984665 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984667 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984670 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984672 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984675 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984677 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984680 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 09:49:53.990273 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984682 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984685 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984687 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984690 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984694 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984697 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984700 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984702 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984705 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984708 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984710 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984713 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984715 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984718 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984722 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984725 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984727 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984730 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984733 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984736 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 09:49:53.990756 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984738 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984741 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984743 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984746 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984749 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984751 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984755 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984758 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984760 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984764 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984767 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984769 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984772 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984774 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984777 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984779 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984783 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984787 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984789 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 09:49:53.991259 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984792 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984795 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984797 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984800 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984802 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984805 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984807 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984810 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984812 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984815 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984818 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984820 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984823 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984825 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984828 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984830 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984833 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984836 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 09:49:53.991714 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:53.984839 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.984844 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.984977 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.987878 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.989364 2561 server.go:1019] "Starting client certificate rotation" Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.989464 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.989533 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 09:49:53.992187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.992090 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:49:53.993506 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:53.993326 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 09:49:54.004017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.003991 2561 log.go:25] "Validated CRI v1 runtime API" Jun 09 09:49:54.007991 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.007975 2561 log.go:25] "Validated CRI v1 image API" Jun 09 09:49:54.008827 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.008807 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 09:49:54.011250 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.011224 2561 fs.go:135] Filesystem UUIDs: map[4ca45c42-fcb2-46db-97bb-eb8e8b312f22:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 929f50b5-33d4-485f-845b-797048431b7e:/dev/nvme0n1p3] Jun 09 09:49:54.011339 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.011250 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 09:49:54.014939 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.014920 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:49:54.017914 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.017661 2561 manager.go:216] Machine: {Timestamp:2026-06-09 09:49:54.016420791 +0000 UTC m=+0.354585176 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102580 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20390109608066da301b7818e09bea SystemUUID:ec203901-0960-8066-da30-1b7818e09bea BootID:804e5c2b-d579-4e45-a7a4-a252a7efcd4c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:38:3f:c0:09:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:38:3f:c0:09:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:c3:1b:34:bd:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 09:49:54.017914 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.017903 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 09:49:54.018103 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.018084 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 09:49:54.020050 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.020027 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 09:49:54.020237 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.020052 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 09:49:54.020982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.020969 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 09:49:54.021048 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.020988 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 09:49:54.021048 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.021000 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:49:54.021800 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.021784 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 09:49:54.022760 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.022748 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 09:49:54.026185 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026170 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:49:54.026329 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026318 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 09:49:54.026392 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026362 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 09 09:49:54.026392 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026386 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 09:49:54.026487 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026406 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 09:49:54.026487 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026420 2561 kubelet.go:398] "Adding apiserver pod source" Jun 09 09:49:54.026487 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026433 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 09:49:54.026975 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026959 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:49:54.027043 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.026983 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 09:49:54.031182 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.031162 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 09:49:54.031956 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.031931 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dfvnx" Jun 09 09:49:54.032734 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.032720 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 09:49:54.032791 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.032751 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 09:49:54.034166 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034143 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 09:49:54.034166 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034161 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 09:49:54.034166 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034167 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034173 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034182 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034192 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034200 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034206 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034212 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034217 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034225 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 09:49:54.034306 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.034231 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 09:49:54.035750 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.035733 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 09:49:54.035750 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.035748 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 09:49:54.035891 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.035867 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 09:49:54.035891 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.035868 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 09:49:54.038851 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.038834 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dfvnx" Jun 09 09:49:54.040423 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.040410 2561 server.go:1268] "Started kubelet" Jun 09 09:49:54.040528 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.040498 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 09:49:54.040625 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.040579 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 09:49:54.040674 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.040650 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 09:49:54.041574 ip-10-0-138-235 systemd[1]: Started Kubernetes Kubelet. Jun 09 09:49:54.042473 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.042424 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 09:49:54.042576 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.042556 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 09:49:54.043691 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.043669 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 09 09:49:54.047348 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.047333 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 09:49:54.047348 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.047342 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 09:49:54.047479 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.047412 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.047991 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.047973 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 09:49:54.048113 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048100 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 09:49:54.048171 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048118 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 09:49:54.048279 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048262 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 09 09:49:54.048279 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048278 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 09 09:49:54.048730 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048710 2561 factory.go:153] Registering CRI-O factory Jun 09 09:49:54.048834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048733 2561 factory.go:223] Registration of the crio container factory successfully Jun 09 09:49:54.048834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048794 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 09:49:54.048834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048803 2561 factory.go:55] Registering systemd factory Jun 09 09:49:54.048834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048810 2561 factory.go:223] Registration of the systemd container factory successfully Jun 09 09:49:54.048834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048830 2561 factory.go:103] Registering Raw factory Jun 09 09:49:54.049105 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.048843 2561 manager.go:1196] Started watching for new ooms in manager Jun 09 09:49:54.049105 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.048927 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 09:49:54.049721 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.049696 2561 manager.go:349] Starting recovery of all containers Jun 09 09:49:54.052448 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.052429 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:54.058843 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.058798 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-235.ec2.internal\" not found" node="ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.061292 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.061276 2561 manager.go:354] Recovery completed Jun 09 09:49:54.062537 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.062512 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 09:49:54.065434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.065423 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.067145 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067130 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.067217 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067157 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.067217 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067168 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.067648 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067631 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 09:49:54.067648 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067644 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.067750 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067644 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 09:49:54.067750 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.067715 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 09:49:54.068300 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.068285 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.068380 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.068315 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.068380 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.068329 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.069198 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.069187 2561 policy_none.go:49] "None policy: Start" Jun 09 09:49:54.069243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.069202 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 09:49:54.069243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.069212 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 09:49:54.070321 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.070311 2561 policy_none.go:47] "Start" Jun 09 09:49:54.108648 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.108622 2561 manager.go:337] "Starting Device Plugin manager" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.108697 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.108711 2561 server.go:87] "Starting device plugin registration server" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.108951 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.108961 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.109088 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.109166 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.109173 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.109669 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.109721 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.116840 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.117989 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.118022 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.118043 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.118097 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 09:49:54.122058 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.120110 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:54.209321 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.209290 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.210714 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.210694 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.210826 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.210724 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.210826 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.210735 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.210826 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.210759 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.218267 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.218201 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal"] Jun 09 09:49:54.218348 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.218281 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.219128 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.219111 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.219188 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.219136 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-235.ec2.internal\": node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.219803 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.219790 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.219862 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.219816 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.219862 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.219827 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.221251 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.221237 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.221373 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.221355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.221433 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.221400 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.221998 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.221973 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.222100 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.222004 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.222100 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.222019 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.222618 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.222603 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.222677 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.222635 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.222677 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.222649 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.223344 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.223329 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.223396 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.223359 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 09:49:54.224042 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.224027 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientMemory" Jun 09 09:49:54.224140 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.224056 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 09:49:54.224140 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.224087 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeHasSufficientPID" Jun 09 09:49:54.233679 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.233662 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.249639 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.249617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.249722 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.249648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.249722 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.249666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e8ac733885f854b6bb0b0e9b6af4d5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-235.ec2.internal\" (UID: \"7e8ac733885f854b6bb0b0e9b6af4d5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.249722 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.249711 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-235.ec2.internal\" not found" node="ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.254031 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.254016 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-235.ec2.internal\" not found" node="ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.333958 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.333934 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.350458 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.350555 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.350555 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e8ac733885f854b6bb0b0e9b6af4d5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-235.ec2.internal\" (UID: \"7e8ac733885f854b6bb0b0e9b6af4d5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.350555 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.350555 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd4006a884017f52d939307551865b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal\" (UID: \"4dd4006a884017f52d939307551865b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.350698 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.350556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e8ac733885f854b6bb0b0e9b6af4d5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-235.ec2.internal\" (UID: \"7e8ac733885f854b6bb0b0e9b6af4d5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.434616 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.434582 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.535455 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.535382 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.553830 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.553797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.558595 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.558580 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.636139 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.636107 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.736614 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.736575 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.837174 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:54.837107 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-235.ec2.internal\" not found" Jun 09 09:49:54.861189 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.861140 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:54.863159 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.863143 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:54.948303 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.948275 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.962217 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.962194 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:49:54.963295 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.963282 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" Jun 09 09:49:54.971319 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.971290 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 09:49:54.988435 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.988407 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 09:49:54.988565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.988541 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:49:54.988624 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.988542 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:49:54.988624 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.988541 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:49:54.988624 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:54.988571 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 09:49:55.026659 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.026638 2561 apiserver.go:52] "Watching apiserver" Jun 09 09:49:55.038276 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.038253 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 09:49:55.039518 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.039494 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tqpms","openshift-multus/multus-nzdkw","openshift-network-operator/iptables-alerter-n6wsn","openshift-ovn-kubernetes/ovnkube-node-mj987","kube-system/global-pull-secret-syncer-kj5qw","kube-system/konnectivity-agent-6c2f5","openshift-cluster-node-tuning-operator/tuned-q47pj","openshift-image-registry/node-ca-9p27q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal","openshift-multus/network-metrics-daemon-jpl6r","openshift-network-diagnostics/network-check-target-jz5mx","kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf","openshift-dns/node-resolver-hj5nf"] Jun 09 09:49:55.041783 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.041747 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd4006a884017f52d939307551865b7.slice/crio-b2b005c545a7fc6784f618fd6f60ebfdf00df1055e295c3626677cabaf9ca2d7 WatchSource:0}: Error finding container b2b005c545a7fc6784f618fd6f60ebfdf00df1055e295c3626677cabaf9ca2d7: Status 404 returned error can't find the container with id b2b005c545a7fc6784f618fd6f60ebfdf00df1055e295c3626677cabaf9ca2d7 Jun 09 09:49:55.042055 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.042035 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8ac733885f854b6bb0b0e9b6af4d5b.slice/crio-c018726563d012cc7ca54fef0b5b1db7e77948a42dd3274b1ff1dfd8f3e17523 WatchSource:0}: Error finding container c018726563d012cc7ca54fef0b5b1db7e77948a42dd3274b1ff1dfd8f3e17523: Status 404 returned error can't find the container with id c018726563d012cc7ca54fef0b5b1db7e77948a42dd3274b1ff1dfd8f3e17523 Jun 09 09:49:55.042144 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.042129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.043489 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.043467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.043701 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.043655 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 09:44:54 +0000 UTC" deadline="2027-12-20 19:31:24.229659751 +0000 UTC" Jun 09 09:49:55.043701 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.043700 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13425h41m29.185963902s" Jun 09 09:49:55.044020 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044000 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nrkmj\"" Jun 09 09:49:55.044128 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 09:49:55.044186 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044129 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 09:49:55.044186 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.044273 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 09:49:55.044304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.044884 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.044867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.045227 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.045207 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c8tj4\"" Jun 09 09:49:55.045591 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.045516 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 09:49:55.046199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.046181 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 09:49:55.046689 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.046670 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x59cc\"" Jun 09 09:49:55.046782 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.046712 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.046782 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.046765 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.047207 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.047150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.047441 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.047402 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 09:49:55.048056 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048041 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:49:55.048483 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048463 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.048569 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.048524 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:49:55.048755 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048736 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 09:49:55.048853 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048803 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gnskq\"" Jun 09 09:49:55.048935 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048882 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.048985 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.048985 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.048965 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 09:49:55.049243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.049200 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 09:49:55.049243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.049232 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 09:49:55.050950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.050939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.052469 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.052450 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kb9pv\"" Jun 09 09:49:55.052557 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.052470 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 09:49:55.052688 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.052675 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 09:49:55.053566 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.053551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.054890 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.054869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-bin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.054987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.054901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-hostroot\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.054987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.054923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-etc-kubernetes\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.054987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.054945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-systemd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.054987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.054965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-etc-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cnibin\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055036 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-slash\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-var-lib-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-config\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-dbus\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-netns\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-daemon-config\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovn-node-metrics-cert\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-script-lib\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-kubelet-config\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055351 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qc69w\"" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-os-release\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3795cf9-2602-4c95-943b-e5194c317bf0-iptables-alerter-script\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-bin\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjf5\" (UniqueName: \"kubernetes.io/projected/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-kube-api-access-jvjf5\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-socket-dir-parent\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-k8s-cni-cncf-io\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055578 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-kubelet\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-conf-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.055687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjl96\" (UniqueName: \"kubernetes.io/projected/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-kube-api-access-fjl96\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055743 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-system-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3795cf9-2602-4c95-943b-e5194c317bf0-host-slash\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-kubelet\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-systemd-units\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-netd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-env-overrides\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-multus\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-multus-certs\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.055979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg276\" (UniqueName: \"kubernetes.io/projected/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-kube-api-access-jg276\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-netns\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-ovn\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-node-log\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-log-socket\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.056447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cnibin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n788x\" (UniqueName: \"kubernetes.io/projected/c3795cf9-2602-4c95-943b-e5194c317bf0-kube-api-access-n788x\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-os-release\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cni-binary-copy\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056607 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.056830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.056874 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.057102 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.057167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.057117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 09:49:55.057582 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.057104 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.058208 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.058055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7vh2g\"" Jun 09 09:49:55.060978 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.060954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:55.061088 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.061025 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:49:55.063029 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.063012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.064421 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.064390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.064514 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.064489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 09:49:55.064514 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.064502 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.064628 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.064610 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.064813 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.064763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sqt8m\"" Jun 09 09:49:55.065950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.065932 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 09:49:55.066026 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.065982 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 09:49:55.066026 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.065942 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fq9w9\"" Jun 09 09:49:55.077205 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.077188 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zns5b" Jun 09 09:49:55.084165 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.084146 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zns5b" Jun 09 09:49:55.121768 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.121730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" event={"ID":"7e8ac733885f854b6bb0b0e9b6af4d5b","Type":"ContainerStarted","Data":"c018726563d012cc7ca54fef0b5b1db7e77948a42dd3274b1ff1dfd8f3e17523"} Jun 09 09:49:55.122801 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.122779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" event={"ID":"4dd4006a884017f52d939307551865b7","Type":"ContainerStarted","Data":"b2b005c545a7fc6784f618fd6f60ebfdf00df1055e295c3626677cabaf9ca2d7"} Jun 09 09:49:55.148844 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.148825 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 09:49:55.157314 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-conf-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjl96\" (UniqueName: \"kubernetes.io/projected/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-kube-api-access-fjl96\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-kubernetes\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-host\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76n8v\" (UniqueName: \"kubernetes.io/projected/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-kube-api-access-76n8v\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-system-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-conf-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-systemd-units\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-conf\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-system-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-systemd-units\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-sys\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-tmp\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-multus\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-netns\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-multus\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157735 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-netns\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-ovn\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-log-socket\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysconfig\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157851 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cnibin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-log-socket\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-ovn\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cnibin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n788x\" (UniqueName: \"kubernetes.io/projected/c3795cf9-2602-4c95-943b-e5194c317bf0-kube-api-access-n788x\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.157987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-cni-dir\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.157994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6457218-4f7e-453e-9a2f-7ef803c28adf-host\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158018 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-sys-fs\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab09d4b-c5e5-4718-b06c-b5625af33450-hosts-file\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-os-release\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158141 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-etc-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-etc-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-dbus\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-agent-certs\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-os-release\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-run\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-tuned\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.158690 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-dbus\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-var-lib-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-config\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-daemon-config\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-script-lib\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7bf\" (UniqueName: \"kubernetes.io/projected/a6457218-4f7e-453e-9a2f-7ef803c28adf-kube-api-access-gw7bf\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-var-lib-openvswitch\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls9kn\" (UniqueName: \"kubernetes.io/projected/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-kube-api-access-ls9kn\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-socket-dir-parent\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-kubelet\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3795cf9-2602-4c95-943b-e5194c317bf0-host-slash\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-kubelet\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-netd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.159468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-env-overrides\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-registration-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-systemd\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-config\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3795cf9-2602-4c95-943b-e5194c317bf0-host-slash\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159165 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-system-cni-dir\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-socket-dir-parent\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-multus-daemon-config\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-netd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-kubelet\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-kubelet\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.158830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-lib-modules\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-multus-certs\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg276\" (UniqueName: \"kubernetes.io/projected/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-kube-api-access-jg276\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159616 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-env-overrides\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-multus-certs\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-node-log\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159703 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-node-log\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovnkube-script-lib\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-socket-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6457218-4f7e-453e-9a2f-7ef803c28adf-serviceca\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq9df\" (UniqueName: \"kubernetes.io/projected/ca31dff7-0a7f-4183-be25-f9eca742a76d-kube-api-access-sq9df\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.159902 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-var-lib-kubelet\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.159942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cni-binary-copy\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.159977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:55.659940167 +0000 UTC m=+1.998104571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-bin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-hostroot\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-etc-kubernetes\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-var-lib-cni-bin\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.160952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-systemd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-run-systemd\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160156 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-etc-kubernetes\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-hostroot\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cnibin\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-cnibin\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-slash\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-netns\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-slash\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-cni-binary-copy\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovn-node-metrics-cert\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-kubelet-config\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-device-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsgc6\" (UniqueName: \"kubernetes.io/projected/8ab09d4b-c5e5-4718-b06c-b5625af33450-kube-api-access-xsgc6\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.160967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c79d695d-1c50-4615-92b6-fdeb47568249-kubelet-config\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.161737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-netns\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-os-release\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-os-release\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3795cf9-2602-4c95-943b-e5194c317bf0-iptables-alerter-script\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-bin\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161270 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab09d4b-c5e5-4718-b06c-b5625af33450-tmp-dir\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-konnectivity-ca\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-modprobe-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjf5\" (UniqueName: \"kubernetes.io/projected/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-kube-api-access-jvjf5\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-k8s-cni-cncf-io\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161553 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-host-run-k8s-cni-cncf-io\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-host-cni-bin\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.162490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.161617 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c3795cf9-2602-4c95-943b-e5194c317bf0-iptables-alerter-script\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.164427 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.164399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-ovn-node-metrics-cert\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.165371 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.165350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjl96\" (UniqueName: \"kubernetes.io/projected/d1f0e0af-3cdc-4d75-8172-1fe2050b36e6-kube-api-access-fjl96\") pod \"ovnkube-node-mj987\" (UID: \"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.167396 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.167374 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n788x\" (UniqueName: \"kubernetes.io/projected/c3795cf9-2602-4c95-943b-e5194c317bf0-kube-api-access-n788x\") pod \"iptables-alerter-n6wsn\" (UID: \"c3795cf9-2602-4c95-943b-e5194c317bf0\") " pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.170043 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.170023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg276\" (UniqueName: \"kubernetes.io/projected/ec50cd79-7166-4c81-afd5-b5ab3b06e1bf-kube-api-access-jg276\") pod \"multus-nzdkw\" (UID: \"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf\") " pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.170200 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.170109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjf5\" (UniqueName: \"kubernetes.io/projected/2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc-kube-api-access-jvjf5\") pod \"multus-additional-cni-plugins-tqpms\" (UID: \"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc\") " pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.262448 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262448 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-registration-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-systemd\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-lib-modules\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-registration-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-systemd\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-socket-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6457218-4f7e-453e-9a2f-7ef803c28adf-serviceca\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq9df\" (UniqueName: \"kubernetes.io/projected/ca31dff7-0a7f-4183-be25-f9eca742a76d-kube-api-access-sq9df\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.262682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-var-lib-kubelet\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-socket-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-lib-modules\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-device-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-var-lib-kubelet\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsgc6\" (UniqueName: \"kubernetes.io/projected/8ab09d4b-c5e5-4718-b06c-b5625af33450-kube-api-access-xsgc6\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.262812 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-device-dir\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.262870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:55.762848987 +0000 UTC m=+2.101013372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262875 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-etc-selinux\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab09d4b-c5e5-4718-b06c-b5625af33450-tmp-dir\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-konnectivity-ca\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.262976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-modprobe-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-kubernetes\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6457218-4f7e-453e-9a2f-7ef803c28adf-serviceca\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-modprobe-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-host\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76n8v\" (UniqueName: \"kubernetes.io/projected/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-kube-api-access-76n8v\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-conf\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-host\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-sys\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab09d4b-c5e5-4718-b06c-b5625af33450-tmp-dir\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-d\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-tmp\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-kubernetes\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysconfig\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-sys\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6457218-4f7e-453e-9a2f-7ef803c28adf-host\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-sys-fs\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysctl-conf\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab09d4b-c5e5-4718-b06c-b5625af33450-hosts-file\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.263942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6457218-4f7e-453e-9a2f-7ef803c28adf-host\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-sysconfig\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-agent-certs\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-run\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca31dff7-0a7f-4183-be25-f9eca742a76d-sys-fs\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab09d4b-c5e5-4718-b06c-b5625af33450-hosts-file\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-konnectivity-ca\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-tuned\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-run\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7bf\" (UniqueName: \"kubernetes.io/projected/a6457218-4f7e-453e-9a2f-7ef803c28adf-kube-api-access-gw7bf\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.264804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.263544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls9kn\" (UniqueName: \"kubernetes.io/projected/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-kube-api-access-ls9kn\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.265483 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.265463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-etc-tuned\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.265600 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.265581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4-agent-certs\") pod \"konnectivity-agent-6c2f5\" (UID: \"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4\") " pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.265653 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.265638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-tmp\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.268856 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.268836 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:49:55.268856 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.268854 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:49:55.269025 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.268863 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:55.269025 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.268940 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:49:55.768923879 +0000 UTC m=+2.107088252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:55.270193 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.270167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq9df\" (UniqueName: \"kubernetes.io/projected/ca31dff7-0a7f-4183-be25-f9eca742a76d-kube-api-access-sq9df\") pod \"aws-ebs-csi-driver-node-zl2zf\" (UID: \"ca31dff7-0a7f-4183-be25-f9eca742a76d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.270297 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.270204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsgc6\" (UniqueName: \"kubernetes.io/projected/8ab09d4b-c5e5-4718-b06c-b5625af33450-kube-api-access-xsgc6\") pod \"node-resolver-hj5nf\" (UID: \"8ab09d4b-c5e5-4718-b06c-b5625af33450\") " pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.270478 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.270463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76n8v\" (UniqueName: \"kubernetes.io/projected/d02ef55a-c3cc-450c-9cfe-8fffd84c052a-kube-api-access-76n8v\") pod \"tuned-q47pj\" (UID: \"d02ef55a-c3cc-450c-9cfe-8fffd84c052a\") " pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.270863 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.270834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls9kn\" (UniqueName: \"kubernetes.io/projected/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-kube-api-access-ls9kn\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.271045 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.271027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7bf\" (UniqueName: \"kubernetes.io/projected/a6457218-4f7e-453e-9a2f-7ef803c28adf-kube-api-access-gw7bf\") pod \"node-ca-9p27q\" (UID: \"a6457218-4f7e-453e-9a2f-7ef803c28adf\") " pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.353745 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.353662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqpms" Jun 09 09:49:55.362122 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.361899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzdkw" Jun 09 09:49:55.362237 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.362169 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd39a85_1bbe_4b4c_be90_4b63cf1cd8cc.slice/crio-372757aac5213c6d58ea79e85581177ca06403726b3806747dc482c23f775f05 WatchSource:0}: Error finding container 372757aac5213c6d58ea79e85581177ca06403726b3806747dc482c23f775f05: Status 404 returned error can't find the container with id 372757aac5213c6d58ea79e85581177ca06403726b3806747dc482c23f775f05 Jun 09 09:49:55.369444 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.369405 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec50cd79_7166_4c81_afd5_b5ab3b06e1bf.slice/crio-49388938aa5d0fe9cbd3180ec797c30b841646714ba636d1b05ef9c65facd03c WatchSource:0}: Error finding container 49388938aa5d0fe9cbd3180ec797c30b841646714ba636d1b05ef9c65facd03c: Status 404 returned error can't find the container with id 49388938aa5d0fe9cbd3180ec797c30b841646714ba636d1b05ef9c65facd03c Jun 09 09:49:55.370555 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.370481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n6wsn" Jun 09 09:49:55.373449 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.373430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:49:55.377249 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.377230 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3795cf9_2602_4c95_943b_e5194c317bf0.slice/crio-dbd908d5632b1f5c308610232c3df6bc0de2fec6980f78dd7bb68f061d986261 WatchSource:0}: Error finding container dbd908d5632b1f5c308610232c3df6bc0de2fec6980f78dd7bb68f061d986261: Status 404 returned error can't find the container with id dbd908d5632b1f5c308610232c3df6bc0de2fec6980f78dd7bb68f061d986261 Jun 09 09:49:55.378409 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.378324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:49:55.381881 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.381862 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f0e0af_3cdc_4d75_8172_1fe2050b36e6.slice/crio-8ca01d0073ae23bb8d94542ba225d0854a2352fde9a21d92bb419c5316ef7599 WatchSource:0}: Error finding container 8ca01d0073ae23bb8d94542ba225d0854a2352fde9a21d92bb419c5316ef7599: Status 404 returned error can't find the container with id 8ca01d0073ae23bb8d94542ba225d0854a2352fde9a21d92bb419c5316ef7599 Jun 09 09:49:55.383756 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.383729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q47pj" Jun 09 09:49:55.387109 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.387056 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e14c76b_8aa3_40dc_b2c2_d5ff5b6e0ba4.slice/crio-74dfbee35a6754e16f01bf3720156b82b0aeb7fbb29c3e42f54e47b3646d33f3 WatchSource:0}: Error finding container 74dfbee35a6754e16f01bf3720156b82b0aeb7fbb29c3e42f54e47b3646d33f3: Status 404 returned error can't find the container with id 74dfbee35a6754e16f01bf3720156b82b0aeb7fbb29c3e42f54e47b3646d33f3 Jun 09 09:49:55.388908 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.388670 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9p27q" Jun 09 09:49:55.392909 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.392355 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02ef55a_c3cc_450c_9cfe_8fffd84c052a.slice/crio-0f0e34890dcf4bece522a01ed4d618124887dbf622d868f189b5383de13dbb07 WatchSource:0}: Error finding container 0f0e34890dcf4bece522a01ed4d618124887dbf622d868f189b5383de13dbb07: Status 404 returned error can't find the container with id 0f0e34890dcf4bece522a01ed4d618124887dbf622d868f189b5383de13dbb07 Jun 09 09:49:55.394716 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.394695 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" Jun 09 09:49:55.400125 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.399207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hj5nf" Jun 09 09:49:55.400125 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.399606 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6457218_4f7e_453e_9a2f_7ef803c28adf.slice/crio-d244583719623d12f8a021fd0917878e5b075f32fe25dbe2244dd1f813d3cabe WatchSource:0}: Error finding container d244583719623d12f8a021fd0917878e5b075f32fe25dbe2244dd1f813d3cabe: Status 404 returned error can't find the container with id d244583719623d12f8a021fd0917878e5b075f32fe25dbe2244dd1f813d3cabe Jun 09 09:49:55.407043 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.407011 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca31dff7_0a7f_4183_be25_f9eca742a76d.slice/crio-bd207bc9bf879a9bf8f3d527bcd341d625c40dc4e5a05c3168a4ce34df8df613 WatchSource:0}: Error finding container bd207bc9bf879a9bf8f3d527bcd341d625c40dc4e5a05c3168a4ce34df8df613: Status 404 returned error can't find the container with id bd207bc9bf879a9bf8f3d527bcd341d625c40dc4e5a05c3168a4ce34df8df613 Jun 09 09:49:55.410395 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:49:55.409655 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab09d4b_c5e5_4718_b06c_b5625af33450.slice/crio-f6cc0fdcb9643eea8819c3d195ee8ba37eff0860bb584f3e27b2c5118addcb15 WatchSource:0}: Error finding container f6cc0fdcb9643eea8819c3d195ee8ba37eff0860bb584f3e27b2c5118addcb15: Status 404 returned error can't find the container with id f6cc0fdcb9643eea8819c3d195ee8ba37eff0860bb584f3e27b2c5118addcb15 Jun 09 09:49:55.666322 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.666201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:55.666480 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.666360 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:55.666480 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.666420 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:56.666400683 +0000 UTC m=+3.004565056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:55.766594 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.766560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:55.766768 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.766711 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:55.766830 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.766775 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:56.766755374 +0000 UTC m=+3.104919747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:55.867831 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:55.867798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:55.868007 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.867946 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:49:55.868007 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.867970 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:49:55.868007 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.867982 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:55.868200 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:55.868040 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:49:56.868019027 +0000 UTC m=+3.206183401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:56.086751 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.086667 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:44:55 +0000 UTC" deadline="2027-11-16 20:07:59.400031603 +0000 UTC" Jun 09 09:49:56.086751 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.086703 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12610h18m3.313332952s" Jun 09 09:49:56.143528 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.143412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hj5nf" event={"ID":"8ab09d4b-c5e5-4718-b06c-b5625af33450","Type":"ContainerStarted","Data":"f6cc0fdcb9643eea8819c3d195ee8ba37eff0860bb584f3e27b2c5118addcb15"} Jun 09 09:49:56.150405 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.150365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6wsn" event={"ID":"c3795cf9-2602-4c95-943b-e5194c317bf0","Type":"ContainerStarted","Data":"dbd908d5632b1f5c308610232c3df6bc0de2fec6980f78dd7bb68f061d986261"} Jun 09 09:49:56.184446 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.184405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzdkw" event={"ID":"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf","Type":"ContainerStarted","Data":"49388938aa5d0fe9cbd3180ec797c30b841646714ba636d1b05ef9c65facd03c"} Jun 09 09:49:56.189920 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.189865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerStarted","Data":"372757aac5213c6d58ea79e85581177ca06403726b3806747dc482c23f775f05"} Jun 09 09:49:56.194548 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.194520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" event={"ID":"ca31dff7-0a7f-4183-be25-f9eca742a76d","Type":"ContainerStarted","Data":"bd207bc9bf879a9bf8f3d527bcd341d625c40dc4e5a05c3168a4ce34df8df613"} Jun 09 09:49:56.204999 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.204948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9p27q" event={"ID":"a6457218-4f7e-453e-9a2f-7ef803c28adf","Type":"ContainerStarted","Data":"d244583719623d12f8a021fd0917878e5b075f32fe25dbe2244dd1f813d3cabe"} Jun 09 09:49:56.221764 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.221687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q47pj" event={"ID":"d02ef55a-c3cc-450c-9cfe-8fffd84c052a","Type":"ContainerStarted","Data":"0f0e34890dcf4bece522a01ed4d618124887dbf622d868f189b5383de13dbb07"} Jun 09 09:49:56.231790 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.231759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6c2f5" event={"ID":"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4","Type":"ContainerStarted","Data":"74dfbee35a6754e16f01bf3720156b82b0aeb7fbb29c3e42f54e47b3646d33f3"} Jun 09 09:49:56.242615 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.242577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"8ca01d0073ae23bb8d94542ba225d0854a2352fde9a21d92bb419c5316ef7599"} Jun 09 09:49:56.482838 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.482598 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:56.525939 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.525911 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:56.674686 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.674091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:56.674686 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.674249 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:56.674686 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.674309 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:58.674291211 +0000 UTC m=+5.012455588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:56.775020 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.774919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:56.775228 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.775109 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:56.775228 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.775176 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:49:58.775156532 +0000 UTC m=+5.113320924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:56.876249 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.875606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:56.876249 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.875801 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:49:56.876249 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.875824 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:49:56.876249 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.875836 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:56.876249 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:56.875894 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:49:58.875875662 +0000 UTC m=+5.214040058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:56.989590 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:56.989560 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:57.087838 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.087513 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:44:55 +0000 UTC" deadline="2028-02-17 10:28:28.172896692 +0000 UTC" Jun 09 09:49:57.087838 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.087573 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14832h38m31.085328364s" Jun 09 09:49:57.118364 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.118329 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:57.118529 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:57.118462 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:49:57.118883 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.118863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:57.119184 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:57.118966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:49:57.119184 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.119043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:57.119184 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:57.119140 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:49:57.578605 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:57.578315 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 09:49:58.693863 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:58.693813 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:58.694393 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.694016 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:58.694393 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.694094 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:02.694060746 +0000 UTC m=+9.032225133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:49:58.794785 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:58.794744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:58.794973 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.794907 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:58.795034 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.794988 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:02.794967494 +0000 UTC m=+9.133131880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:49:58.896136 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:58.895635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:58.896136 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.895830 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:49:58.896136 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.895850 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:49:58.896136 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.895863 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:58.896136 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:58.895960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:50:02.895941063 +0000 UTC m=+9.234105435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:49:59.118434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:59.118399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:49:59.118614 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:59.118537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:49:59.118614 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:59.118550 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:49:59.118745 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:59.118650 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:49:59.118745 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:49:59.118715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:49:59.118850 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:49:59.118787 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:01.119239 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:01.119193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:01.119681 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:01.119366 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:01.119833 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:01.119812 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:01.119964 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:01.119939 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:01.120095 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:01.120008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:01.120152 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:01.120092 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:02.729313 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:02.729273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:02.729770 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.729425 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:02.729770 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.729489 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:10.729470205 +0000 UTC m=+17.067634591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:02.830245 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:02.830204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:02.830432 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.830383 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:02.830486 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.830459 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:10.830437281 +0000 UTC m=+17.168601672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:02.931085 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:02.931031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:02.931256 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.931239 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:50:02.931325 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.931263 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:50:02.931325 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.931277 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:02.931424 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:02.931340 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:50:10.931321772 +0000 UTC m=+17.269486146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:03.118425 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:03.118370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:03.118620 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:03.118370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:03.118620 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:03.118499 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:03.118620 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:03.118598 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:03.118791 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:03.118370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:03.118791 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:03.118693 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:05.118347 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:05.118309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:05.118347 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:05.118351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:05.118794 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:05.118351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:05.118794 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:05.118430 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:05.118794 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:05.118526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:05.118794 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:05.118608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:07.119258 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:07.119065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:07.119258 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:07.119125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:07.119258 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:07.119083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:07.119258 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:07.119215 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:07.119969 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:07.119338 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:07.119969 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:07.119427 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:09.118981 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:09.118928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:09.118981 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:09.118956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:09.119492 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:09.119117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:09.119492 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:09.119125 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:09.119492 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:09.119235 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:09.119492 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:09.119337 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:10.788005 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:10.787968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:10.788461 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.788128 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:10.788461 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.788191 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:26.788175615 +0000 UTC m=+33.126339986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:10.888857 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:10.888832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:10.889042 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.889022 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:10.889135 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.889117 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:26.889095551 +0000 UTC m=+33.227259943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:10.989213 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:10.989172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:10.989371 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.989349 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:50:10.989371 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.989369 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:50:10.989499 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.989381 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:10.989499 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:10.989448 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:50:26.989428936 +0000 UTC m=+33.327593308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:11.118565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:11.118541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:11.118661 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:11.118627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:11.118661 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:11.118636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:11.118661 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:11.118634 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:11.118757 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:11.118720 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:11.118791 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:11.118781 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:13.118361 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:13.118325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:13.118796 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:13.118327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:13.118796 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:13.118453 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:13.118796 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:13.118333 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:13.118796 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:13.118572 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:13.118796 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:13.118617 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:15.118679 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:15.118647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:15.119118 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:15.118698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:15.119118 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:15.118647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:15.119118 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:15.118788 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:15.119118 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:15.118857 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:15.119118 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:15.118919 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:16.291806 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.291344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" event={"ID":"7e8ac733885f854b6bb0b0e9b6af4d5b","Type":"ContainerStarted","Data":"af96f1f65661abbbfa48c500438e4d4174c62ecba18c1ea0c4f3f31ec1c86dfb"} Jun 09 09:50:16.293047 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.293021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzdkw" event={"ID":"ec50cd79-7166-4c81-afd5-b5ab3b06e1bf","Type":"ContainerStarted","Data":"2fd018df8c849d77d260f359ecf1bac13fa50355fdae51abe5569fa0beadd42f"} Jun 09 09:50:16.294619 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.294596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q47pj" event={"ID":"d02ef55a-c3cc-450c-9cfe-8fffd84c052a","Type":"ContainerStarted","Data":"4f3587f3831467e0afcc7e6023958eea8d4660c126b6126c57bec4121456658e"} Jun 09 09:50:16.298943 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.298922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:50:16.299320 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299296 2561 generic.go:356] "Generic (PLEG): container finished" podID="d1f0e0af-3cdc-4d75-8172-1fe2050b36e6" containerID="6948d3e9028e6c4b3dcdd39e96588be31f8f409702a0a894a76f4363495e8aa5" exitCode=1 Jun 09 09:50:16.299379 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"2e407e73c942992dd61ac39d41803a980c7a4a61b638402e76feb4d333124d0f"} Jun 09 09:50:16.299422 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"e985c83d17153ba728e6011e1a995a53f7febb18a6adb02787518a6fc6ebbd9c"} Jun 09 09:50:16.299457 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"362af62578e27a3663a080179a3034fac3723f2820309165950c99a69cbbff86"} Jun 09 09:50:16.299495 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299489 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"673418e504fcb7af916d8cc1654c19e6c7cfda190dc4b0bcfc60816c6e581561"} Jun 09 09:50:16.299548 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerDied","Data":"6948d3e9028e6c4b3dcdd39e96588be31f8f409702a0a894a76f4363495e8aa5"} Jun 09 09:50:16.299600 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.299588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"9d6a6acf541e85c1846b63939b0b6ce9e7923ba8b23fd8a70ffcd3e18d777504"} Jun 09 09:50:16.306991 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.306932 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-235.ec2.internal" podStartSLOduration=22.306915877 podStartE2EDuration="22.306915877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:16.306505567 +0000 UTC m=+22.644669960" watchObservedRunningTime="2026-06-09 09:50:16.306915877 +0000 UTC m=+22.645080271" Jun 09 09:50:16.320866 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.320822 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q47pj" podStartSLOduration=2.392067124 podStartE2EDuration="22.320805691s" totalImagesPullingTime="19.928738567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:16.320390924 +0000 UTC m=+22.658555319" watchObservedRunningTime="2026-06-09 09:50:16.320805691 +0000 UTC m=+22.658970085" Jun 09 09:50:16.334534 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:16.334502 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nzdkw" podStartSLOduration=1.926067207 podStartE2EDuration="22.334493898s" totalImagesPullingTime="20.408426691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:16.334314731 +0000 UTC m=+22.672479135" watchObservedRunningTime="2026-06-09 09:50:16.334493898 +0000 UTC m=+22.672658290" Jun 09 09:50:17.118712 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.118676 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:17.118712 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.118713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:17.118949 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.118784 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:17.118949 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:17.118805 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:17.118949 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:17.118859 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:17.118949 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:17.118906 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:17.303119 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.303060 2561 generic.go:356] "Generic (PLEG): container finished" podID="4dd4006a884017f52d939307551865b7" containerID="de440dd073e6e664f65efddb82c7b26443b94c840770a77caddcace73d413262" exitCode=0 Jun 09 09:50:17.303619 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.303125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" event={"ID":"4dd4006a884017f52d939307551865b7","Type":"ContainerDied","Data":"de440dd073e6e664f65efddb82c7b26443b94c840770a77caddcace73d413262"} Jun 09 09:50:17.305014 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.304988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" event={"ID":"ca31dff7-0a7f-4183-be25-f9eca742a76d","Type":"ContainerStarted","Data":"6e8a0f97a4fbc1a55196c0f0ea435c2067e4420b2adde2e9dbf6488d362552f6"} Jun 09 09:50:17.306691 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.306664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9p27q" event={"ID":"a6457218-4f7e-453e-9a2f-7ef803c28adf","Type":"ContainerStarted","Data":"1b97ad7ec072f777a868a025af8b49945ee23481ccfb354d7d94801170d5d974"} Jun 09 09:50:17.308239 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.308217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6c2f5" event={"ID":"2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4","Type":"ContainerStarted","Data":"e304d61fd064068abd3a2fe66524ac2267847273abb445478358a5c30e5098a1"} Jun 09 09:50:17.309728 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.309708 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hj5nf" event={"ID":"8ab09d4b-c5e5-4718-b06c-b5625af33450","Type":"ContainerStarted","Data":"3c6b17605b2908653af9c439e9397cab0c42619e19cd29e065b57c95a8d848c9"} Jun 09 09:50:17.311435 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.311222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n6wsn" event={"ID":"c3795cf9-2602-4c95-943b-e5194c317bf0","Type":"ContainerStarted","Data":"aa3ee652eb181675c828b3f5fe76e1965d39c00949c165a49e17763f3172aabe"} Jun 09 09:50:17.312894 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.312869 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="a37f78e78291f2e894e315d6b69a9cb1daf59270e9b49ffbdbc6790f127f68a1" exitCode=0 Jun 09 09:50:17.313000 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.312949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"a37f78e78291f2e894e315d6b69a9cb1daf59270e9b49ffbdbc6790f127f68a1"} Jun 09 09:50:17.345197 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.345152 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n6wsn" podStartSLOduration=3.403506864 podStartE2EDuration="23.345133229s" totalImagesPullingTime="19.941626365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:17.344786158 +0000 UTC m=+23.682950596" watchObservedRunningTime="2026-06-09 09:50:17.345133229 +0000 UTC m=+23.683297624" Jun 09 09:50:17.356607 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.356535 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6c2f5" podStartSLOduration=3.428500269 podStartE2EDuration="23.356518668s" totalImagesPullingTime="19.928018399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:17.356410138 +0000 UTC m=+23.694574534" watchObservedRunningTime="2026-06-09 09:50:17.356518668 +0000 UTC m=+23.694683062" Jun 09 09:50:17.369480 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.369396 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9p27q" podStartSLOduration=3.468821302 podStartE2EDuration="23.369380285s" totalImagesPullingTime="19.900558983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:17.369319342 +0000 UTC m=+23.707483735" watchObservedRunningTime="2026-06-09 09:50:17.369380285 +0000 UTC m=+23.707544680" Jun 09 09:50:17.745897 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:17.745875 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 09:50:18.125444 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.125132 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T09:50:17.745891651Z","UUID":"79fb0d49-1f3e-423a-a28c-970b32bfcc44","Handler":null,"Name":"","Endpoint":""} Jun 09 09:50:18.127356 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.127333 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 09:50:18.127500 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.127382 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 09:50:18.317737 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.317696 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" event={"ID":"4dd4006a884017f52d939307551865b7","Type":"ContainerStarted","Data":"d9c048e2ea71b93d852640d1cc1b52c9d80862c5c13156306c4f50ba1217b7c9"} Jun 09 09:50:18.319911 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.319880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" event={"ID":"ca31dff7-0a7f-4183-be25-f9eca742a76d","Type":"ContainerStarted","Data":"0a77bdb0314fe7abba04da058847c36574f9065dfd5eb5d78f73988f2c89285e"} Jun 09 09:50:18.323496 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.323472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:50:18.324256 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.324233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"de3f4fa00338500c12f550529abbf49dadc2c2f3da5ce6d331f6e5fc9c342f3f"} Jun 09 09:50:18.329996 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.329945 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hj5nf" podStartSLOduration=4.437604932 podStartE2EDuration="24.32992977s" totalImagesPullingTime="19.892324838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:17.380908945 +0000 UTC m=+23.719073337" watchObservedRunningTime="2026-06-09 09:50:18.32992977 +0000 UTC m=+24.668094165" Jun 09 09:50:18.330665 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:18.330625 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-235.ec2.internal" podStartSLOduration=24.330616197 podStartE2EDuration="24.330616197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:18.32999478 +0000 UTC m=+24.668159176" watchObservedRunningTime="2026-06-09 09:50:18.330616197 +0000 UTC m=+24.668780591" Jun 09 09:50:19.118452 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:19.118421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:19.118452 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:19.118437 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:19.118656 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:19.118519 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:19.118656 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:19.118634 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:19.118738 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:19.118706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:19.118796 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:19.118778 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:19.328947 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:19.328906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" event={"ID":"ca31dff7-0a7f-4183-be25-f9eca742a76d","Type":"ContainerStarted","Data":"74db975e2cfd564279b44b0b41d93bf47bceae12d7fdd57e3ec21b632a610949"} Jun 09 09:50:19.344898 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:19.344846 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zl2zf" podStartSLOduration=3.338461265 podStartE2EDuration="25.344827584s" totalImagesPullingTime="22.006366319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:19.343906293 +0000 UTC m=+25.682070688" watchObservedRunningTime="2026-06-09 09:50:19.344827584 +0000 UTC m=+25.682991978" Jun 09 09:50:20.516848 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:20.516816 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:50:20.517675 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:20.517653 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:50:20.981843 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:20.981803 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:50:20.982456 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:20.982435 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6c2f5" Jun 09 09:50:21.050682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.050643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:21.119041 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.119012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:21.119041 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.119021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:21.119041 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.119041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:21.119341 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:21.119170 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:21.119341 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:21.119241 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:21.119341 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:21.119287 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:21.132445 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.132419 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:21.233355 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.233277 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:21.281663 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:21.281635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:22.340942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.340765 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:50:22.341491 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.341277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"d5d8f2b611fd14dae63f803dc3d224f4200136b478b6613bf8e9be241d5fb72f"} Jun 09 09:50:22.341564 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.341549 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:22.341763 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.341738 2561 scope.go:117] "RemoveContainer" containerID="6948d3e9028e6c4b3dcdd39e96588be31f8f409702a0a894a76f4363495e8aa5" Jun 09 09:50:22.343190 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.343168 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="7d056f78bfe576cf6dd8282406f49b73b4b7a6670001035f13720cbe22318c91" exitCode=0 Jun 09 09:50:22.343296 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.343241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"7d056f78bfe576cf6dd8282406f49b73b4b7a6670001035f13720cbe22318c91"} Jun 09 09:50:22.357892 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:22.357785 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:23.118945 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.118913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:23.118945 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.118923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:23.119238 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.119023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:23.119238 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.119041 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:23.119238 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.119129 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:23.119238 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.119200 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:23.352471 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.352273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:50:23.352884 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.352808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" event={"ID":"d1f0e0af-3cdc-4d75-8172-1fe2050b36e6","Type":"ContainerStarted","Data":"d78925a60ba02c32c65ac09ec62f068ca866183ed230ea2a9eed6daee17c5cc5"} Jun 09 09:50:23.353121 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.353095 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:23.353331 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.353257 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:23.371155 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.371103 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:23.375913 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.375874 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" podStartSLOduration=9.198788999 podStartE2EDuration="29.37586096s" totalImagesPullingTime="20.177071961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:23.37546064 +0000 UTC m=+29.713625033" watchObservedRunningTime="2026-06-09 09:50:23.37586096 +0000 UTC m=+29.714025403" Jun 09 09:50:23.465446 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.465421 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kj5qw"] Jun 09 09:50:23.465557 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.465551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:23.465660 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.465640 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:23.468802 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.468778 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jpl6r"] Jun 09 09:50:23.468905 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.468876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:23.468988 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.468970 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:23.469350 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.469330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jz5mx"] Jun 09 09:50:23.469425 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.469413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:23.469500 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:23.469482 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:23.546382 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.546355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:23.649031 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.648945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:23.964975 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:23.964895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:24.063160 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:24.063129 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:24.357490 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:24.357460 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="69a02b61cfefde1abdb76c95a3a939e374c1bf73d43dc9d5b35bda2954325327" exitCode=0 Jun 09 09:50:24.357946 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:24.357545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"69a02b61cfefde1abdb76c95a3a939e374c1bf73d43dc9d5b35bda2954325327"} Jun 09 09:50:25.118619 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:25.118589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:25.118761 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:25.118698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:25.118761 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:25.118719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:25.118761 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:25.118702 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:25.118903 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:25.118772 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:25.118903 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:25.118871 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:25.361770 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:25.361734 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="9a9e0a88bcd34ee7c356869fc21c36650341f7e82a7b8a5baf49a07ed60ec74a" exitCode=0 Jun 09 09:50:25.362475 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:25.361807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"9a9e0a88bcd34ee7c356869fc21c36650341f7e82a7b8a5baf49a07ed60ec74a"} Jun 09 09:50:26.808988 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:26.808892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:26.809488 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:26.809055 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:26.809488 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:26.809142 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret podName:c79d695d-1c50-4615-92b6-fdeb47568249 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:58.809124848 +0000 UTC m=+65.147289222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret") pod "global-pull-secret-syncer-kj5qw" (UID: "c79d695d-1c50-4615-92b6-fdeb47568249") : object "kube-system"/"original-pull-secret" not registered Jun 09 09:50:26.910105 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:26.910063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:26.910267 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:26.910209 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:26.910324 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:26.910287 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:50:58.910260168 +0000 UTC m=+65.248424554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 09:50:27.011016 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:27.010978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:27.011199 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.011138 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 09:50:27.011199 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.011159 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 09:50:27.011199 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.011169 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jt6t4 for pod openshift-network-diagnostics/network-check-target-jz5mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:27.011324 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.011220 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4 podName:67f491fb-237e-4664-8ffa-6e5b897ee86b nodeName:}" failed. No retries permitted until 2026-06-09 09:50:59.011205963 +0000 UTC m=+65.349370333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jt6t4" (UniqueName: "kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4") pod "network-check-target-jz5mx" (UID: "67f491fb-237e-4664-8ffa-6e5b897ee86b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 09:50:27.119084 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:27.119038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:27.119219 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:27.119038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:27.119219 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.119163 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jz5mx" podUID="67f491fb-237e-4664-8ffa-6e5b897ee86b" Jun 09 09:50:27.119280 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:27.119038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:27.119310 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.119223 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kj5qw" podUID="c79d695d-1c50-4615-92b6-fdeb47568249" Jun 09 09:50:27.119357 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:27.119317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:50:28.507658 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.507569 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-235.ec2.internal" event="NodeReady" Jun 09 09:50:28.508136 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.507753 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 09:50:28.545993 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.545963 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xx6cd"] Jun 09 09:50:28.548860 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.548834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.549209 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.549157 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k4kvp"] Jun 09 09:50:28.550583 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.550562 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 09:50:28.550694 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.550665 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncfhc\"" Jun 09 09:50:28.550753 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.550667 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 09:50:28.551036 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.551019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.552759 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.552732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t5vqs\"" Jun 09 09:50:28.552759 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.552745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 09:50:28.552759 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.552752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 09:50:28.552975 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.552870 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 09:50:28.557786 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.557766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xx6cd"] Jun 09 09:50:28.561044 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.561019 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4kvp"] Jun 09 09:50:28.622173 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.622136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-config-volume\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.622329 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.622187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns7kp\" (UniqueName: \"kubernetes.io/projected/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-kube-api-access-ns7kp\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.622329 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.622210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-tmp-dir\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.622329 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.622280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.723484 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.723661 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e001e2-a759-4934-8ec3-3e9ef644ec51-cert\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.723661 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpm68\" (UniqueName: \"kubernetes.io/projected/d7e001e2-a759-4934-8ec3-3e9ef644ec51-kube-api-access-xpm68\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.723661 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-config-volume\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.723661 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:28.723622 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:28.723846 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:28.723684 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:50:29.223663107 +0000 UTC m=+35.561827480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:28.723846 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns7kp\" (UniqueName: \"kubernetes.io/projected/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-kube-api-access-ns7kp\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.723846 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.723753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-tmp-dir\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.724034 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.724019 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-tmp-dir\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.724270 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.724251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-config-volume\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.733565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.733413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns7kp\" (UniqueName: \"kubernetes.io/projected/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-kube-api-access-ns7kp\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:28.824332 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.824218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e001e2-a759-4934-8ec3-3e9ef644ec51-cert\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.824332 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.824259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpm68\" (UniqueName: \"kubernetes.io/projected/d7e001e2-a759-4934-8ec3-3e9ef644ec51-kube-api-access-xpm68\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.826940 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.826920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7e001e2-a759-4934-8ec3-3e9ef644ec51-cert\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.832014 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.831986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpm68\" (UniqueName: \"kubernetes.io/projected/d7e001e2-a759-4934-8ec3-3e9ef644ec51-kube-api-access-xpm68\") pod \"ingress-canary-k4kvp\" (UID: \"d7e001e2-a759-4934-8ec3-3e9ef644ec51\") " pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:28.867946 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:28.867913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4kvp" Jun 09 09:50:29.118786 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.118746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:29.118953 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.118861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:29.118953 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.118886 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:29.121117 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:50:29.121288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121153 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:50:29.121288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121153 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:50:29.121512 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hpd64\"" Jun 09 09:50:29.121512 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:50:29.121667 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.121519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7682x\"" Jun 09 09:50:29.226932 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.226900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:29.227107 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:29.227058 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:29.227159 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:29.227133 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:50:30.227116482 +0000 UTC m=+36.565280853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:29.329233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.329208 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4kvp"] Jun 09 09:50:29.337012 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:50:29.336991 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e001e2_a759_4934_8ec3_3e9ef644ec51.slice/crio-51b0757c7ba6c721e20fa135ab75656695964da7ba5d32c9efb116a83cfdc16c WatchSource:0}: Error finding container 51b0757c7ba6c721e20fa135ab75656695964da7ba5d32c9efb116a83cfdc16c: Status 404 returned error can't find the container with id 51b0757c7ba6c721e20fa135ab75656695964da7ba5d32c9efb116a83cfdc16c Jun 09 09:50:29.374840 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.374774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerStarted","Data":"5ec3e6ad8939b80c7392f2577b9720dfe779a00d24654a3e42607cc9a624bde5"} Jun 09 09:50:29.376001 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.375975 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4kvp" event={"ID":"d7e001e2-a759-4934-8ec3-3e9ef644ec51","Type":"ContainerStarted","Data":"51b0757c7ba6c721e20fa135ab75656695964da7ba5d32c9efb116a83cfdc16c"} Jun 09 09:50:29.865088 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.865045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:29.965079 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:29.965026 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:30.235766 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:30.235633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:30.235946 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:30.235818 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:30.235946 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:30.235913 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:50:32.235894218 +0000 UTC m=+38.574058588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:30.253933 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:30.253901 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:30.354161 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:30.354127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:30.381157 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:30.381124 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="5ec3e6ad8939b80c7392f2577b9720dfe779a00d24654a3e42607cc9a624bde5" exitCode=0 Jun 09 09:50:30.381295 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:30.381165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"5ec3e6ad8939b80c7392f2577b9720dfe779a00d24654a3e42607cc9a624bde5"} Jun 09 09:50:31.385953 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:31.385777 2561 generic.go:356] "Generic (PLEG): container finished" podID="2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc" containerID="918c352aadd693b1d23581480e1a2a3c1c01702dcd88335492643aa8b9ae9e0a" exitCode=0 Jun 09 09:50:31.386445 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:31.385865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerDied","Data":"918c352aadd693b1d23581480e1a2a3c1c01702dcd88335492643aa8b9ae9e0a"} Jun 09 09:50:31.387537 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:31.387482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4kvp" event={"ID":"d7e001e2-a759-4934-8ec3-3e9ef644ec51","Type":"ContainerStarted","Data":"4f171237e41b066c0cc83318c48567fdc5c547101b6f32f325b36e330702d3fd"} Jun 09 09:50:31.415862 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:31.415812 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k4kvp" podStartSLOduration=1.724781388 podStartE2EDuration="3.415796327s" totalImagesPullingTime="1.691014939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:31.415118301 +0000 UTC m=+37.753282696" watchObservedRunningTime="2026-06-09 09:50:31.415796327 +0000 UTC m=+37.753960726" Jun 09 09:50:32.253239 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:32.253204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:32.253411 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:32.253361 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:32.253454 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:32.253427 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:50:36.253410691 +0000 UTC m=+42.591575062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:32.393537 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:32.393506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqpms" event={"ID":"2fd39a85-1bbe-4b4c-be90-4b63cf1cd8cc","Type":"ContainerStarted","Data":"071c7efecb9963fa51f02d55b31c954350de9a0bcb690e9f1e98be385600c959"} Jun 09 09:50:32.412206 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:32.412157 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tqpms" podStartSLOduration=8.397120532 podStartE2EDuration="38.412140373s" totalImagesPullingTime="30.015019841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:50:32.411058736 +0000 UTC m=+38.749223128" watchObservedRunningTime="2026-06-09 09:50:32.412140373 +0000 UTC m=+38.750304765" Jun 09 09:50:32.531023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:32.530937 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:32.576404 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:32.576372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:33.714102 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:33.714055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:33.815509 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:33.815477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:36.282022 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:36.281984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:36.282465 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:36.282136 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:36.282465 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:36.282188 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:50:44.282174704 +0000 UTC m=+50.620339074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:44.327554 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:44.327519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:50:44.328160 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:44.327630 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:50:44.328160 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:44.327687 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:51:00.327672712 +0000 UTC m=+66.665837082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:50:47.593668 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:47.593631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:47.764244 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:47.764206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:51.845657 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:51.845623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:51.946276 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:51.946242 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:55.372059 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:55.372033 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj987" Jun 09 09:50:55.474304 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:55.474268 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:55.527444 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:55.527417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:55.576642 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:55.576589 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:50:58.828342 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:58.828291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:58.830142 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:58.830121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 09:50:58.841804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:58.841771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c79d695d-1c50-4615-92b6-fdeb47568249-original-pull-secret\") pod \"global-pull-secret-syncer-kj5qw\" (UID: \"c79d695d-1c50-4615-92b6-fdeb47568249\") " pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:58.928922 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:58.928891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:50:58.930911 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:58.930890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 09:50:58.939244 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:58.939225 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:50:58.939318 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:50:58.939283 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:52:02.939267137 +0000 UTC m=+129.277431508 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : secret "metrics-daemon-secret" not found Jun 09 09:50:59.029332 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.029282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:59.031080 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.031045 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 09:50:59.042215 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.042192 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 09:50:59.053783 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.053755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6t4\" (UniqueName: \"kubernetes.io/projected/67f491fb-237e-4664-8ffa-6e5b897ee86b-kube-api-access-jt6t4\") pod \"network-check-target-jz5mx\" (UID: \"67f491fb-237e-4664-8ffa-6e5b897ee86b\") " pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:59.137188 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.137151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kj5qw" Jun 09 09:50:59.144956 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.144935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7682x\"" Jun 09 09:50:59.153386 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.153364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:50:59.266923 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.266896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kj5qw"] Jun 09 09:50:59.270216 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:50:59.270183 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79d695d_1c50_4615_92b6_fdeb47568249.slice/crio-22c3cad72d5eabd979509e0ad7b1042d89ff6a91ba5fe44542b6fbdfb844b609 WatchSource:0}: Error finding container 22c3cad72d5eabd979509e0ad7b1042d89ff6a91ba5fe44542b6fbdfb844b609: Status 404 returned error can't find the container with id 22c3cad72d5eabd979509e0ad7b1042d89ff6a91ba5fe44542b6fbdfb844b609 Jun 09 09:50:59.285446 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.283166 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jz5mx"] Jun 09 09:50:59.288504 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:50:59.288484 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f491fb_237e_4664_8ffa_6e5b897ee86b.slice/crio-de73960c3d5b7e13fadc72a378fab0da6e6d95ec9f741e854a211aa645f1b6ba WatchSource:0}: Error finding container de73960c3d5b7e13fadc72a378fab0da6e6d95ec9f741e854a211aa645f1b6ba: Status 404 returned error can't find the container with id de73960c3d5b7e13fadc72a378fab0da6e6d95ec9f741e854a211aa645f1b6ba Jun 09 09:50:59.453855 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.453772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jz5mx" event={"ID":"67f491fb-237e-4664-8ffa-6e5b897ee86b","Type":"ContainerStarted","Data":"de73960c3d5b7e13fadc72a378fab0da6e6d95ec9f741e854a211aa645f1b6ba"} Jun 09 09:50:59.454798 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:50:59.454776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kj5qw" event={"ID":"c79d695d-1c50-4615-92b6-fdeb47568249","Type":"ContainerStarted","Data":"22c3cad72d5eabd979509e0ad7b1042d89ff6a91ba5fe44542b6fbdfb844b609"} Jun 09 09:51:00.327879 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.327834 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:51:00.337658 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.337621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:51:00.337825 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:51:00.337749 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:51:00.337825 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:51:00.337819 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:51:32.337799742 +0000 UTC m=+98.675964138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:51:00.767760 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.767716 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5"] Jun 09 09:51:00.789497 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.789470 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g"] Jun 09 09:51:00.789677 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.789603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.791923 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.791743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q4jjp\"" Jun 09 09:51:00.791923 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.791755 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 09:51:00.791923 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.791768 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 09:51:00.791923 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.791828 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 09:51:00.792416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.792397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 09:51:00.807558 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.807501 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5"] Jun 09 09:51:00.807558 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.807536 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g"] Jun 09 09:51:00.807746 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.807635 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.809825 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.809804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 09:51:00.809966 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.809850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 09:51:00.810124 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.810103 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 09:51:00.810237 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.810207 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 09:51:00.841907 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.841879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd1755cf-d1d6-4f37-b8db-a98025683214-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.842042 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.841940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfcz\" (UniqueName: \"kubernetes.io/projected/cd1755cf-d1d6-4f37-b8db-a98025683214-kube-api-access-sjfcz\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.842042 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.841974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.842042 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.842002 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.842228 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.842136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.842228 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.842171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk6rf\" (UniqueName: \"kubernetes.io/projected/fd9c3af8-5964-40f0-a031-7c85b141818f-kube-api-access-dk6rf\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.842320 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.842257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.842320 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.842291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c3af8-5964-40f0-a031-7c85b141818f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.943233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.943411 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c3af8-5964-40f0-a031-7c85b141818f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.943411 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd1755cf-d1d6-4f37-b8db-a98025683214-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.943787 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfcz\" (UniqueName: \"kubernetes.io/projected/cd1755cf-d1d6-4f37-b8db-a98025683214-kube-api-access-sjfcz\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.943787 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.943787 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.944017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.944017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.943857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk6rf\" (UniqueName: \"kubernetes.io/projected/fd9c3af8-5964-40f0-a031-7c85b141818f-kube-api-access-dk6rf\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.944144 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.944053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd9c3af8-5964-40f0-a031-7c85b141818f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.946706 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.946656 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.946832 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.946804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.946991 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.946963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd1755cf-d1d6-4f37-b8db-a98025683214-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.948004 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.947976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-ca\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.948254 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.948237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fd9c3af8-5964-40f0-a031-7c85b141818f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:00.951899 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.951852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfcz\" (UniqueName: \"kubernetes.io/projected/cd1755cf-d1d6-4f37-b8db-a98025683214-kube-api-access-sjfcz\") pod \"managed-serviceaccount-addon-agent-86dc44f4-hngf5\" (UID: \"cd1755cf-d1d6-4f37-b8db-a98025683214\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:00.952312 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:00.952294 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk6rf\" (UniqueName: \"kubernetes.io/projected/fd9c3af8-5964-40f0-a031-7c85b141818f-kube-api-access-dk6rf\") pod \"cluster-proxy-proxy-agent-6656b57968-2fg6g\" (UID: \"fd9c3af8-5964-40f0-a031-7c85b141818f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:01.115061 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:01.115025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" Jun 09 09:51:01.124396 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:01.124366 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:51:01.297052 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:01.297014 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5"] Jun 09 09:51:01.329472 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:01.329441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g"] Jun 09 09:51:02.336839 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:51:02.336805 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd1755cf_d1d6_4f37_b8db_a98025683214.slice/crio-ed4df3d0178bcaf982bc77fd41eabdd5336c56b8247e2e1893930fbe9304d0d8 WatchSource:0}: Error finding container ed4df3d0178bcaf982bc77fd41eabdd5336c56b8247e2e1893930fbe9304d0d8: Status 404 returned error can't find the container with id ed4df3d0178bcaf982bc77fd41eabdd5336c56b8247e2e1893930fbe9304d0d8 Jun 09 09:51:02.464312 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:02.464269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" event={"ID":"cd1755cf-d1d6-4f37-b8db-a98025683214","Type":"ContainerStarted","Data":"ed4df3d0178bcaf982bc77fd41eabdd5336c56b8247e2e1893930fbe9304d0d8"} Jun 09 09:51:03.714408 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:51:03.714373 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd9c3af8_5964_40f0_a031_7c85b141818f.slice/crio-face498cc91b72f8589c10fa36c964d3893f62fdedfb5064eb8f869fc7628d91 WatchSource:0}: Error finding container face498cc91b72f8589c10fa36c964d3893f62fdedfb5064eb8f869fc7628d91: Status 404 returned error can't find the container with id face498cc91b72f8589c10fa36c964d3893f62fdedfb5064eb8f869fc7628d91 Jun 09 09:51:04.475710 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.475658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerStarted","Data":"face498cc91b72f8589c10fa36c964d3893f62fdedfb5064eb8f869fc7628d91"} Jun 09 09:51:04.477952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.477921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jz5mx" event={"ID":"67f491fb-237e-4664-8ffa-6e5b897ee86b","Type":"ContainerStarted","Data":"b8abbe432ef98bae1cbbb81bcb6a15f04c6603f301196f656dbdd748ed42c9ca"} Jun 09 09:51:04.478109 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.478015 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:51:04.480590 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.480553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kj5qw" event={"ID":"c79d695d-1c50-4615-92b6-fdeb47568249","Type":"ContainerStarted","Data":"599bcb8570963ba5448bb8aa9048ae18fe10c1a21f45314cb6257f5d417768d7"} Jun 09 09:51:04.492947 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.492896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jz5mx" podStartSLOduration=66.029886772 podStartE2EDuration="1m10.492877639s" totalImagesPullingTime="4.462990867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:51:04.49150352 +0000 UTC m=+70.829667914" watchObservedRunningTime="2026-06-09 09:51:04.492877639 +0000 UTC m=+70.831042018" Jun 09 09:51:04.507167 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:04.507116 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kj5qw" podStartSLOduration=66.022105262 podStartE2EDuration="1m10.507099011s" totalImagesPullingTime="4.484993749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:51:04.506554534 +0000 UTC m=+70.844718922" watchObservedRunningTime="2026-06-09 09:51:04.507099011 +0000 UTC m=+70.845263402" Jun 09 09:51:07.493086 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:07.493024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" event={"ID":"cd1755cf-d1d6-4f37-b8db-a98025683214","Type":"ContainerStarted","Data":"1723b5b3b8c4e0ba5f9339b6b4ca1bf9fd6eeef3beeb1e85455997fbd9cbbdd7"} Jun 09 09:51:07.506382 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:07.506316 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" podStartSLOduration=3.360618144 podStartE2EDuration="7.506295279s" totalImagesPullingTime="4.145677135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:51:07.505175427 +0000 UTC m=+73.843339819" watchObservedRunningTime="2026-06-09 09:51:07.506295279 +0000 UTC m=+73.844459672" Jun 09 09:51:09.499986 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:09.499955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerStarted","Data":"ffef9b983178813bfd87a32cc736a1ff51e443ea5c62dc33f49e9676101e5ec8"} Jun 09 09:51:09.500406 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:09.499998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerStarted","Data":"54b4c4981b5828b01485790500f5ad949dbcdfb8b90ba9f94821a3470c910e0b"} Jun 09 09:51:09.500406 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:09.500015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerStarted","Data":"04d3639217e9a7e90345ab514d10421d2ddb648efa326892f557d340e5b2950f"} Jun 09 09:51:09.516242 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:09.516192 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" podStartSLOduration=4.360984449 podStartE2EDuration="9.516176682s" totalImagesPullingTime="5.155192233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:51:09.514759787 +0000 UTC m=+75.852924203" watchObservedRunningTime="2026-06-09 09:51:09.516176682 +0000 UTC m=+75.854341075" Jun 09 09:51:32.362049 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:32.362016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:51:32.362440 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:51:32.362169 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:51:32.362440 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:51:32.362229 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:52:36.362213786 +0000 UTC m=+162.700378160 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:51:35.486281 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:51:35.486250 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jz5mx" Jun 09 09:52:02.975646 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:52:02.975606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:52:02.976148 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:02.975756 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 09:52:02.976148 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:02.975827 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs podName:3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1 nodeName:}" failed. No retries permitted until 2026-06-09 09:54:04.975804146 +0000 UTC m=+251.313968537 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs") pod "network-metrics-daemon-jpl6r" (UID: "3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1") : secret "metrics-daemon-secret" not found Jun 09 09:52:31.563792 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:31.563749 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xx6cd" podUID="e9dfb9f7-31d4-4f80-a353-736d0c19f79d" Jun 09 09:52:31.737859 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:52:31.737830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:52:32.130767 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:32.130726 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jpl6r" podUID="3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1" Jun 09 09:52:36.404342 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:52:36.404304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:52:36.404793 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:36.404420 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 09:52:36.404793 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:52:36.404485 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls podName:e9dfb9f7-31d4-4f80-a353-736d0c19f79d nodeName:}" failed. No retries permitted until 2026-06-09 09:54:38.404467814 +0000 UTC m=+284.742632187 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls") pod "dns-default-xx6cd" (UID: "e9dfb9f7-31d4-4f80-a353-736d0c19f79d") : secret "dns-default-metrics-tls" not found Jun 09 09:52:44.266778 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:52:44.266693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:52:47.118440 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:52:47.118385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:53:04.804660 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:04.804620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:04.905116 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:04.905053 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:06.836779 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:06.836743 2561 generic.go:356] "Generic (PLEG): container finished" podID="cd1755cf-d1d6-4f37-b8db-a98025683214" containerID="1723b5b3b8c4e0ba5f9339b6b4ca1bf9fd6eeef3beeb1e85455997fbd9cbbdd7" exitCode=255 Jun 09 09:53:06.837184 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:06.836793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" event={"ID":"cd1755cf-d1d6-4f37-b8db-a98025683214","Type":"ContainerDied","Data":"1723b5b3b8c4e0ba5f9339b6b4ca1bf9fd6eeef3beeb1e85455997fbd9cbbdd7"} Jun 09 09:53:06.837184 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:06.837088 2561 scope.go:117] "RemoveContainer" containerID="1723b5b3b8c4e0ba5f9339b6b4ca1bf9fd6eeef3beeb1e85455997fbd9cbbdd7" Jun 09 09:53:06.883833 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:06.883803 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:06.985526 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:06.985494 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:07.844312 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:07.844273 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dc44f4-hngf5" event={"ID":"cd1755cf-d1d6-4f37-b8db-a98025683214","Type":"ContainerStarted","Data":"d3901ad7ae4cc2afb9f440012046a56595e0d701a7933347cfe97b3cdca74f5b"} Jun 09 09:53:09.047904 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.047869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:09.142512 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.142476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:09.248759 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.248718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:09.342805 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.342772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:09.443984 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.443950 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:09.505590 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:09.505560 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:10.126286 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:10.126249 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:10.226202 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:10.226160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:11.217471 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:11.217437 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:11.709903 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:11.709870 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:11.765527 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:11.765498 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:12.223273 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:12.223249 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hj5nf_8ab09d4b-c5e5-4718-b06c-b5625af33450/dns-node-resolver/0.log" Jun 09 09:53:12.552292 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:12.552210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:13.222104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:13.222080 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p27q_a6457218-4f7e-453e-9a2f-7ef803c28adf/node-ca/0.log" Jun 09 09:53:13.313015 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:13.312975 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:13.455145 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:13.455100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:13.555211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:13.555120 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:13.656140 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:13.656106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:14.221974 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:14.221942 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4kvp_d7e001e2-a759-4934-8ec3-3e9ef644ec51/serve-healthcheck-canary/0.log" Jun 09 09:53:14.616884 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:14.616853 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:15.016380 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:15.016293 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:15.116986 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:15.116953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:15.216821 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:15.216784 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:15.413574 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:15.413540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:15.612646 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:15.612616 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:16.612426 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:16.612393 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.017192 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.017109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.117248 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.117215 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.220603 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.220578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.270842 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.270766 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.408824 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.408787 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:17.815314 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:17.815284 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:18.208612 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:18.208583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:18.807634 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:18.807605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:19.210391 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:19.210364 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:19.410844 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:19.410816 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:19.511351 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:19.511275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:19.811547 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:19.811469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:20.011051 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:20.011012 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:20.216323 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:20.216291 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:20.817281 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:20.817248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:21.415676 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:21.415645 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:21.609585 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:21.609552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:21.814028 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:21.813936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:22.123421 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:22.123387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:22.224190 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:22.224159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:22.827592 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:22.827560 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:23.100652 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:23.100617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:23.254378 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:23.254343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:23.410873 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:23.410785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:23.610362 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:23.610325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:23.812838 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:23.812754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:24.008508 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:24.008476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:24.413722 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:24.413688 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:26.045652 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:26.045623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:26.102443 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:26.102410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:27.826046 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:27.826015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:27.885287 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:27.885260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:27.944838 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:27.944799 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:28.119954 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:28.119925 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:28.500977 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:28.500894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:28.556169 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:28.556141 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:28.913107 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:28.913058 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:29.125716 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:29.125675 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:29.315362 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:29.315274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:29.416018 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:29.415986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:29.516596 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:29.516564 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:29.570926 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:29.570842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:31.763345 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.763311 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7tzxv"] Jun 09 09:53:31.765932 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.765907 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.768751 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.768727 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 09:53:31.768858 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.768819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 09:53:31.769218 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.769200 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c4stl\"" Jun 09 09:53:31.769327 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.769222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 09:53:31.769436 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.769422 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 09:53:31.781752 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.781732 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tzxv"] Jun 09 09:53:31.855236 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.855200 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:31.890417 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.890389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.890556 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.890422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-crio-socket\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.890556 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.890494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-data-volume\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.890556 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.890535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.890556 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.890552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662nd\" (UniqueName: \"kubernetes.io/projected/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-api-access-662nd\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.958160 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.958125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:31.991825 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.991940 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-crio-socket\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.991940 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-data-volume\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.992045 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.992045 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662nd\" (UniqueName: \"kubernetes.io/projected/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-api-access-662nd\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.992045 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.991985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-crio-socket\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.992294 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.992270 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-data-volume\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.992458 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.992440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.994175 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.994155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:31.999424 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:31.999396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-662nd\" (UniqueName: \"kubernetes.io/projected/6517f9fe-5b98-44af-ac31-bf7bcecf4cb2-kube-api-access-662nd\") pod \"insights-runtime-extractor-7tzxv\" (UID: \"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2\") " pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:32.075756 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.075674 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7tzxv" Jun 09 09:53:32.139929 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.139885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:32.197135 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.197104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7tzxv"] Jun 09 09:53:32.200224 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:53:32.200198 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6517f9fe_5b98_44af_ac31_bf7bcecf4cb2.slice/crio-5f1c3477f8b45dc74e94819bd44fe728f90143d08be5d00eedf6f87d9ba06e57 WatchSource:0}: Error finding container 5f1c3477f8b45dc74e94819bd44fe728f90143d08be5d00eedf6f87d9ba06e57: Status 404 returned error can't find the container with id 5f1c3477f8b45dc74e94819bd44fe728f90143d08be5d00eedf6f87d9ba06e57 Jun 09 09:53:32.217061 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.217037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:32.915800 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.915776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tzxv" event={"ID":"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2","Type":"ContainerStarted","Data":"25bdee84a3ceaf4e32a35474e0e03657d71b6061b5f61515f411827a051b356c"} Jun 09 09:53:32.916130 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.915832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tzxv" event={"ID":"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2","Type":"ContainerStarted","Data":"b32d382563f19b7d80f91ae861417c6410e9ea6e91016929e592f819df76f9c8"} Jun 09 09:53:32.916130 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:32.915852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tzxv" event={"ID":"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2","Type":"ContainerStarted","Data":"5f1c3477f8b45dc74e94819bd44fe728f90143d08be5d00eedf6f87d9ba06e57"} Jun 09 09:53:33.964787 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:33.964743 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:34.023356 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:34.023322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:34.287758 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:34.287669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:34.350418 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:34.350387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:34.924255 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:34.924219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7tzxv" event={"ID":"6517f9fe-5b98-44af-ac31-bf7bcecf4cb2","Type":"ContainerStarted","Data":"a74dd981b652c74a733eae70a9f2e529c87ef1ee3e56d4f55dc7f02f6c9d65d7"} Jun 09 09:53:34.940948 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:34.940903 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7tzxv" podStartSLOduration=1.469639809 podStartE2EDuration="3.940886295s" totalImagesPullingTime="2.471246486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:53:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:34.939668436 +0000 UTC m=+221.277832828" watchObservedRunningTime="2026-06-09 09:53:34.940886295 +0000 UTC m=+221.279050688" Jun 09 09:53:35.088892 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:35.088860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:38.423594 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:38.423554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:39.351149 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:39.351106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:39.413111 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:39.413082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:40.425327 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.425278 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:40.524753 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.524723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:40.640208 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.640165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:40.679329 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.679250 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4"] Jun 09 09:53:40.681669 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.681647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.683701 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.683677 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 09:53:40.683790 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.683677 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 09:53:40.683992 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.683976 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 09:53:40.684149 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.684133 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 09:53:40.684322 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.684298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qn2lq\"" Jun 09 09:53:40.684691 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.684674 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 09:53:40.684731 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.684674 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 09:53:40.687440 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.687421 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2mlmg"] Jun 09 09:53:40.689901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.689880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.691939 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.691920 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 09:53:40.692033 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.691948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kbkvf\"" Jun 09 09:53:40.692033 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.691924 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 09:53:40.693266 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.693250 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 09:53:40.695464 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.695444 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4"] Jun 09 09:53:40.725350 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.725323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:40.756789 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscxr\" (UniqueName: \"kubernetes.io/projected/a46209b2-e489-4720-9318-53769b4c500e-kube-api-access-mscxr\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtbc\" (UniqueName: \"kubernetes.io/projected/2a7888aa-638b-414f-9ab0-22055b65ac48-kube-api-access-jvtbc\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-metrics-client-ca\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-wtmp\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.756982 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.756969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-textfile\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a46209b2-e489-4720-9318-53769b4c500e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-root\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.757243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.757207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-sys\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.857808 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtbc\" (UniqueName: \"kubernetes.io/projected/2a7888aa-638b-414f-9ab0-22055b65ac48-kube-api-access-jvtbc\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.857808 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-metrics-client-ca\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-wtmp\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-textfile\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a46209b2-e489-4720-9318-53769b4c500e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-root\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.857994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-sys\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-root\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscxr\" (UniqueName: \"kubernetes.io/projected/a46209b2-e489-4720-9318-53769b4c500e-kube-api-access-mscxr\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858141 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-wtmp\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a7888aa-638b-414f-9ab0-22055b65ac48-sys\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-textfile\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:40.858279 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:40.858336 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:40.858348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls podName:2a7888aa-638b-414f-9ab0-22055b65ac48 nodeName:}" failed. No retries permitted until 2026-06-09 09:53:41.358329003 +0000 UTC m=+227.696493392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls") pod "node-exporter-2mlmg" (UID: "2a7888aa-638b-414f-9ab0-22055b65ac48") : secret "node-exporter-tls" not found Jun 09 09:53:40.858416 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:40.858379 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls podName:a46209b2-e489-4720-9318-53769b4c500e nodeName:}" failed. No retries permitted until 2026-06-09 09:53:41.35836934 +0000 UTC m=+227.696533716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-6d7j4" (UID: "a46209b2-e489-4720-9318-53769b4c500e") : secret "kube-state-metrics-tls" not found Jun 09 09:53:40.858913 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-metrics-client-ca\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858913 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-accelerators-collector-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.858913 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.859034 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.858911 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.859087 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.859034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a46209b2-e489-4720-9318-53769b4c500e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.860587 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.860550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.860705 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.860634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.868293 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.868268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtbc\" (UniqueName: \"kubernetes.io/projected/2a7888aa-638b-414f-9ab0-22055b65ac48-kube-api-access-jvtbc\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:40.868730 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.868711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscxr\" (UniqueName: \"kubernetes.io/projected/a46209b2-e489-4720-9318-53769b4c500e-kube-api-access-mscxr\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:40.885339 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:40.885317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.036656 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.036579 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.142796 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.142764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.237723 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.237689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.361462 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.361432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:41.361621 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.361478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:41.363816 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.363792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a7888aa-638b-414f-9ab0-22055b65ac48-node-exporter-tls\") pod \"node-exporter-2mlmg\" (UID: \"2a7888aa-638b-414f-9ab0-22055b65ac48\") " pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:41.364039 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.364018 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a46209b2-e489-4720-9318-53769b4c500e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-6d7j4\" (UID: \"a46209b2-e489-4720-9318-53769b4c500e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:41.591680 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.591634 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" Jun 09 09:53:41.599863 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.599838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2mlmg" Jun 09 09:53:41.611632 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:53:41.611569 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7888aa_638b_414f_9ab0_22055b65ac48.slice/crio-74f91402261d19d81e4b526b14a0a6fbd43282403799804220f04b480c82abd7 WatchSource:0}: Error finding container 74f91402261d19d81e4b526b14a0a6fbd43282403799804220f04b480c82abd7: Status 404 returned error can't find the container with id 74f91402261d19d81e4b526b14a0a6fbd43282403799804220f04b480c82abd7 Jun 09 09:53:41.646551 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.646507 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.719649 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.719619 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4"] Jun 09 09:53:41.722205 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:53:41.722182 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46209b2_e489_4720_9318_53769b4c500e.slice/crio-cf1ca910307cef90bdb5b135db855b3e02d774454260783fd31cc81dc295d4c4 WatchSource:0}: Error finding container cf1ca910307cef90bdb5b135db855b3e02d774454260783fd31cc81dc295d4c4: Status 404 returned error can't find the container with id cf1ca910307cef90bdb5b135db855b3e02d774454260783fd31cc81dc295d4c4 Jun 09 09:53:41.725565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.725536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.730160 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.730139 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:53:41.734139 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.734123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.736141 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 09:53:41.736234 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736163 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 09:53:41.736311 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736294 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 09:53:41.736814 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736638 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 09:53:41.736814 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736690 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 09:53:41.736814 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736719 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 09:53:41.736814 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.736727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 09:53:41.737037 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.737006 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d8tsl\"" Jun 09 09:53:41.737092 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.737006 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 09:53:41.737137 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.737006 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 09:53:41.750834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.750813 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:53:41.864854 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.864771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.864854 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.864825 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.864854 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.864849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865133 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.864910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865133 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.864982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865133 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865133 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.865446 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.865297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwg8s\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.945107 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.945055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mlmg" event={"ID":"2a7888aa-638b-414f-9ab0-22055b65ac48","Type":"ContainerStarted","Data":"74f91402261d19d81e4b526b14a0a6fbd43282403799804220f04b480c82abd7"} Jun 09 09:53:41.946103 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.946062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" event={"ID":"a46209b2-e489-4720-9318-53769b4c500e","Type":"ContainerStarted","Data":"cf1ca910307cef90bdb5b135db855b3e02d774454260783fd31cc81dc295d4c4"} Jun 09 09:53:41.947677 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.947649 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:41.965725 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965799 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965799 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965799 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965799 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965994 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.965994 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.965837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966103 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966157 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966157 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966250 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966250 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwg8s\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966250 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.966408 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.966268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.967128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.967556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969505 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969481 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969583 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969707 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969809 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969809 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.969901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.969830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.970235 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.970211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.970505 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.970486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:41.973937 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:41.973915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwg8s\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s\") pod \"alertmanager-main-0\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:42.043441 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:42.043408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:53:42.192237 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:42.192209 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:53:42.195141 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:53:42.195115 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c22514c_83d6_40a0_b8f3_f5cd55fa4812.slice/crio-6fb5e6e4aecb8fa341d885ef7e8da82be5d57cadf5b8a4f0dcb369cdc0000f04 WatchSource:0}: Error finding container 6fb5e6e4aecb8fa341d885ef7e8da82be5d57cadf5b8a4f0dcb369cdc0000f04: Status 404 returned error can't find the container with id 6fb5e6e4aecb8fa341d885ef7e8da82be5d57cadf5b8a4f0dcb369cdc0000f04 Jun 09 09:53:42.951821 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:42.951783 2561 generic.go:356] "Generic (PLEG): container finished" podID="2a7888aa-638b-414f-9ab0-22055b65ac48" containerID="26af5ab3f173e4910ea54d88926979937ff798bcdd83ebbdc3adc63e43dc405d" exitCode=0 Jun 09 09:53:42.952282 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:42.951868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mlmg" event={"ID":"2a7888aa-638b-414f-9ab0-22055b65ac48","Type":"ContainerDied","Data":"26af5ab3f173e4910ea54d88926979937ff798bcdd83ebbdc3adc63e43dc405d"} Jun 09 09:53:42.953368 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:42.953343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"6fb5e6e4aecb8fa341d885ef7e8da82be5d57cadf5b8a4f0dcb369cdc0000f04"} Jun 09 09:53:43.601852 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.601815 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:43.675378 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.675347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:43.731745 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.731710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:43.958852 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.958412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mlmg" event={"ID":"2a7888aa-638b-414f-9ab0-22055b65ac48","Type":"ContainerStarted","Data":"f865afb10449ca0e8e0bee142660faa6f4e01065b4d37ef95d78339fdd2d724c"} Jun 09 09:53:43.958852 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.958516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2mlmg" event={"ID":"2a7888aa-638b-414f-9ab0-22055b65ac48","Type":"ContainerStarted","Data":"f8a7bb41183b9013a842140ec3146384f03a40691b60823178ab3cccfc14f588"} Jun 09 09:53:43.960467 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.960446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" event={"ID":"a46209b2-e489-4720-9318-53769b4c500e","Type":"ContainerStarted","Data":"d43be88a031231c53362f457976f4267483c7e1d468a08368eb5ee7607fdb74d"} Jun 09 09:53:43.960577 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.960486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" event={"ID":"a46209b2-e489-4720-9318-53769b4c500e","Type":"ContainerStarted","Data":"6ee464ca445fb91c9efcbeadc946cd0cdae1fbbbd23c0bfb32214879ead60dfe"} Jun 09 09:53:43.960577 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.960508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" event={"ID":"a46209b2-e489-4720-9318-53769b4c500e","Type":"ContainerStarted","Data":"2d366e599a13c4426d86a20b4d03600b3db70698443f547cb596639150fca424"} Jun 09 09:53:43.961889 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.961862 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da" exitCode=0 Jun 09 09:53:43.961999 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.961910 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da"} Jun 09 09:53:43.976439 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:43.976401 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2mlmg" podStartSLOduration=3.033302546 podStartE2EDuration="3.976387398s" totalImagesPullingTime="875.670956ms" totalInitContainerRuntime="67.413896ms" isStatefulPod=true podCreationTimestamp="2026-06-09 09:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:43.975384636 +0000 UTC m=+230.313549030" watchObservedRunningTime="2026-06-09 09:53:43.976387398 +0000 UTC m=+230.314551790" Jun 09 09:53:44.019268 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:44.019200 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-6d7j4" podStartSLOduration=2.465645669 podStartE2EDuration="4.019187973s" totalImagesPullingTime="1.553542304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:44.018585702 +0000 UTC m=+230.356750095" watchObservedRunningTime="2026-06-09 09:53:44.019187973 +0000 UTC m=+230.357352368" Jun 09 09:53:44.205587 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:44.205505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:45.446462 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.446419 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:45.448864 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.448841 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd"] Jun 09 09:53:45.451617 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.451594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.453279 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.453258 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 09:53:45.453368 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.453258 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g9hbk\"" Jun 09 09:53:45.460310 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.460096 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd"] Jun 09 09:53:45.546459 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.546425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:45.599630 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.599597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.599776 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.599650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnknq\" (UniqueName: \"kubernetes.io/projected/00ff0fec-2750-4912-b0bc-fe137dd48992-kube-api-access-xnknq\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.700001 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.699976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.700123 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.700009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnknq\" (UniqueName: \"kubernetes.io/projected/00ff0fec-2750-4912-b0bc-fe137dd48992-kube-api-access-xnknq\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.700246 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:45.700139 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 09:53:45.700246 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:45.700203 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert podName:00ff0fec-2750-4912-b0bc-fe137dd48992 nodeName:}" failed. No retries permitted until 2026-06-09 09:53:46.200181061 +0000 UTC m=+232.538345443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-xhgpd" (UID: "00ff0fec-2750-4912-b0bc-fe137dd48992") : secret "monitoring-plugin-cert" not found Jun 09 09:53:45.708477 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.708455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnknq\" (UniqueName: \"kubernetes.io/projected/00ff0fec-2750-4912-b0bc-fe137dd48992-kube-api-access-xnknq\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:45.971343 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.971262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c"} Jun 09 09:53:45.971474 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.971349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93"} Jun 09 09:53:45.971474 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.971376 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c"} Jun 09 09:53:45.971474 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.971398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98"} Jun 09 09:53:45.971474 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:45.971422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0"} Jun 09 09:53:46.205565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.205524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:46.205736 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:46.205711 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 09:53:46.205781 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:53:46.205765 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert podName:00ff0fec-2750-4912-b0bc-fe137dd48992 nodeName:}" failed. No retries permitted until 2026-06-09 09:53:47.205750649 +0000 UTC m=+233.543915020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-xhgpd" (UID: "00ff0fec-2750-4912-b0bc-fe137dd48992") : secret "monitoring-plugin-cert" not found Jun 09 09:53:46.326894 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.326802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:46.427672 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.427635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:46.528439 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.528399 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:46.861957 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.861934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:46.978387 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:46.978353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerStarted","Data":"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d"} Jun 09 09:53:47.003401 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.003356 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.355646434 podStartE2EDuration="6.003340736s" totalImagesPullingTime="3.626803378s" totalInitContainerRuntime="20.890924ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:47.001882523 +0000 UTC m=+233.340046916" watchObservedRunningTime="2026-06-09 09:53:47.003340736 +0000 UTC m=+233.341505130" Jun 09 09:53:47.213957 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.213912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:47.216276 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.216245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00ff0fec-2750-4912-b0bc-fe137dd48992-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-xhgpd\" (UID: \"00ff0fec-2750-4912-b0bc-fe137dd48992\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:47.263452 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.263418 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:47.390140 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.390107 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd"] Jun 09 09:53:47.393031 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:53:47.393007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ff0fec_2750_4912_b0bc_fe137dd48992.slice/crio-67681cd36212e06c63a9f4b3067abccec988ad3660860a990585cabff77822fb WatchSource:0}: Error finding container 67681cd36212e06c63a9f4b3067abccec988ad3660860a990585cabff77822fb: Status 404 returned error can't find the container with id 67681cd36212e06c63a9f4b3067abccec988ad3660860a990585cabff77822fb Jun 09 09:53:47.983820 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:47.983787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" event={"ID":"00ff0fec-2750-4912-b0bc-fe137dd48992","Type":"ContainerStarted","Data":"67681cd36212e06c63a9f4b3067abccec988ad3660860a990585cabff77822fb"} Jun 09 09:53:48.988610 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:48.988578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" event={"ID":"00ff0fec-2750-4912-b0bc-fe137dd48992","Type":"ContainerStarted","Data":"d4df161d6c0b7479a8140296c057539b473535313e007000c0ad8863e99f650f"} Jun 09 09:53:48.989014 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:48.988706 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:48.993749 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:48.993726 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" Jun 09 09:53:49.002465 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:49.002426 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-xhgpd" podStartSLOduration=2.57446272 podStartE2EDuration="4.002413261s" totalImagesPullingTime="1.427950541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:49.002291333 +0000 UTC m=+235.340455750" watchObservedRunningTime="2026-06-09 09:53:49.002413261 +0000 UTC m=+235.340577654" Jun 09 09:53:50.527262 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:50.527229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:50.574150 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:50.574109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:51.116793 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:51.116760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:51.125537 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:51.125500 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" podUID="fd9c3af8-5964-40f0-a031-7c85b141818f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:53:51.215727 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:51.215692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:57.143308 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:57.143269 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:57.213008 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:57.212974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:53:58.340279 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:53:58.340243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:01.126093 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:01.126029 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" podUID="fd9c3af8-5964-40f0-a031-7c85b141818f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:54:02.174523 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:02.174485 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:02.230671 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:02.230641 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:02.289321 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:02.289283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:04.434608 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:04.434573 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:04.495371 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:04.495341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:05.061307 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:05.061273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:54:05.063650 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:05.063623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1-metrics-certs\") pod \"network-metrics-daemon-jpl6r\" (UID: \"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1\") " pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:54:05.120724 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:05.120697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hpd64\"" Jun 09 09:54:05.128959 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:05.128933 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jpl6r" Jun 09 09:54:05.254422 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:05.254340 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jpl6r"] Jun 09 09:54:05.256987 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:54:05.256957 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffa61bf_7e3a_4192_8ecf_87035f4bbfe1.slice/crio-612d7515fccea861e3840baf02becf58d826cf88c56a4bb2baca7cb305f82c76 WatchSource:0}: Error finding container 612d7515fccea861e3840baf02becf58d826cf88c56a4bb2baca7cb305f82c76: Status 404 returned error can't find the container with id 612d7515fccea861e3840baf02becf58d826cf88c56a4bb2baca7cb305f82c76 Jun 09 09:54:06.045119 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:06.045094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpl6r" event={"ID":"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1","Type":"ContainerStarted","Data":"612d7515fccea861e3840baf02becf58d826cf88c56a4bb2baca7cb305f82c76"} Jun 09 09:54:07.050182 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.050145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpl6r" event={"ID":"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1","Type":"ContainerStarted","Data":"7fd7e43c9e0dd3a7a59adc0f4c57c1daee793626a64a6812630dd4f75974a2d9"} Jun 09 09:54:07.050586 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.050205 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jpl6r" event={"ID":"3ffa61bf-7e3a-4192-8ecf-87035f4bbfe1","Type":"ContainerStarted","Data":"7a0a75fa60efad92a74edc5d4337bccbec83522212975ff306f88ea983a113f0"} Jun 09 09:54:07.066129 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.066048 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jpl6r" podStartSLOduration=252.290707356 podStartE2EDuration="4m13.066029121s" totalImagesPullingTime="775.321765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:54:07.065044249 +0000 UTC m=+253.403208664" watchObservedRunningTime="2026-06-09 09:54:07.066029121 +0000 UTC m=+253.404193515" Jun 09 09:54:07.177701 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.177666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:07.239221 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.239186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:07.795220 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.795184 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:07.851351 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:07.851320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:11.125777 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:11.125694 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" podUID="fd9c3af8-5964-40f0-a031-7c85b141818f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 09:54:11.125777 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:11.125765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" Jun 09 09:54:11.126344 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:11.126313 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ffef9b983178813bfd87a32cc736a1ff51e443ea5c62dc33f49e9676101e5ec8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 09:54:11.126385 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:11.126366 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" podUID="fd9c3af8-5964-40f0-a031-7c85b141818f" containerName="service-proxy" containerID="cri-o://ffef9b983178813bfd87a32cc736a1ff51e443ea5c62dc33f49e9676101e5ec8" gracePeriod=30 Jun 09 09:54:12.069796 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:12.069756 2561 generic.go:356] "Generic (PLEG): container finished" podID="fd9c3af8-5964-40f0-a031-7c85b141818f" containerID="ffef9b983178813bfd87a32cc736a1ff51e443ea5c62dc33f49e9676101e5ec8" exitCode=2 Jun 09 09:54:12.069962 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:12.069805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerDied","Data":"ffef9b983178813bfd87a32cc736a1ff51e443ea5c62dc33f49e9676101e5ec8"} Jun 09 09:54:12.069962 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:12.069840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6656b57968-2fg6g" event={"ID":"fd9c3af8-5964-40f0-a031-7c85b141818f","Type":"ContainerStarted","Data":"cbba690648ff22f34eb114e449bc1b781d80b4f5bd0f8ab0f0f5d2a002455d94"} Jun 09 09:54:17.294272 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:17.294233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:17.346931 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:17.346900 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:21.190818 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:21.190779 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:21.243558 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:21.243525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:22.259019 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:22.258981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/init-config-reloader/0.log" Jun 09 09:54:22.455944 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:22.455914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/alertmanager/0.log" Jun 09 09:54:22.655890 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:22.655855 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/config-reloader/0.log" Jun 09 09:54:22.856164 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:22.856133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/kube-rbac-proxy-web/0.log" Jun 09 09:54:23.056339 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:23.056257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/kube-rbac-proxy/0.log" Jun 09 09:54:23.256543 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:23.256511 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/kube-rbac-proxy-metric/0.log" Jun 09 09:54:23.458674 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:23.458622 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c22514c-83d6-40a0-b8f3-f5cd55fa4812/prom-label-proxy/0.log" Jun 09 09:54:23.857726 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:23.857699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-state-metrics/0.log" Jun 09 09:54:24.056106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:24.056059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-rbac-proxy-main/0.log" Jun 09 09:54:24.258056 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:24.257970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-rbac-proxy-self/0.log" Jun 09 09:54:24.656906 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:24.656878 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-xhgpd_00ff0fec-2750-4912-b0bc-fe137dd48992/monitoring-plugin/0.log" Jun 09 09:54:24.855317 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:24.855294 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/init-textfile/0.log" Jun 09 09:54:25.057238 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:25.057170 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/node-exporter/0.log" Jun 09 09:54:25.255687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:25.255651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/kube-rbac-proxy/0.log" Jun 09 09:54:26.750558 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:26.750515 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:26.812487 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:26.812455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:33.056416 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:33.056390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hj5nf_8ab09d4b-c5e5-4718-b06c-b5625af33450/dns-node-resolver/0.log" Jun 09 09:54:34.056487 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:34.056456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p27q_a6457218-4f7e-453e-9a2f-7ef803c28adf/node-ca/0.log" Jun 09 09:54:34.738408 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:54:34.738362 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xx6cd" podUID="e9dfb9f7-31d4-4f80-a353-736d0c19f79d" Jun 09 09:54:35.056794 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:35.056719 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4kvp_d7e001e2-a759-4934-8ec3-3e9ef644ec51/serve-healthcheck-canary/0.log" Jun 09 09:54:35.145332 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:35.145306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:36.317365 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:36.317322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:36.417658 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:36.417615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:38.423362 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:38.423323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:38.425622 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:38.425601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9dfb9f7-31d4-4f80-a353-736d0c19f79d-metrics-tls\") pod \"dns-default-xx6cd\" (UID: \"e9dfb9f7-31d4-4f80-a353-736d0c19f79d\") " pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:38.448542 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:38.448521 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ncfhc\"" Jun 09 09:54:38.456956 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:38.456939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:38.585796 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:38.585765 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xx6cd"] Jun 09 09:54:38.588410 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:54:38.588384 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dfb9f7_31d4_4f80_a353_736d0c19f79d.slice/crio-8cb6dbbc14420b8b1d8037f264b64115e020dfd0513e8c08e7036bf4d89fcf28 WatchSource:0}: Error finding container 8cb6dbbc14420b8b1d8037f264b64115e020dfd0513e8c08e7036bf4d89fcf28: Status 404 returned error can't find the container with id 8cb6dbbc14420b8b1d8037f264b64115e020dfd0513e8c08e7036bf4d89fcf28 Jun 09 09:54:39.163809 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:39.163775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xx6cd" event={"ID":"e9dfb9f7-31d4-4f80-a353-736d0c19f79d","Type":"ContainerStarted","Data":"8cb6dbbc14420b8b1d8037f264b64115e020dfd0513e8c08e7036bf4d89fcf28"} Jun 09 09:54:40.169412 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:40.169382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xx6cd" event={"ID":"e9dfb9f7-31d4-4f80-a353-736d0c19f79d","Type":"ContainerStarted","Data":"6d46301e7061fa4de8985d8aae84736776d2462401faafb6364fcff797043833"} Jun 09 09:54:41.173918 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:41.173882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xx6cd" event={"ID":"e9dfb9f7-31d4-4f80-a353-736d0c19f79d","Type":"ContainerStarted","Data":"5a4488953005c96432927e2cfde52ceb35ad9ecd83aa4eb60ee670f310ac2d57"} Jun 09 09:54:41.174292 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:41.173998 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:41.190765 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:41.190709 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xx6cd" podStartSLOduration=251.784376116 podStartE2EDuration="4m13.190695485s" totalImagesPullingTime="1.406319369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:54:41.190302212 +0000 UTC m=+287.528466604" watchObservedRunningTime="2026-06-09 09:54:41.190695485 +0000 UTC m=+287.528859879" Jun 09 09:54:46.003748 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:46.003709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:46.068156 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:46.068118 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:50.840184 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:50.840145 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:51.179654 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:51.179577 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xx6cd" Jun 09 09:54:51.967565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:51.967535 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:52.372484 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:52.372451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:52.472520 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:52.472484 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:52.532862 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:52.532828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:54.069529 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:54.069500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:54:54.069971 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:54.069794 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:54:54.075312 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:54.075291 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 09:54:55.922541 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:55.922505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:59.603241 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:59.603204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:59.702122 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:59.702046 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:54:59.906863 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:54:59.906774 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:00.141199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.141164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:00.980155 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980118 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:00.980528 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980418 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="alertmanager" containerID="cri-o://3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" gracePeriod=120 Jun 09 09:55:00.980528 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980502 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-web" containerID="cri-o://a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" gracePeriod=120 Jun 09 09:55:00.980631 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980532 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="config-reloader" containerID="cri-o://fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" gracePeriod=120 Jun 09 09:55:00.980631 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980551 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy" containerID="cri-o://df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" gracePeriod=120 Jun 09 09:55:00.980631 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980503 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="prom-label-proxy" containerID="cri-o://83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" gracePeriod=120 Jun 09 09:55:00.980766 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:00.980580 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-metric" containerID="cri-o://ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" gracePeriod=120 Jun 09 09:55:01.244324 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244240 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" exitCode=0 Jun 09 09:55:01.244324 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244263 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" exitCode=0 Jun 09 09:55:01.244324 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244269 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" exitCode=0 Jun 09 09:55:01.244324 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244276 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" exitCode=0 Jun 09 09:55:01.244633 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d"} Jun 09 09:55:01.244633 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93"} Jun 09 09:55:01.244633 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98"} Jun 09 09:55:01.244633 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.244471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0"} Jun 09 09:55:01.347355 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.347321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:01.403589 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:01.403550 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:02.229169 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.229142 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.250510 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250483 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" exitCode=0 Jun 09 09:55:02.250510 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250505 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerID="a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" exitCode=0 Jun 09 09:55:02.250687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c"} Jun 09 09:55:02.250687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250558 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.250687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250600 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c"} Jun 09 09:55:02.250687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c22514c-83d6-40a0-b8f3-f5cd55fa4812","Type":"ContainerDied","Data":"6fb5e6e4aecb8fa341d885ef7e8da82be5d57cadf5b8a4f0dcb369cdc0000f04"} Jun 09 09:55:02.250687 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.250669 2561 scope.go:117] "RemoveContainer" containerID="83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" Jun 09 09:55:02.259730 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.259712 2561 scope.go:117] "RemoveContainer" containerID="ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" Jun 09 09:55:02.268249 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.268236 2561 scope.go:117] "RemoveContainer" containerID="df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" Jun 09 09:55:02.276012 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.275993 2561 scope.go:117] "RemoveContainer" containerID="a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" Jun 09 09:55:02.282286 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.282262 2561 scope.go:117] "RemoveContainer" containerID="fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" Jun 09 09:55:02.288970 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.288942 2561 scope.go:117] "RemoveContainer" containerID="3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" Jun 09 09:55:02.295640 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.295621 2561 scope.go:117] "RemoveContainer" containerID="5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da" Jun 09 09:55:02.302322 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.302305 2561 scope.go:117] "RemoveContainer" containerID="83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" Jun 09 09:55:02.302573 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.302549 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d\": container with ID starting with 83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d not found: ID does not exist" containerID="83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" Jun 09 09:55:02.302656 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.302579 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d"} err="failed to get container status \"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d\": rpc error: code = NotFound desc = could not find container \"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d\": container with ID starting with 83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d not found: ID does not exist" Jun 09 09:55:02.302656 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.302597 2561 scope.go:117] "RemoveContainer" containerID="ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" Jun 09 09:55:02.302844 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.302827 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c\": container with ID starting with ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c not found: ID does not exist" containerID="ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" Jun 09 09:55:02.302908 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.302854 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c"} err="failed to get container status \"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c\": rpc error: code = NotFound desc = could not find container \"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c\": container with ID starting with ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c not found: ID does not exist" Jun 09 09:55:02.302908 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.302878 2561 scope.go:117] "RemoveContainer" containerID="df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" Jun 09 09:55:02.303164 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.303138 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93\": container with ID starting with df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93 not found: ID does not exist" containerID="df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" Jun 09 09:55:02.303244 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303161 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93"} err="failed to get container status \"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93\": rpc error: code = NotFound desc = could not find container \"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93\": container with ID starting with df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93 not found: ID does not exist" Jun 09 09:55:02.303244 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303177 2561 scope.go:117] "RemoveContainer" containerID="a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" Jun 09 09:55:02.303444 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.303422 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c\": container with ID starting with a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c not found: ID does not exist" containerID="a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" Jun 09 09:55:02.303491 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303452 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c"} err="failed to get container status \"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c\": rpc error: code = NotFound desc = could not find container \"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c\": container with ID starting with a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c not found: ID does not exist" Jun 09 09:55:02.303491 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303477 2561 scope.go:117] "RemoveContainer" containerID="fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" Jun 09 09:55:02.303714 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.303696 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98\": container with ID starting with fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98 not found: ID does not exist" containerID="fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" Jun 09 09:55:02.303767 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303719 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98"} err="failed to get container status \"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98\": rpc error: code = NotFound desc = could not find container \"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98\": container with ID starting with fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98 not found: ID does not exist" Jun 09 09:55:02.303767 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303736 2561 scope.go:117] "RemoveContainer" containerID="3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" Jun 09 09:55:02.303976 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.303951 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0\": container with ID starting with 3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0 not found: ID does not exist" containerID="3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" Jun 09 09:55:02.304025 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303972 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0"} err="failed to get container status \"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0\": rpc error: code = NotFound desc = could not find container \"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0\": container with ID starting with 3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0 not found: ID does not exist" Jun 09 09:55:02.304025 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.303991 2561 scope.go:117] "RemoveContainer" containerID="5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da" Jun 09 09:55:02.304270 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:55:02.304245 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da\": container with ID starting with 5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da not found: ID does not exist" containerID="5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da" Jun 09 09:55:02.304319 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304278 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da"} err="failed to get container status \"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da\": rpc error: code = NotFound desc = could not find container \"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da\": container with ID starting with 5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da not found: ID does not exist" Jun 09 09:55:02.304319 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304298 2561 scope.go:117] "RemoveContainer" containerID="83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d" Jun 09 09:55:02.304551 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304533 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d"} err="failed to get container status \"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d\": rpc error: code = NotFound desc = could not find container \"83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d\": container with ID starting with 83d17cddf7da25a82ba5c30358bb92c7d03e075249f7929b9f14fbb82be7f53d not found: ID does not exist" Jun 09 09:55:02.304591 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304553 2561 scope.go:117] "RemoveContainer" containerID="ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c" Jun 09 09:55:02.304767 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304750 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c"} err="failed to get container status \"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c\": rpc error: code = NotFound desc = could not find container \"ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c\": container with ID starting with ec0a5b5d138be5f1a75d535f3bad52afdf467f0239501beff5ee878a0eb5793c not found: ID does not exist" Jun 09 09:55:02.304809 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304769 2561 scope.go:117] "RemoveContainer" containerID="df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93" Jun 09 09:55:02.304993 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304971 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93"} err="failed to get container status \"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93\": rpc error: code = NotFound desc = could not find container \"df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93\": container with ID starting with df7e6571cc0e7c52fd1bd5d617cd0be365ca5a284a8092d2e49c090870232b93 not found: ID does not exist" Jun 09 09:55:02.305029 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.304995 2561 scope.go:117] "RemoveContainer" containerID="a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c" Jun 09 09:55:02.305238 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305218 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c"} err="failed to get container status \"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c\": rpc error: code = NotFound desc = could not find container \"a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c\": container with ID starting with a2c669e37ce09a1828cc8cea8cb6c1160b5926f6b5a74e7f6abc1b17922b149c not found: ID does not exist" Jun 09 09:55:02.305291 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305240 2561 scope.go:117] "RemoveContainer" containerID="fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98" Jun 09 09:55:02.305425 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305405 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98"} err="failed to get container status \"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98\": rpc error: code = NotFound desc = could not find container \"fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98\": container with ID starting with fc6c891e3aae33c1e5c259e0de6fa2ae6564f0dd495fdcd8342daeefe02c0e98 not found: ID does not exist" Jun 09 09:55:02.305468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305428 2561 scope.go:117] "RemoveContainer" containerID="3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0" Jun 09 09:55:02.305653 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305635 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0"} err="failed to get container status \"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0\": rpc error: code = NotFound desc = could not find container \"3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0\": container with ID starting with 3291241ccdab14009a764d686e746beeccace7078b49ad7040306c7ab5ef1df0 not found: ID does not exist" Jun 09 09:55:02.305653 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305655 2561 scope.go:117] "RemoveContainer" containerID="5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da" Jun 09 09:55:02.305911 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.305889 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da"} err="failed to get container status \"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da\": rpc error: code = NotFound desc = could not find container \"5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da\": container with ID starting with 5ae63cc648f9cd711679398a007268f4d78c708b9c41e624e12c39cb33ed72da not found: ID does not exist" Jun 09 09:55:02.407794 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407758 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.407794 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407800 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407821 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407890 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407922 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407938 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407971 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408017 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.407996 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwg8s\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408407 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.408021 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408407 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.408056 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408407 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.408111 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.408407 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.408150 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web\") pod \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\" (UID: \"9c22514c-83d6-40a0-b8f3-f5cd55fa4812\") " Jun 09 09:55:02.409400 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.409367 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:55:02.409613 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.409585 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:55:02.409761 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.409731 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 09:55:02.411016 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.410987 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume" (OuterVolumeSpecName: "config-volume") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.411532 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.411453 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.411532 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.411473 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.411532 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.411491 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:55:02.411717 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.411650 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.411717 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.411682 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s" (OuterVolumeSpecName: "kube-api-access-kwg8s") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "kube-api-access-kwg8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 09:55:02.412212 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.412193 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out" (OuterVolumeSpecName: "config-out") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 09:55:02.412394 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.412376 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.414803 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.414772 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.421285 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.421265 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config" (OuterVolumeSpecName: "web-config") pod "9c22514c-83d6-40a0-b8f3-f5cd55fa4812" (UID: "9c22514c-83d6-40a0-b8f3-f5cd55fa4812"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 09:55:02.508855 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508817 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-cluster-tls-config\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.508855 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508851 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-main-db\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508865 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-tls-assets\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508882 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508896 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwg8s\" (UniqueName: \"kubernetes.io/projected/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-kube-api-access-kwg8s\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508907 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-out\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508919 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508930 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-metrics-client-ca\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508942 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508955 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-main-tls\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.508966 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.509007 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-web-config\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.509110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.509019 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c22514c-83d6-40a0-b8f3-f5cd55fa4812-config-volume\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 09:55:02.572640 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.572613 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:02.577682 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.577653 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:02.606525 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606493 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:02.606783 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606767 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="alertmanager" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606786 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="alertmanager" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606801 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-web" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606809 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-web" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606824 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="config-reloader" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606834 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="config-reloader" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606848 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="prom-label-proxy" Jun 09 09:55:02.606856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606856 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="prom-label-proxy" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606867 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="init-config-reloader" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606876 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="init-config-reloader" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606886 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606894 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606917 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-metric" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606925 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-metric" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606988 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-web" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.606999 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.607007 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="prom-label-proxy" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.607016 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="alertmanager" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.607024 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="config-reloader" Jun 09 09:55:02.607211 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.607032 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" containerName="kube-rbac-proxy-metric" Jun 09 09:55:02.613089 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.613056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.614995 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.614961 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 09:55:02.614995 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.614982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 09:55:02.615199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.614982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 09:55:02.615199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.615028 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 09:55:02.615199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.614983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d8tsl\"" Jun 09 09:55:02.615199 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.615009 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 09:55:02.615408 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.615331 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 09:55:02.615539 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.615520 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 09:55:02.615624 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.615580 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 09:55:02.621565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.621545 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 09:55:02.625342 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.625319 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:02.709892 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.709856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-out\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.709892 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.709892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.709917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.709932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.709986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710106 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swffl\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-kube-api-access-swffl\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-web-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.710274 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.710231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.810922 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.810922 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.810922 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-web-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.810922 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-out\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.810993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811181 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811833 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swffl\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-kube-api-access-swffl\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.811952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.811887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.812344 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.812174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.812521 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.812492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814159 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814159 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-out\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814159 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-web-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814159 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814332 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-config-volume\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814462 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814697 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.814810 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.814795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.815987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.815966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.819288 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.819271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swffl\" (UniqueName: \"kubernetes.io/projected/2141d8ec-1f93-4306-8ac1-887ac66ce0ec-kube-api-access-swffl\") pod \"alertmanager-main-0\" (UID: \"2141d8ec-1f93-4306-8ac1-887ac66ce0ec\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:02.923359 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:02.923315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 09:55:03.054974 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:03.054942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 09:55:03.057905 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:55:03.057864 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2141d8ec_1f93_4306_8ac1_887ac66ce0ec.slice/crio-fbdf0e93be98f44dce728155f73516bf75f6aa9a446a7ecabd20ea87f4044535 WatchSource:0}: Error finding container fbdf0e93be98f44dce728155f73516bf75f6aa9a446a7ecabd20ea87f4044535: Status 404 returned error can't find the container with id fbdf0e93be98f44dce728155f73516bf75f6aa9a446a7ecabd20ea87f4044535 Jun 09 09:55:03.256670 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:03.256634 2561 generic.go:356] "Generic (PLEG): container finished" podID="2141d8ec-1f93-4306-8ac1-887ac66ce0ec" containerID="5cdd6c51a4b9709b7e25313aa7e68bc0ec8d9c198eca91901fb15ef8bf2b92e7" exitCode=0 Jun 09 09:55:03.257022 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:03.256717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerDied","Data":"5cdd6c51a4b9709b7e25313aa7e68bc0ec8d9c198eca91901fb15ef8bf2b92e7"} Jun 09 09:55:03.257022 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:03.256793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"fbdf0e93be98f44dce728155f73516bf75f6aa9a446a7ecabd20ea87f4044535"} Jun 09 09:55:04.124115 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.124082 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c22514c-83d6-40a0-b8f3-f5cd55fa4812" path="/var/lib/kubelet/pods/9c22514c-83d6-40a0-b8f3-f5cd55fa4812/volumes" Jun 09 09:55:04.263130 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"b04b1c76c436d75159e09a0392724b222137d2cd1834ab11dc954845b2271ef5"} Jun 09 09:55:04.263565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"07a2c658877d3bf9c86c911abc872915e89796d011c4dd011973498d9be28b24"} Jun 09 09:55:04.263565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"51b00e45f7920e73565d91f9205949915584d4fe0d8716ee3e403a8154b39be1"} Jun 09 09:55:04.263565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"58b0744dfee84eb24ea40f09d8b19467dea9e5f92770d675e6808234fceb564f"} Jun 09 09:55:04.263565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"19e3a5de545cc0d050cabe750c18b05bf1da44fcb638b4b45f7f56d849b92442"} Jun 09 09:55:04.263565 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.263254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2141d8ec-1f93-4306-8ac1-887ac66ce0ec","Type":"ContainerStarted","Data":"0348824beb08939eeaa88d1691ca77bda36bcbf2aea4700584721a4f5602dd3c"} Jun 09 09:55:04.290742 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:04.290701 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.276419747 podStartE2EDuration="2.290682236s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.262489ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:55:04.288883317 +0000 UTC m=+310.627047712" watchObservedRunningTime="2026-06-09 09:55:04.290682236 +0000 UTC m=+310.628846694" Jun 09 09:55:05.000110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.000059 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb"] Jun 09 09:55:05.003649 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.003628 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.005353 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.005328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 09:55:05.005470 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.005387 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 09:55:05.005909 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.005893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 09:55:05.005970 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.005893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v5zc7\"" Jun 09 09:55:05.005970 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.005938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 09:55:05.006275 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.006263 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 09:55:05.012241 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.012224 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 09:55:05.018400 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.018379 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb"] Jun 09 09:55:05.129859 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.129960 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-serving-certs-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.129960 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-federate-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.129960 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-metrics-client-ca\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.129960 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.130109 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.129962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7p9\" (UniqueName: \"kubernetes.io/projected/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-kube-api-access-zj7p9\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.130109 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.130014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.130109 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.130034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.230778 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.230743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-serving-certs-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.230955 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.230788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-federate-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.230955 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.230889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-metrics-client-ca\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.230955 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.230916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.230955 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.230950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7p9\" (UniqueName: \"kubernetes.io/projected/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-kube-api-access-zj7p9\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.231158 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.231007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.231158 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.231035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.231318 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.231286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.231665 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.231638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-serving-certs-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.231768 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.231680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-metrics-client-ca\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.232130 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.232109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.233431 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.233399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.233544 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.233529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-federate-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.233927 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.233903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-secret-telemeter-client\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.234002 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.233925 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-telemeter-client-tls\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.242275 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.242256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7p9\" (UniqueName: \"kubernetes.io/projected/1d62f279-3776-4ea2-b5b6-67f3ee6dd187-kube-api-access-zj7p9\") pod \"telemeter-client-75f6c8ccf8-q75fb\" (UID: \"1d62f279-3776-4ea2-b5b6-67f3ee6dd187\") " pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.314436 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.314358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" Jun 09 09:55:05.443505 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.443478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb"] Jun 09 09:55:05.447779 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:55:05.447749 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d62f279_3776_4ea2_b5b6_67f3ee6dd187.slice/crio-40fdbe2dc33e277338b273f09dddf48466e01d84d0045a72ca61f91f58157d70 WatchSource:0}: Error finding container 40fdbe2dc33e277338b273f09dddf48466e01d84d0045a72ca61f91f58157d70: Status 404 returned error can't find the container with id 40fdbe2dc33e277338b273f09dddf48466e01d84d0045a72ca61f91f58157d70 Jun 09 09:55:05.450104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.450087 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 09:55:05.935090 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:05.935035 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:06.035336 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:06.035274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:06.234149 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:06.234059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:06.271446 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:06.271410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" event={"ID":"1d62f279-3776-4ea2-b5b6-67f3ee6dd187","Type":"ContainerStarted","Data":"40fdbe2dc33e277338b273f09dddf48466e01d84d0045a72ca61f91f58157d70"} Jun 09 09:55:06.350929 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:06.350881 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:07.276777 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:07.276746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" event={"ID":"1d62f279-3776-4ea2-b5b6-67f3ee6dd187","Type":"ContainerStarted","Data":"569f81086315e36a98476456a2c29a7d0f9312313eebf8d17abfad9c8705c433"} Jun 09 09:55:07.396382 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:07.396348 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:07.495050 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:07.494958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:07.612285 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:07.612248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:08.282744 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:08.282707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" event={"ID":"1d62f279-3776-4ea2-b5b6-67f3ee6dd187","Type":"ContainerStarted","Data":"21bebe02705048cad7914c3face98b0b44b5744ecef4475def383927db851320"} Jun 09 09:55:08.282918 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:08.282768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" event={"ID":"1d62f279-3776-4ea2-b5b6-67f3ee6dd187","Type":"ContainerStarted","Data":"01abf3467eca70215301dabe0d841c25434958464c91541ce1549db2e570754d"} Jun 09 09:55:08.305730 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:08.305670 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75f6c8ccf8-q75fb" podStartSLOduration=2.578657627 podStartE2EDuration="4.305654545s" totalImagesPullingTime="1.726996918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:55:08.304154355 +0000 UTC m=+314.642318748" watchObservedRunningTime="2026-06-09 09:55:08.305654545 +0000 UTC m=+314.643818929" Jun 09 09:55:09.061894 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:09.061840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:09.159588 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:09.159538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:15.013883 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:15.013839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:15.114847 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:15.114811 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:19.847693 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:19.847663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:19.952697 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:19.952662 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:20.046750 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:20.046719 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:21.218241 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:21.218195 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:21.317938 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:21.317904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:36.270451 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:36.270410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:36.456993 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:36.456955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:50.306535 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:50.306451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:55:50.371519 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:55:50.371476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:15.320035 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:15.319998 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:15.522436 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:15.522396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:24.792894 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:24.792864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:25.080321 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:25.080236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:25.184257 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:25.184222 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:27.186527 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:27.186486 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:27.261551 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:27.261517 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:36.032479 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:36.032446 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:36.136950 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:36.136913 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:36.261158 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:36.261113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:36.356176 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:36.356138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:36.708010 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:36.707924 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:56:55.987401 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:56:55.987368 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:24.048459 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:24.048373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:24.143696 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:24.143665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:50.747818 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:50.747767 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:51.754087 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:51.754041 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:54.602611 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:54.602576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:54.697476 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:54.697441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:55.520535 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:55.520505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:55.642414 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:55.642380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:55.747462 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:55.747428 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:59.263246 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:59.263199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:57:59.565205 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:57:59.565116 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:00.925422 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.925385 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9"] Jun 09 09:58:00.928549 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.928531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:00.930397 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.930375 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 09:58:00.930615 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.930598 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8rq7k\"" Jun 09 09:58:00.930729 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.930624 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 09:58:00.970122 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:00.970088 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9"] Jun 09 09:58:01.072588 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.072547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkppz\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-kube-api-access-pkppz\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.072759 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.072638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.173441 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.173392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.173441 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.173445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkppz\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-kube-api-access-pkppz\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.182860 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.182789 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.182965 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.182944 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkppz\" (UniqueName: \"kubernetes.io/projected/2c300b82-d214-4ad9-8cab-d9940ca8bc99-kube-api-access-pkppz\") pod \"cert-manager-cainjector-5d99449ffd-zwhk9\" (UID: \"2c300b82-d214-4ad9-8cab-d9940ca8bc99\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.237833 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.237797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" Jun 09 09:58:01.346597 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.346562 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:01.365382 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.365349 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9"] Jun 09 09:58:01.368197 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:58:01.368161 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c300b82_d214_4ad9_8cab_d9940ca8bc99.slice/crio-d33f93ea494d26d63cbcae267f007eee82170df14056debc3300e2b44c593ded WatchSource:0}: Error finding container d33f93ea494d26d63cbcae267f007eee82170df14056debc3300e2b44c593ded: Status 404 returned error can't find the container with id d33f93ea494d26d63cbcae267f007eee82170df14056debc3300e2b44c593ded Jun 09 09:58:01.448308 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.448212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:01.892483 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:01.892444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" event={"ID":"2c300b82-d214-4ad9-8cab-d9940ca8bc99","Type":"ContainerStarted","Data":"d33f93ea494d26d63cbcae267f007eee82170df14056debc3300e2b44c593ded"} Jun 09 09:58:04.722271 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:04.722236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:04.906320 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:04.906288 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" event={"ID":"2c300b82-d214-4ad9-8cab-d9940ca8bc99","Type":"ContainerStarted","Data":"c4801c3f116c0ca0fc2d00a1047dda63ef3fa0526a146692280624cfded3b2d8"} Jun 09 09:58:04.925002 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:04.924952 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zwhk9" podStartSLOduration=2.268234611 podStartE2EDuration="4.924934776s" totalImagesPullingTime="2.656700165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:58:04.92371791 +0000 UTC m=+491.261882302" watchObservedRunningTime="2026-06-09 09:58:04.924934776 +0000 UTC m=+491.263099169" Jun 09 09:58:06.774721 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:06.774687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:11.565397 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:11.565361 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:11.662538 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:11.662503 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:13.377668 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.377638 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv"] Jun 09 09:58:13.380650 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.380631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.382933 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.382914 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 09:58:13.383038 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.382956 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wqwt8\"" Jun 09 09:58:13.383038 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.382914 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 09:58:13.391634 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.391612 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv"] Jun 09 09:58:13.479083 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.479036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd85w\" (UniqueName: \"kubernetes.io/projected/c617ebb5-e54d-4648-9b81-d93f99fce2ea-kube-api-access-dd85w\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.479292 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.479146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c617ebb5-e54d-4648-9b81-d93f99fce2ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.579678 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.579646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c617ebb5-e54d-4648-9b81-d93f99fce2ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.579856 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.579724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd85w\" (UniqueName: \"kubernetes.io/projected/c617ebb5-e54d-4648-9b81-d93f99fce2ea-kube-api-access-dd85w\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.580050 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.580030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c617ebb5-e54d-4648-9b81-d93f99fce2ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.588927 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.588904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd85w\" (UniqueName: \"kubernetes.io/projected/c617ebb5-e54d-4648-9b81-d93f99fce2ea-kube-api-access-dd85w\") pod \"openshift-lws-operator-fd8ccff4c-cfnrv\" (UID: \"c617ebb5-e54d-4648-9b81-d93f99fce2ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.689801 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.689721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" Jun 09 09:58:13.814045 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.814015 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv"] Jun 09 09:58:13.817447 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:58:13.817418 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc617ebb5_e54d_4648_9b81_d93f99fce2ea.slice/crio-a3dc1c15ca03a8fd0de8bb93757c3ac0c7d1ff02ccb947f91067567f9e4dd16d WatchSource:0}: Error finding container a3dc1c15ca03a8fd0de8bb93757c3ac0c7d1ff02ccb947f91067567f9e4dd16d: Status 404 returned error can't find the container with id a3dc1c15ca03a8fd0de8bb93757c3ac0c7d1ff02ccb947f91067567f9e4dd16d Jun 09 09:58:13.939447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:13.939413 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" event={"ID":"c617ebb5-e54d-4648-9b81-d93f99fce2ea","Type":"ContainerStarted","Data":"a3dc1c15ca03a8fd0de8bb93757c3ac0c7d1ff02ccb947f91067567f9e4dd16d"} Jun 09 09:58:16.951943 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:16.951906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" event={"ID":"c617ebb5-e54d-4648-9b81-d93f99fce2ea","Type":"ContainerStarted","Data":"a65b2acb813bd7eea7747fbaf8d44605f931513efa7b8b25202beaa90ef5152a"} Jun 09 09:58:16.967946 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:16.967896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cfnrv" podStartSLOduration=1.4679430390000001 podStartE2EDuration="3.967882026s" totalImagesPullingTime="2.499938987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:58:16.966640022 +0000 UTC m=+503.304804428" watchObservedRunningTime="2026-06-09 09:58:16.967882026 +0000 UTC m=+503.306046419" Jun 09 09:58:17.592234 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:17.592204 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:17.693179 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:17.693145 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:19.535232 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:19.535196 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:32.559820 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:32.559775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:32.662081 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:32.662040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.181018 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.180986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.365401 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.365366 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.469187 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.469153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.531016 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.530981 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp"] Jun 09 09:58:33.534484 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.534466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.536714 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.536686 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 09:58:33.536848 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.536749 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 09:58:33.536920 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.536853 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 09:58:33.537007 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.536988 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 09:58:33.537444 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.537424 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r4fm8\"" Jun 09 09:58:33.552804 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.552781 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp"] Jun 09 09:58:33.635628 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.635530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-manifests\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.635628 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.635573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-tmp\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.636116 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.635679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.636116 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.635753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-886mh\" (UniqueName: \"kubernetes.io/projected/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-kube-api-access-886mh\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.636116 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.635786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.685529 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.685496 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.736722 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.736685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.736901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.736729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-886mh\" (UniqueName: \"kubernetes.io/projected/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-kube-api-access-886mh\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.736901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.736746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.736901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.736769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-manifests\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.736901 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.736791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-tmp\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.737215 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.737191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-manifests\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.739021 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.738991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-tmp\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.739465 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.739443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.739532 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.739443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.744380 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.744361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-886mh\" (UniqueName: \"kubernetes.io/projected/4ffa4c18-3d7a-4c98-befa-f2321c6d127a-kube-api-access-886mh\") pod \"opendatahub-operator-controller-manager-66d57cfb98-bpljp\" (UID: \"4ffa4c18-3d7a-4c98-befa-f2321c6d127a\") " pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.785032 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.784993 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.845287 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.845256 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:33.888668 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.888590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:33.987057 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.987008 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp"] Jun 09 09:58:33.989960 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:58:33.989934 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffa4c18_3d7a_4c98_befa_f2321c6d127a.slice/crio-a21f1194b587807f0a5e80d3e917a7dd9069bf55c1e02951c73464c4361007b3 WatchSource:0}: Error finding container a21f1194b587807f0a5e80d3e917a7dd9069bf55c1e02951c73464c4361007b3: Status 404 returned error can't find the container with id a21f1194b587807f0a5e80d3e917a7dd9069bf55c1e02951c73464c4361007b3 Jun 09 09:58:33.993196 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:33.993164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:34.013745 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:34.013717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" event={"ID":"4ffa4c18-3d7a-4c98-befa-f2321c6d127a","Type":"ContainerStarted","Data":"a21f1194b587807f0a5e80d3e917a7dd9069bf55c1e02951c73464c4361007b3"} Jun 09 09:58:34.094694 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:34.094656 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:34.188330 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:34.188248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:34.289335 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:34.289306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:37.029479 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:37.029391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" event={"ID":"4ffa4c18-3d7a-4c98-befa-f2321c6d127a","Type":"ContainerStarted","Data":"a227f07f3c3a0f87562b26015f3275fe6f348ab9b604aa6d82e8cc9668f4ca2e"} Jun 09 09:58:37.793766 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:37.793723 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:37.926718 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:37.926687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:38.035667 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:38.035631 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ffa4c18-3d7a-4c98-befa-f2321c6d127a" containerID="a227f07f3c3a0f87562b26015f3275fe6f348ab9b604aa6d82e8cc9668f4ca2e" exitCode=0 Jun 09 09:58:38.036085 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:38.035717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" event={"ID":"4ffa4c18-3d7a-4c98-befa-f2321c6d127a","Type":"ContainerDied","Data":"a227f07f3c3a0f87562b26015f3275fe6f348ab9b604aa6d82e8cc9668f4ca2e"} Jun 09 09:58:39.041858 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:39.041826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" event={"ID":"4ffa4c18-3d7a-4c98-befa-f2321c6d127a","Type":"ContainerStarted","Data":"bb470c65514e57d56d80d614dea5cc1394f02e0c474b8ea64af0ff2ce330b011"} Jun 09 09:58:39.042269 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:39.041936 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:39.065026 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:39.064973 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" podStartSLOduration=1.9912913479999999 podStartE2EDuration="6.064953731s" totalImagesPullingTime="3.022054924s" totalInitContainerRuntime="1.051607459s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:58:39.063599014 +0000 UTC m=+525.401763407" watchObservedRunningTime="2026-06-09 09:58:39.064953731 +0000 UTC m=+525.403118128" Jun 09 09:58:44.122882 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:44.122838 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:44.222789 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:44.222753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:50.048060 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:50.048033 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66d57cfb98-bpljp" Jun 09 09:58:52.182128 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.182092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:52.292450 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.292413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:52.752061 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.752023 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n48lk"] Jun 09 09:58:52.759377 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.759348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:52.761479 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.761462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 09:58:52.762148 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.762132 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8wgqw\"" Jun 09 09:58:52.773946 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.773923 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n48lk"] Jun 09 09:58:52.787148 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.787122 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:52.886468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.886435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:52.903573 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.903538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:52.903573 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:52.903578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnpq\" (UniqueName: \"kubernetes.io/projected/f6012752-aac5-465f-904c-1759a1f3ef5d-kube-api-access-pnnpq\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.004696 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.004606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.004696 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.004651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnpq\" (UniqueName: \"kubernetes.io/projected/f6012752-aac5-465f-904c-1759a1f3ef5d-kube-api-access-pnnpq\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.004880 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:58:53.004770 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 09:58:53.004880 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:58:53.004834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert podName:f6012752-aac5-465f-904c-1759a1f3ef5d nodeName:}" failed. No retries permitted until 2026-06-09 09:58:53.504817587 +0000 UTC m=+539.842981959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert") pod "odh-model-controller-6dc94f689f-n48lk" (UID: "f6012752-aac5-465f-904c-1759a1f3ef5d") : secret "odh-model-controller-webhook-cert" not found Jun 09 09:58:53.017496 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.017475 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnpq\" (UniqueName: \"kubernetes.io/projected/f6012752-aac5-465f-904c-1759a1f3ef5d-kube-api-access-pnnpq\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.193757 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.193721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:53.324108 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.324006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:53.348728 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.348703 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hm57j"] Jun 09 09:58:53.351200 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.351183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.352890 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.352869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 09:58:53.352992 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.352908 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rflzc\"" Jun 09 09:58:53.364427 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.364401 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hm57j"] Jun 09 09:58:53.507806 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.507771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b7fe1ae-e432-48aa-b430-29536cf141e0-tls-certs\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.507806 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.507811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85nwx\" (UniqueName: \"kubernetes.io/projected/8b7fe1ae-e432-48aa-b430-29536cf141e0-kube-api-access-85nwx\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.508012 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.507841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.510127 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.510104 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6012752-aac5-465f-904c-1759a1f3ef5d-cert\") pod \"odh-model-controller-6dc94f689f-n48lk\" (UID: \"f6012752-aac5-465f-904c-1759a1f3ef5d\") " pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.609124 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.609063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b7fe1ae-e432-48aa-b430-29536cf141e0-tls-certs\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.609305 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.609131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nwx\" (UniqueName: \"kubernetes.io/projected/8b7fe1ae-e432-48aa-b430-29536cf141e0-kube-api-access-85nwx\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.611520 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.611473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b7fe1ae-e432-48aa-b430-29536cf141e0-tls-certs\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.612203 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.612174 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:53.620420 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.620393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85nwx\" (UniqueName: \"kubernetes.io/projected/8b7fe1ae-e432-48aa-b430-29536cf141e0-kube-api-access-85nwx\") pod \"model-serving-api-5dd488fc48-hm57j\" (UID: \"8b7fe1ae-e432-48aa-b430-29536cf141e0\") " pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.665115 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.665058 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:53.670834 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.670804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:53.809703 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.809667 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hm57j"] Jun 09 09:58:53.813401 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:58:53.813378 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7fe1ae_e432_48aa_b430_29536cf141e0.slice/crio-c78ae631ecbe9582fa2af3abbdf65de573e50223be8c33cda6ea2439b413c217 WatchSource:0}: Error finding container c78ae631ecbe9582fa2af3abbdf65de573e50223be8c33cda6ea2439b413c217: Status 404 returned error can't find the container with id c78ae631ecbe9582fa2af3abbdf65de573e50223be8c33cda6ea2439b413c217 Jun 09 09:58:53.824040 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:53.824018 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-n48lk"] Jun 09 09:58:53.826406 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:58:53.826385 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6012752_aac5_465f_904c_1759a1f3ef5d.slice/crio-07e207c1ceef01a69faa731e512756add23ae5d8e921ac10b6f2cfd10e1b9858 WatchSource:0}: Error finding container 07e207c1ceef01a69faa731e512756add23ae5d8e921ac10b6f2cfd10e1b9858: Status 404 returned error can't find the container with id 07e207c1ceef01a69faa731e512756add23ae5d8e921ac10b6f2cfd10e1b9858 Jun 09 09:58:54.106564 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:54.106523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" event={"ID":"f6012752-aac5-465f-904c-1759a1f3ef5d","Type":"ContainerStarted","Data":"07e207c1ceef01a69faa731e512756add23ae5d8e921ac10b6f2cfd10e1b9858"} Jun 09 09:58:54.107718 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:54.107681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" event={"ID":"8b7fe1ae-e432-48aa-b430-29536cf141e0","Type":"ContainerStarted","Data":"c78ae631ecbe9582fa2af3abbdf65de573e50223be8c33cda6ea2439b413c217"} Jun 09 09:58:55.551385 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.551236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:55.650703 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.650627 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:55.728945 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.727480 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb"] Jun 09 09:58:55.736164 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.735623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.738643 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.737860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 09:58:55.738643 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.738222 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 09:58:55.738643 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.738420 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 09:58:55.738643 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.738462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bvjqk\"" Jun 09 09:58:55.738906 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.738795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb"] Jun 09 09:58:55.738906 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.738883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 09:58:55.830614 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.830511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76afe536-214f-48fa-a317-a4b211734770-tmp\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.830774 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.830618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chfwb\" (UniqueName: \"kubernetes.io/projected/76afe536-214f-48fa-a317-a4b211734770-kube-api-access-chfwb\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.830774 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.830645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.932987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.932257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76afe536-214f-48fa-a317-a4b211734770-tmp\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.932987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.932343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chfwb\" (UniqueName: \"kubernetes.io/projected/76afe536-214f-48fa-a317-a4b211734770-kube-api-access-chfwb\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.932987 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.932370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.932987 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:58:55.932502 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 09:58:55.932987 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:58:55.932575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs podName:76afe536-214f-48fa-a317-a4b211734770 nodeName:}" failed. No retries permitted until 2026-06-09 09:58:56.432553828 +0000 UTC m=+542.770718203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs") pod "kube-auth-proxy-5784d47dd-gwbqb" (UID: "76afe536-214f-48fa-a317-a4b211734770") : secret "kube-auth-proxy-tls" not found Jun 09 09:58:55.935989 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.935961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76afe536-214f-48fa-a317-a4b211734770-tmp\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.943648 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.943619 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chfwb\" (UniqueName: \"kubernetes.io/projected/76afe536-214f-48fa-a317-a4b211734770-kube-api-access-chfwb\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:55.998518 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:55.996367 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:56.436153 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:56.436120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:56.438710 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:56.438681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76afe536-214f-48fa-a317-a4b211734770-tls-certs\") pod \"kube-auth-proxy-5784d47dd-gwbqb\" (UID: \"76afe536-214f-48fa-a317-a4b211734770\") " pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:56.648917 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:56.648882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" Jun 09 09:58:58.131963 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.131869 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb"] Jun 09 09:58:58.133488 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.133461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" event={"ID":"f6012752-aac5-465f-904c-1759a1f3ef5d","Type":"ContainerStarted","Data":"17cf10648fb256f2e969ba7f3dad15483b6b39ec5a9fb9aeca77e4da66651151"} Jun 09 09:58:58.133673 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.133656 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:58:58.135234 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.135213 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" event={"ID":"8b7fe1ae-e432-48aa-b430-29536cf141e0","Type":"ContainerStarted","Data":"2f9b8606b956fa5f188b911a63ea929ca60e39474b876d8c40d51a98827ca830"} Jun 09 09:58:58.135366 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.135275 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:58:58.149655 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.149616 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" podStartSLOduration=1.969204382 podStartE2EDuration="6.149602236s" totalImagesPullingTime="4.180397854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:58:58.147833291 +0000 UTC m=+544.485997684" watchObservedRunningTime="2026-06-09 09:58:58.149602236 +0000 UTC m=+544.487766629" Jun 09 09:58:58.163989 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:58.163932 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" podStartSLOduration=0.996432114 podStartE2EDuration="5.163917418s" totalImagesPullingTime="4.167485304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:58:58.162435722 +0000 UTC m=+544.500600116" watchObservedRunningTime="2026-06-09 09:58:58.163917418 +0000 UTC m=+544.502081810" Jun 09 09:58:59.142157 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:59.142059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" event={"ID":"76afe536-214f-48fa-a317-a4b211734770","Type":"ContainerStarted","Data":"f96c157c040c401b76663c0e400ebd45ad76a546b6fa1758c15bc135413538ba"} Jun 09 09:58:59.694430 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:59.694393 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:58:59.827320 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:58:59.827254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:00.147461 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:00.147428 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" event={"ID":"76afe536-214f-48fa-a317-a4b211734770","Type":"ContainerStarted","Data":"e257e1184211696ed629888b75a146af8a3eb0abe6fd317bf51d0c067655c47d"} Jun 09 09:59:00.171420 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:00.171371 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5784d47dd-gwbqb" podStartSLOduration=3.239423409 podStartE2EDuration="5.171356378s" totalImagesPullingTime="1.931932969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:00.170148664 +0000 UTC m=+546.508313054" watchObservedRunningTime="2026-06-09 09:59:00.171356378 +0000 UTC m=+546.509520771" Jun 09 09:59:03.862719 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:03.862679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:03.987825 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:03.987782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:04.006152 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.006123 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mr86x"] Jun 09 09:59:04.008996 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.008980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.012104 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.012082 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-296hr\"" Jun 09 09:59:04.012203 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.012126 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 09:59:04.035689 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.035665 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6"] Jun 09 09:59:04.037990 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.037974 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.040295 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.040269 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mr86x"] Jun 09 09:59:04.040380 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.040366 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vdx85\"" Jun 09 09:59:04.040434 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.040402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 09:59:04.066524 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.066493 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6"] Jun 09 09:59:04.102539 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.102505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxb6\" (UniqueName: \"kubernetes.io/projected/feddf805-7da0-4260-b34a-ece6a16fcc41-kube-api-access-6lxb6\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.102705 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.102580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.149718 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.149637 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:04.203038 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.202997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk8dh\" (UniqueName: \"kubernetes.io/projected/fae06b9a-9a33-482f-a4c6-5b2299a179e3-kube-api-access-nk8dh\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.203222 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.203057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.203222 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:59:04.203174 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 09:59:04.203222 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.203194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxb6\" (UniqueName: \"kubernetes.io/projected/feddf805-7da0-4260-b34a-ece6a16fcc41-kube-api-access-6lxb6\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.203343 ip-10-0-138-235 kubenswrapper[2561]: E0609 09:59:04.203249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert podName:feddf805-7da0-4260-b34a-ece6a16fcc41 nodeName:}" failed. No retries permitted until 2026-06-09 09:59:04.703230935 +0000 UTC m=+551.041395305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert") pod "kserve-controller-manager-69fc866d76-mr86x" (UID: "feddf805-7da0-4260-b34a-ece6a16fcc41") : secret "kserve-webhook-server-cert" not found Jun 09 09:59:04.203343 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.203269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae06b9a-9a33-482f-a4c6-5b2299a179e3-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.220126 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.220063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxb6\" (UniqueName: \"kubernetes.io/projected/feddf805-7da0-4260-b34a-ece6a16fcc41-kube-api-access-6lxb6\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.290412 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.290377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:04.304280 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.304256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae06b9a-9a33-482f-a4c6-5b2299a179e3-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.304392 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.304291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk8dh\" (UniqueName: \"kubernetes.io/projected/fae06b9a-9a33-482f-a4c6-5b2299a179e3-kube-api-access-nk8dh\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.306716 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.306686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae06b9a-9a33-482f-a4c6-5b2299a179e3-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.330611 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.330582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk8dh\" (UniqueName: \"kubernetes.io/projected/fae06b9a-9a33-482f-a4c6-5b2299a179e3-kube-api-access-nk8dh\") pod \"llmisvc-controller-manager-864bfd7bc9-gqkc6\" (UID: \"fae06b9a-9a33-482f-a4c6-5b2299a179e3\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.348498 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.348468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:04.666797 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:59:04.666765 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfae06b9a_9a33_482f_a4c6_5b2299a179e3.slice/crio-45ded9f875fdacfc511d12f92a1029e327e79142c34e7b2e20f511188cea27c1 WatchSource:0}: Error finding container 45ded9f875fdacfc511d12f92a1029e327e79142c34e7b2e20f511188cea27c1: Status 404 returned error can't find the container with id 45ded9f875fdacfc511d12f92a1029e327e79142c34e7b2e20f511188cea27c1 Jun 09 09:59:04.667766 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.667738 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6"] Jun 09 09:59:04.668925 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.668899 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:04.708324 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.708248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.710609 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.710584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feddf805-7da0-4260-b34a-ece6a16fcc41-cert\") pod \"kserve-controller-manager-69fc866d76-mr86x\" (UID: \"feddf805-7da0-4260-b34a-ece6a16fcc41\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.887110 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.887065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:04.920109 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.920056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:04.999573 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:04.999542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:05.086821 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:05.086788 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mr86x"] Jun 09 09:59:05.090280 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:59:05.090254 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeddf805_7da0_4260_b34a_ece6a16fcc41.slice/crio-8e195cab77402b43031dd323f53664fa7e779c3ca3a009c9e4a8e55e1a06eb2b WatchSource:0}: Error finding container 8e195cab77402b43031dd323f53664fa7e779c3ca3a009c9e4a8e55e1a06eb2b: Status 404 returned error can't find the container with id 8e195cab77402b43031dd323f53664fa7e779c3ca3a009c9e4a8e55e1a06eb2b Jun 09 09:59:05.169652 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:05.169618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" event={"ID":"fae06b9a-9a33-482f-a4c6-5b2299a179e3","Type":"ContainerStarted","Data":"45ded9f875fdacfc511d12f92a1029e327e79142c34e7b2e20f511188cea27c1"} Jun 09 09:59:05.170746 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:05.170720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" event={"ID":"feddf805-7da0-4260-b34a-ece6a16fcc41","Type":"ContainerStarted","Data":"8e195cab77402b43031dd323f53664fa7e779c3ca3a009c9e4a8e55e1a06eb2b"} Jun 09 09:59:05.752113 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:05.751935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:05.873014 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:05.872978 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:06.264296 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:06.264247 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:06.354407 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:06.354370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:08.567989 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.567947 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2grsd"] Jun 09 09:59:08.571689 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.571666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.583151 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.583132 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 09:59:08.583710 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.583689 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4ktqx\"" Jun 09 09:59:08.585854 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.585831 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 09:59:08.620249 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.620218 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2grsd"] Jun 09 09:59:08.744052 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.743963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/310b5dd6-5cd4-4f34-9699-994734bbd206-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.744052 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.744043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmr4m\" (UniqueName: \"kubernetes.io/projected/310b5dd6-5cd4-4f34-9699-994734bbd206-kube-api-access-wmr4m\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.845472 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.845441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmr4m\" (UniqueName: \"kubernetes.io/projected/310b5dd6-5cd4-4f34-9699-994734bbd206-kube-api-access-wmr4m\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.845697 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.845503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/310b5dd6-5cd4-4f34-9699-994734bbd206-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.848245 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.848220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/310b5dd6-5cd4-4f34-9699-994734bbd206-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.860747 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.860724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmr4m\" (UniqueName: \"kubernetes.io/projected/310b5dd6-5cd4-4f34-9699-994734bbd206-kube-api-access-wmr4m\") pod \"servicemesh-operator3-57f65f65fb-2grsd\" (UID: \"310b5dd6-5cd4-4f34-9699-994734bbd206\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:08.880632 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:08.880601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:09.063874 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.063637 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2grsd"] Jun 09 09:59:09.068648 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:59:09.068620 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310b5dd6_5cd4_4f34_9699_994734bbd206.slice/crio-c67ba87a8b9cccc4665a8806d1689c7b0aefe07981883be37d1a32b91bfc762a WatchSource:0}: Error finding container c67ba87a8b9cccc4665a8806d1689c7b0aefe07981883be37d1a32b91bfc762a: Status 404 returned error can't find the container with id c67ba87a8b9cccc4665a8806d1689c7b0aefe07981883be37d1a32b91bfc762a Jun 09 09:59:09.144185 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.144157 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-n48lk" Jun 09 09:59:09.146040 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.146022 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hm57j" Jun 09 09:59:09.192798 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.192764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" event={"ID":"feddf805-7da0-4260-b34a-ece6a16fcc41","Type":"ContainerStarted","Data":"e2d2915d268c483374147a4306ed8b2d74de47e002c2bcbc47f05cdff7070248"} Jun 09 09:59:09.192972 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.192825 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:09.194410 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.194388 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" event={"ID":"fae06b9a-9a33-482f-a4c6-5b2299a179e3","Type":"ContainerStarted","Data":"5a78c152d54b250fa82cbe5ab465587b287dde77117c68709c3b5221493dbdb1"} Jun 09 09:59:09.194563 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.194433 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:09.195920 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.195901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" event={"ID":"310b5dd6-5cd4-4f34-9699-994734bbd206","Type":"ContainerStarted","Data":"c67ba87a8b9cccc4665a8806d1689c7b0aefe07981883be37d1a32b91bfc762a"} Jun 09 09:59:09.231540 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.231478 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" podStartSLOduration=1.497627399 podStartE2EDuration="5.231457373s" totalImagesPullingTime="3.733829974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:09.230818806 +0000 UTC m=+555.568983196" watchObservedRunningTime="2026-06-09 09:59:09.231457373 +0000 UTC m=+555.569621793" Jun 09 09:59:09.253952 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.253894 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" podStartSLOduration=2.947232236 podStartE2EDuration="6.253874474s" totalImagesPullingTime="3.306642238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:09.252240237 +0000 UTC m=+555.590404643" watchObservedRunningTime="2026-06-09 09:59:09.253874474 +0000 UTC m=+555.592038867" Jun 09 09:59:09.927428 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:09.927372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:11.077660 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.077626 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-55f8bc7b47-hlk8p"] Jun 09 09:59:11.083397 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.083367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.087020 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.086993 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 09:59:11.087233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.087210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6lr6p\"" Jun 09 09:59:11.097521 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.097498 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55f8bc7b47-hlk8p"] Jun 09 09:59:11.136760 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.136666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:11.268500 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.268441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/617ee310-f557-4a68-b1f2-16ed1fba4131-redirect-config\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.268706 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.268596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t478s\" (UniqueName: \"kubernetes.io/projected/617ee310-f557-4a68-b1f2-16ed1fba4131-kube-api-access-t478s\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.369233 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.369200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/617ee310-f557-4a68-b1f2-16ed1fba4131-redirect-config\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.369427 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.369282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t478s\" (UniqueName: \"kubernetes.io/projected/617ee310-f557-4a68-b1f2-16ed1fba4131-kube-api-access-t478s\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.370013 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.369980 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/617ee310-f557-4a68-b1f2-16ed1fba4131-redirect-config\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.383543 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.383514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t478s\" (UniqueName: \"kubernetes.io/projected/617ee310-f557-4a68-b1f2-16ed1fba4131-kube-api-access-t478s\") pod \"dashboard-redirect-55f8bc7b47-hlk8p\" (UID: \"617ee310-f557-4a68-b1f2-16ed1fba4131\") " pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.397191 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.397163 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" Jun 09 09:59:11.650468 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:11.650291 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55f8bc7b47-hlk8p"] Jun 09 09:59:12.213121 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:12.213086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" event={"ID":"617ee310-f557-4a68-b1f2-16ed1fba4131","Type":"ContainerStarted","Data":"43635956a7627cb3be2eccfd85bbd2ccf7e3c54eb01cba65843bdc173dfbb6db"} Jun 09 09:59:12.214880 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:12.214852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" event={"ID":"310b5dd6-5cd4-4f34-9699-994734bbd206","Type":"ContainerStarted","Data":"ae3f037f8e76857d7638652556ffb09d1e38a5196aefd55dcee52315fc1b1909"} Jun 09 09:59:12.215019 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:12.214977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:12.249022 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:12.248963 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" podStartSLOduration=1.7676471230000002 podStartE2EDuration="4.248944321s" totalImagesPullingTime="2.481297198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:12.247955613 +0000 UTC m=+558.586120007" watchObservedRunningTime="2026-06-09 09:59:12.248944321 +0000 UTC m=+558.587108706" Jun 09 09:59:14.225538 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:14.225501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" event={"ID":"617ee310-f557-4a68-b1f2-16ed1fba4131","Type":"ContainerStarted","Data":"c3fc1b68e8e7e098df5764969f9a75bed0cabbc3c2f9ff9c2238b6244695b43a"} Jun 09 09:59:14.242767 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:14.242720 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-55f8bc7b47-hlk8p" podStartSLOduration=1.4766899549999999 podStartE2EDuration="3.242705426s" totalImagesPullingTime="1.766015471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:14.240037299 +0000 UTC m=+560.578201691" watchObservedRunningTime="2026-06-09 09:59:14.242705426 +0000 UTC m=+560.580869822" Jun 09 09:59:17.468774 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:17.468742 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:17.567504 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:17.567466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:20.984243 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:20.984213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:21.342410 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:21.342376 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:23.223021 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:23.222992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2grsd" Jun 09 09:59:26.936755 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.936696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:26.941894 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.941869 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p"] Jun 09 09:59:26.980953 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.980927 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p"] Jun 09 09:59:26.981136 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.981026 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.983373 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.983329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 09:59:26.983373 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.983358 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 09:59:26.983373 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.983358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 09:59:26.983634 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.983624 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 09:59:26.983897 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.983877 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-k7cf7\"" Jun 09 09:59:26.991047 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991150 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991150 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58669dd3-b3c9-480e-800f-42f64a3d274b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991150 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991309 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991309 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc627\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-kube-api-access-pc627\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:26.991309 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:26.991296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.006466 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.006441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:27.091803 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.091803 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58669dd3-b3c9-480e-800f-42f64a3d274b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc627\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-kube-api-access-pc627\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092023 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.091987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.092538 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.092505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.094445 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.094418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.094546 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.094420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.094606 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.094565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58669dd3-b3c9-480e-800f-42f64a3d274b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.094695 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.094677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.104467 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.104440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc627\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-kube-api-access-pc627\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.104579 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.104564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58669dd3-b3c9-480e-800f-42f64a3d274b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gw67p\" (UID: \"58669dd3-b3c9-480e-800f-42f64a3d274b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.291748 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.291667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:27.462178 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.462145 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p"] Jun 09 09:59:27.465100 ip-10-0-138-235 kubenswrapper[2561]: W0609 09:59:27.465055 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58669dd3_b3c9_480e_800f_42f64a3d274b.slice/crio-2ecd7739ca15faec58b62fa9b290f8bf7f2e55411b3f66b7c9dae13ebec006d9 WatchSource:0}: Error finding container 2ecd7739ca15faec58b62fa9b290f8bf7f2e55411b3f66b7c9dae13ebec006d9: Status 404 returned error can't find the container with id 2ecd7739ca15faec58b62fa9b290f8bf7f2e55411b3f66b7c9dae13ebec006d9 Jun 09 09:59:27.655358 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:27.655310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:28.292152 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:28.292112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" event={"ID":"58669dd3-b3c9-480e-800f-42f64a3d274b","Type":"ContainerStarted","Data":"2ecd7739ca15faec58b62fa9b290f8bf7f2e55411b3f66b7c9dae13ebec006d9"} Jun 09 09:59:29.812609 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:29.812571 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 09:59:29.812885 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:29.812645 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 09 09:59:30.303801 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.303766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" event={"ID":"58669dd3-b3c9-480e-800f-42f64a3d274b","Type":"ContainerStarted","Data":"40bcf72de34e9b12152d1657bb783cfc45635df91bd5cb5d7c479224547174fa"} Jun 09 09:59:30.304007 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.303954 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:30.305589 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.305561 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-gw67p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 09:59:30.305703 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.305610 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" podUID="58669dd3-b3c9-480e-800f-42f64a3d274b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 09:59:30.323934 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.323892 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" podStartSLOduration=1.978997905 podStartE2EDuration="4.323873632s" totalImagesPullingTime="2.344875727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:30.322134121 +0000 UTC m=+576.660298515" watchObservedRunningTime="2026-06-09 09:59:30.323873632 +0000 UTC m=+576.662038025" Jun 09 09:59:30.489381 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.489347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:30.589722 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.589688 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:30.792476 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:30.792435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:31.004447 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:31.004352 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:31.104942 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:31.104914 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:31.309614 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:31.309528 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gw67p" Jun 09 09:59:31.635992 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:31.635954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:40.202479 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:40.202450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gqkc6" Jun 09 09:59:40.205580 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:40.205557 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mr86x" Jun 09 09:59:53.629496 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:53.629448 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 09:59:54.098781 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:54.098757 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:59:54.100003 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:54.099980 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 09:59:54.679718 ip-10-0-138-235 kubenswrapper[2561]: I0609 09:59:54.679691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:04.792182 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:04.792140 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:04.857901 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:04.857863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:09.879560 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:09.879472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:09.976027 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:09.975995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:17.068908 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:17.068866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:17.138471 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:17.138438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:21.075526 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:21.075483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:21.180111 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:21.180057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:21.250130 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:21.250096 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:22.027821 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:22.027780 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:22.609593 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:22.609558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:23.685301 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:23.685267 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:23.786672 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:23.786640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:27.026404 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:27.026362 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:30.228220 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:30.228185 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:30.489924 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:30.489841 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:32.885755 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:32.885722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:33.027013 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:33.026978 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:35.052256 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:35.052223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:35.509597 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:35.509495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:37.024260 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.024225 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc"] Jun 09 10:00:37.026936 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.026919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.029824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.029800 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cjl2b\"" Jun 09 10:00:37.030179 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.030158 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 10:00:37.030281 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.030219 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 10:00:37.054427 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.054402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc"] Jun 09 10:00:37.091760 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.091728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5r8g\" (UniqueName: \"kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.091920 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.091771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.192565 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.192529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5r8g\" (UniqueName: \"kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.192766 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.192588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.193036 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.193014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.208851 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.208828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5r8g\" (UniqueName: \"kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.337760 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.337731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:37.478952 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.478792 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc"] Jun 09 10:00:37.482009 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:00:37.481983 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2142d30c_d051_446e_9d5f_caa55cb7e64c.slice/crio-f4ad3503ec4dcc8010982cdbc57748f5fda4394171aa4d6d691e443030661d81 WatchSource:0}: Error finding container f4ad3503ec4dcc8010982cdbc57748f5fda4394171aa4d6d691e443030661d81: Status 404 returned error can't find the container with id f4ad3503ec4dcc8010982cdbc57748f5fda4394171aa4d6d691e443030661d81 Jun 09 10:00:37.484480 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.484461 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 10:00:37.609205 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:37.609114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" event={"ID":"2142d30c-d051-446e-9d5f-caa55cb7e64c","Type":"ContainerStarted","Data":"f4ad3503ec4dcc8010982cdbc57748f5fda4394171aa4d6d691e443030661d81"} Jun 09 10:00:38.033966 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:38.033885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:38.129797 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:38.129757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:38.243190 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:38.243123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:38.339280 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:38.339232 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:39.484496 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:39.484463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:41.902034 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:41.901999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:42.017843 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:42.017810 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:44.646642 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:44.646611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" event={"ID":"2142d30c-d051-446e-9d5f-caa55cb7e64c","Type":"ContainerStarted","Data":"e0543c675ed139c1f0b5810212f153ee9403d277fce52b1fda24acedc4ffc28e"} Jun 09 10:00:44.647033 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:44.646733 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:44.674123 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:44.673967 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" podStartSLOduration=1.845706811 podStartE2EDuration="8.673945525s" totalImagesPullingTime="6.828238714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:00:44.673723513 +0000 UTC m=+651.011887921" watchObservedRunningTime="2026-06-09 10:00:44.673945525 +0000 UTC m=+651.012109923" Jun 09 10:00:46.071862 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:46.071820 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:46.175722 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:46.175682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:47.167553 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:47.167512 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:47.631804 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:47.631769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:49.391122 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:49.391065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:49.491505 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:49.491474 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:55.653786 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:55.653751 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.259396 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.259359 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:57.328363 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.328329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:57.461301 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.461267 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc"] Jun 09 10:00:57.461473 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.461434 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" containerName="manager" containerID="cri-o://e0543c675ed139c1f0b5810212f153ee9403d277fce52b1fda24acedc4ffc28e" gracePeriod=2 Jun 09 10:00:57.471057 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.471029 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:00:57.474345 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.474313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.477785 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.477759 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc"] Jun 09 10:00:57.487036 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.487000 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:00:57.499336 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:00:57.499296 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2142d30c-d051-446e-9d5f-caa55cb7e64c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.500906 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:00:57.500870 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" is forbidden: User \"system:node:ip-10-0-138-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-235.ec2.internal' and this object" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.514202 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.514131 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:00:57.514491 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.514478 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" containerName="manager" Jun 09 10:00:57.514491 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.514491 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" containerName="manager" Jun 09 10:00:57.514634 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.514561 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" containerName="manager" Jun 09 10:00:57.517431 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.517413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.534867 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.534834 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:00:57.550461 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:00:57.550390 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" is forbidden: User \"system:node:ip-10-0-138-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-235.ec2.internal' and this object" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.579189 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.579163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fph2p\" (UniqueName: \"kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.579299 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.579248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.680222 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.680193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fph2p\" (UniqueName: \"kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.680348 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.680253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.680348 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.680297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.680348 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.680336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzz62\" (UniqueName: \"kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.680604 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.680585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.688682 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.688659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fph2p\" (UniqueName: \"kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mzbjt\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.705892 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.705865 2561 generic.go:356] "Generic (PLEG): container finished" podID="2142d30c-d051-446e-9d5f-caa55cb7e64c" containerID="e0543c675ed139c1f0b5810212f153ee9403d277fce52b1fda24acedc4ffc28e" exitCode=0 Jun 09 10:00:57.706006 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.705902 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4ad3503ec4dcc8010982cdbc57748f5fda4394171aa4d6d691e443030661d81" Jun 09 10:00:57.706156 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.706140 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.707659 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:00:57.707639 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lvrmc\" is forbidden: User \"system:node:ip-10-0-138-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-235.ec2.internal' and this object" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:57.781161 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.781062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz62\" (UniqueName: \"kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.781305 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.781194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.781515 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.781499 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.796989 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.796953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz62\" (UniqueName: \"kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z2fzc\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.841596 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.841566 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:57.850390 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.850363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:57.863098 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.863051 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:57.882392 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.882358 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5r8g\" (UniqueName: \"kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g\") pod \"2142d30c-d051-446e-9d5f-caa55cb7e64c\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " Jun 09 10:00:57.882392 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.882393 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume\") pod \"2142d30c-d051-446e-9d5f-caa55cb7e64c\" (UID: \"2142d30c-d051-446e-9d5f-caa55cb7e64c\") " Jun 09 10:00:57.882782 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.882757 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2142d30c-d051-446e-9d5f-caa55cb7e64c" (UID: "2142d30c-d051-446e-9d5f-caa55cb7e64c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:00:57.884683 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.884620 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g" (OuterVolumeSpecName: "kube-api-access-t5r8g") pod "2142d30c-d051-446e-9d5f-caa55cb7e64c" (UID: "2142d30c-d051-446e-9d5f-caa55cb7e64c"). InnerVolumeSpecName "kube-api-access-t5r8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:00:57.975474 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.975343 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:00:57.983569 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.983543 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5r8g\" (UniqueName: \"kubernetes.io/projected/2142d30c-d051-446e-9d5f-caa55cb7e64c-kube-api-access-t5r8g\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:00:57.983569 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.983569 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2142d30c-d051-446e-9d5f-caa55cb7e64c-extensions-socket-volume\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:00:57.999177 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:57.999156 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:00:58.001785 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:00:58.001740 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc96a4f_9b67_483d_af3c_bb3b539b6109.slice/crio-4006f8c7be12e72568434ef435ed3ed96a40a7f916ee3e9728154bf71076dbfa WatchSource:0}: Error finding container 4006f8c7be12e72568434ef435ed3ed96a40a7f916ee3e9728154bf71076dbfa: Status 404 returned error can't find the container with id 4006f8c7be12e72568434ef435ed3ed96a40a7f916ee3e9728154bf71076dbfa Jun 09 10:00:58.034601 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.034549 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:00:58.037815 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:00:58.037783 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda316ae6f_e25f_47dc_a71e_7090bff6d2c3.slice/crio-c684c5e35c6b573618b00447182cef3c450c3e04b383c5584cc381abdd468d8c WatchSource:0}: Error finding container c684c5e35c6b573618b00447182cef3c450c3e04b383c5584cc381abdd468d8c: Status 404 returned error can't find the container with id c684c5e35c6b573618b00447182cef3c450c3e04b383c5584cc381abdd468d8c Jun 09 10:00:58.125498 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.125459 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2142d30c-d051-446e-9d5f-caa55cb7e64c" path="/var/lib/kubelet/pods/2142d30c-d051-446e-9d5f-caa55cb7e64c/volumes" Jun 09 10:00:58.712040 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.711932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" event={"ID":"a316ae6f-e25f-47dc-a71e-7090bff6d2c3","Type":"ContainerStarted","Data":"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85"} Jun 09 10:00:58.712513 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.712091 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:00:58.712513 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.712138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" event={"ID":"a316ae6f-e25f-47dc-a71e-7090bff6d2c3","Type":"ContainerStarted","Data":"c684c5e35c6b573618b00447182cef3c450c3e04b383c5584cc381abdd468d8c"} Jun 09 10:00:58.713625 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.713606 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lvrmc" Jun 09 10:00:58.713760 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.713640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" event={"ID":"4fc96a4f-9b67-483d-af3c-bb3b539b6109","Type":"ContainerStarted","Data":"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84"} Jun 09 10:00:58.713760 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.713690 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:00:58.713760 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.713715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" event={"ID":"4fc96a4f-9b67-483d-af3c-bb3b539b6109","Type":"ContainerStarted","Data":"4006f8c7be12e72568434ef435ed3ed96a40a7f916ee3e9728154bf71076dbfa"} Jun 09 10:00:58.736805 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.736709 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" podStartSLOduration=1.7366934550000002 podStartE2EDuration="1.736693455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:00:58.735116158 +0000 UTC m=+665.073280548" watchObservedRunningTime="2026-06-09 10:00:58.736693455 +0000 UTC m=+665.074857847" Jun 09 10:00:58.761512 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:00:58.761460 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" podStartSLOduration=1.7614403090000001 podStartE2EDuration="1.761440309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:00:58.758921747 +0000 UTC m=+665.097086140" watchObservedRunningTime="2026-06-09 10:00:58.761440309 +0000 UTC m=+665.099604791" Jun 09 10:01:00.250562 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:00.250524 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:00.350495 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:00.350458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:05.440356 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:05.440311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:05.541714 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:05.541660 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:08.026546 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:08.026505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:08.127131 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:08.127061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:09.725485 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:09.725459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:01:09.725870 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:09.725526 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:01:09.814287 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:09.814252 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:01:09.814477 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:09.814453 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" podUID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" containerName="manager" containerID="cri-o://60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85" gracePeriod=10 Jun 09 10:01:10.063196 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.063173 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:01:10.077654 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.077630 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzz62\" (UniqueName: \"kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62\") pod \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " Jun 09 10:01:10.077768 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.077710 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume\") pod \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\" (UID: \"a316ae6f-e25f-47dc-a71e-7090bff6d2c3\") " Jun 09 10:01:10.078119 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.078095 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a316ae6f-e25f-47dc-a71e-7090bff6d2c3" (UID: "a316ae6f-e25f-47dc-a71e-7090bff6d2c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:01:10.079664 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.079638 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62" (OuterVolumeSpecName: "kube-api-access-dzz62") pod "a316ae6f-e25f-47dc-a71e-7090bff6d2c3" (UID: "a316ae6f-e25f-47dc-a71e-7090bff6d2c3"). InnerVolumeSpecName "kube-api-access-dzz62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:01:10.100815 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.100787 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc"] Jun 09 10:01:10.101289 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.101260 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" containerName="manager" Jun 09 10:01:10.101289 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.101278 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" containerName="manager" Jun 09 10:01:10.101432 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.101378 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" containerName="manager" Jun 09 10:01:10.104536 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.104512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.127342 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.127314 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc"] Jun 09 10:01:10.179295 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.179268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kcf\" (UniqueName: \"kubernetes.io/projected/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-kube-api-access-c9kcf\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.179457 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.179371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.179457 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.179442 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzz62\" (UniqueName: \"kubernetes.io/projected/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-kube-api-access-dzz62\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:01:10.179552 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.179457 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a316ae6f-e25f-47dc-a71e-7090bff6d2c3-extensions-socket-volume\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:01:10.280884 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.280801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kcf\" (UniqueName: \"kubernetes.io/projected/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-kube-api-access-c9kcf\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.280884 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.280873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.285104 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.281662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.289533 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.289505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kcf\" (UniqueName: \"kubernetes.io/projected/5c35e3e4-b0bd-47de-bddf-38ae709c51ed-kube-api-access-c9kcf\") pod \"kuadrant-operator-controller-manager-86878c769f-6cqdc\" (UID: \"5c35e3e4-b0bd-47de-bddf-38ae709c51ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.415616 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.415581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.550650 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.550625 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc"] Jun 09 10:01:10.552934 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:01:10.552906 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c35e3e4_b0bd_47de_bddf_38ae709c51ed.slice/crio-f3ef53c6b691cff45de52c2ee8d8f347a7799666cbbdbe17056d8987c15577f0 WatchSource:0}: Error finding container f3ef53c6b691cff45de52c2ee8d8f347a7799666cbbdbe17056d8987c15577f0: Status 404 returned error can't find the container with id f3ef53c6b691cff45de52c2ee8d8f347a7799666cbbdbe17056d8987c15577f0 Jun 09 10:01:10.776109 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.776062 2561 generic.go:356] "Generic (PLEG): container finished" podID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" containerID="60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85" exitCode=0 Jun 09 10:01:10.777653 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.776720 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" Jun 09 10:01:10.777653 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.777254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" event={"ID":"a316ae6f-e25f-47dc-a71e-7090bff6d2c3","Type":"ContainerDied","Data":"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85"} Jun 09 10:01:10.777653 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.777299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc" event={"ID":"a316ae6f-e25f-47dc-a71e-7090bff6d2c3","Type":"ContainerDied","Data":"c684c5e35c6b573618b00447182cef3c450c3e04b383c5584cc381abdd468d8c"} Jun 09 10:01:10.777653 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.777328 2561 scope.go:117] "RemoveContainer" containerID="60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85" Jun 09 10:01:10.781770 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.781750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" event={"ID":"5c35e3e4-b0bd-47de-bddf-38ae709c51ed","Type":"ContainerStarted","Data":"1c3c672ccc920fe2cf0552f61df96a542df44bb66f3ca79381acfd2868496c53"} Jun 09 10:01:10.781855 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.781785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" event={"ID":"5c35e3e4-b0bd-47de-bddf-38ae709c51ed","Type":"ContainerStarted","Data":"f3ef53c6b691cff45de52c2ee8d8f347a7799666cbbdbe17056d8987c15577f0"} Jun 09 10:01:10.781914 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.781870 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:10.789730 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.789706 2561 scope.go:117] "RemoveContainer" containerID="60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85" Jun 09 10:01:10.789966 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:01:10.789946 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85\": container with ID starting with 60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85 not found: ID does not exist" containerID="60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85" Jun 09 10:01:10.790043 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.789974 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85"} err="failed to get container status \"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85\": rpc error: code = NotFound desc = could not find container \"60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85\": container with ID starting with 60e7bee31665aa6e0b6d17b1ffb2bef96fc2b29db2e37e8fb3501ffc5bbb9b85 not found: ID does not exist" Jun 09 10:01:10.794197 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.794169 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:01:10.798417 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.798391 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z2fzc"] Jun 09 10:01:10.819628 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:10.819550 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" podStartSLOduration=0.819535501 podStartE2EDuration="819.535501ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:01:10.817806404 +0000 UTC m=+677.155970789" watchObservedRunningTime="2026-06-09 10:01:10.819535501 +0000 UTC m=+677.157699894" Jun 09 10:01:12.124269 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:12.124235 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a316ae6f-e25f-47dc-a71e-7090bff6d2c3" path="/var/lib/kubelet/pods/a316ae6f-e25f-47dc-a71e-7090bff6d2c3/volumes" Jun 09 10:01:21.790119 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:21.790090 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6cqdc" Jun 09 10:01:21.842039 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:21.842009 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:01:21.842287 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:21.842239 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" podUID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" containerName="manager" containerID="cri-o://57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84" gracePeriod=10 Jun 09 10:01:22.087561 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.087538 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:01:22.181921 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.181888 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume\") pod \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " Jun 09 10:01:22.182131 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.181978 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fph2p\" (UniqueName: \"kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p\") pod \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\" (UID: \"4fc96a4f-9b67-483d-af3c-bb3b539b6109\") " Jun 09 10:01:22.182316 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.182284 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fc96a4f-9b67-483d-af3c-bb3b539b6109" (UID: "4fc96a4f-9b67-483d-af3c-bb3b539b6109"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:01:22.184054 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.184032 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p" (OuterVolumeSpecName: "kube-api-access-fph2p") pod "4fc96a4f-9b67-483d-af3c-bb3b539b6109" (UID: "4fc96a4f-9b67-483d-af3c-bb3b539b6109"). InnerVolumeSpecName "kube-api-access-fph2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:01:22.283375 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.283343 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc96a4f-9b67-483d-af3c-bb3b539b6109-extensions-socket-volume\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:01:22.283375 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.283367 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fph2p\" (UniqueName: \"kubernetes.io/projected/4fc96a4f-9b67-483d-af3c-bb3b539b6109-kube-api-access-fph2p\") on node \"ip-10-0-138-235.ec2.internal\" DevicePath \"\"" Jun 09 10:01:22.845138 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.845099 2561 generic.go:356] "Generic (PLEG): container finished" podID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" containerID="57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84" exitCode=0 Jun 09 10:01:22.845138 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.845144 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" Jun 09 10:01:22.845627 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.845162 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" event={"ID":"4fc96a4f-9b67-483d-af3c-bb3b539b6109","Type":"ContainerDied","Data":"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84"} Jun 09 10:01:22.845627 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.845221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt" event={"ID":"4fc96a4f-9b67-483d-af3c-bb3b539b6109","Type":"ContainerDied","Data":"4006f8c7be12e72568434ef435ed3ed96a40a7f916ee3e9728154bf71076dbfa"} Jun 09 10:01:22.845627 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.845242 2561 scope.go:117] "RemoveContainer" containerID="57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84" Jun 09 10:01:22.853828 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.853812 2561 scope.go:117] "RemoveContainer" containerID="57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84" Jun 09 10:01:22.854059 ip-10-0-138-235 kubenswrapper[2561]: E0609 10:01:22.854040 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84\": container with ID starting with 57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84 not found: ID does not exist" containerID="57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84" Jun 09 10:01:22.854160 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.854093 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84"} err="failed to get container status \"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84\": rpc error: code = NotFound desc = could not find container \"57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84\": container with ID starting with 57657a0aad06bc79a01bda001bb48dd2dfae974bd293b9deac2bf29b358e9f84 not found: ID does not exist" Jun 09 10:01:22.866083 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.866039 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:01:22.872335 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:22.872313 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mzbjt"] Jun 09 10:01:24.124295 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:24.124265 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" path="/var/lib/kubelet/pods/4fc96a4f-9b67-483d-af3c-bb3b539b6109/volumes" Jun 09 10:01:26.193151 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:26.193114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:26.289469 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:26.289419 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:27.834144 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:27.834106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:27.934726 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:27.934688 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:29.890562 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:29.890534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:43.998158 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:43.998065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:44.112806 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.112773 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:44.163912 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.163845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:44.463181 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.463145 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:01:44.463503 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.463492 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" containerName="manager" Jun 09 10:01:44.463549 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.463505 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" containerName="manager" Jun 09 10:01:44.463583 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.463556 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc96a4f-9b67-483d-af3c-bb3b539b6109" containerName="manager" Jun 09 10:01:44.466080 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.466039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.468063 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.468042 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 10:01:44.468189 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.468117 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-267nb\"" Jun 09 10:01:44.473960 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.473940 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:01:44.506712 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.506689 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:01:44.582993 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.582960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvls\" (UniqueName: \"kubernetes.io/projected/c7242bc9-5f30-4414-b557-95ef364a7a3b-kube-api-access-psvls\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.582993 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.582996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7242bc9-5f30-4414-b557-95ef364a7a3b-config-file\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.684289 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.684253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvls\" (UniqueName: \"kubernetes.io/projected/c7242bc9-5f30-4414-b557-95ef364a7a3b-kube-api-access-psvls\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.684289 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.684292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7242bc9-5f30-4414-b557-95ef364a7a3b-config-file\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.684948 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.684929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7242bc9-5f30-4414-b557-95ef364a7a3b-config-file\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.692990 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.692964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvls\" (UniqueName: \"kubernetes.io/projected/c7242bc9-5f30-4414-b557-95ef364a7a3b-kube-api-access-psvls\") pod \"limitador-limitador-54d6d988d5-qw6xc\" (UID: \"c7242bc9-5f30-4414-b557-95ef364a7a3b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.776999 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.776920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:44.840537 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.840499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:44.899604 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.899576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:44.914676 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.914650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:01:44.917620 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:01:44.917593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7242bc9_5f30_4414_b557_95ef364a7a3b.slice/crio-3406c05ac9b1cae1df912d8012310a96c7f983c8e6d2ac751301a05b5dc824e4 WatchSource:0}: Error finding container 3406c05ac9b1cae1df912d8012310a96c7f983c8e6d2ac751301a05b5dc824e4: Status 404 returned error can't find the container with id 3406c05ac9b1cae1df912d8012310a96c7f983c8e6d2ac751301a05b5dc824e4 Jun 09 10:01:44.954843 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:44.954815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" event={"ID":"c7242bc9-5f30-4414-b557-95ef364a7a3b","Type":"ContainerStarted","Data":"3406c05ac9b1cae1df912d8012310a96c7f983c8e6d2ac751301a05b5dc824e4"} Jun 09 10:01:47.972503 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:47.972460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" event={"ID":"c7242bc9-5f30-4414-b557-95ef364a7a3b","Type":"ContainerStarted","Data":"d5c2a733a8f10c067364e968e49e54cf6d5b594198003f19a9b11b04e81f2388"} Jun 09 10:01:47.972890 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:47.972593 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:01:47.989739 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:47.989691 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" podStartSLOduration=1.593189797 podStartE2EDuration="3.989674714s" totalImagesPullingTime="2.396484917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:01:47.988521868 +0000 UTC m=+714.326686260" watchObservedRunningTime="2026-06-09 10:01:47.989674714 +0000 UTC m=+714.327839106" Jun 09 10:01:58.257745 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:58.257714 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:01:58.978751 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:01:58.978721 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qw6xc" Jun 09 10:02:01.773550 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:01.773503 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:02:11.612533 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:11.612494 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:02:11.712243 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:11.712208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:02:11.872489 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:11.872406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:02:36.466114 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:36.466060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:02:36.567344 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:02:36.567305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:08.996284 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:08.996199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:09.097228 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:09.097188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:15.177575 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:15.177538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:15.275553 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:15.275517 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:15.381266 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:15.381224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:15.448860 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:15.448754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:18.573706 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:18.573664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:18.662488 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:18.662460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:49.656683 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:49.656626 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:49.830065 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:49.830034 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:50.082751 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:50.082668 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:50.175844 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:50.175802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:03:50.219545 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:03:50.219510 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:04:21.647716 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:21.647677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:36.515358 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:36.515323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:38.164520 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:38.164483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:38.219582 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:38.219545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:51.531366 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:51.531299 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:51.626647 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:51.626608 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:04:54.132033 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:54.132007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 10:04:54.133438 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:04:54.133407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 10:05:00.831056 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.831022 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b"] Jun 09 10:05:00.834631 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.834610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.836464 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.836444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 10:05:00.837447 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.837136 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4c9kr\"" Jun 09 10:05:00.837447 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.837256 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 10:05:00.837447 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.837389 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 10:05:00.847226 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.847202 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b"] Jun 09 10:05:00.907154 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.907119 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:05:00.952453 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.952657 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.952657 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952561 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8mc\" (UniqueName: \"kubernetes.io/projected/c824cc31-0663-4471-8651-25fe4920d4e2-kube-api-access-gn8mc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.952657 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c824cc31-0663-4471-8651-25fe4920d4e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.952657 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:00.952657 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:00.952639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.053925 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.053884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054130 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.053956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8mc\" (UniqueName: \"kubernetes.io/projected/c824cc31-0663-4471-8651-25fe4920d4e2-kube-api-access-gn8mc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054130 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.053984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c824cc31-0663-4471-8651-25fe4920d4e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054130 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054130 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054348 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054391 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054481 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.054733 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.054707 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.056970 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.056941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c824cc31-0663-4471-8651-25fe4920d4e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.057330 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.057311 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c824cc31-0663-4471-8651-25fe4920d4e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.063954 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.063933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8mc\" (UniqueName: \"kubernetes.io/projected/c824cc31-0663-4471-8651-25fe4920d4e2-kube-api-access-gn8mc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b\" (UID: \"c824cc31-0663-4471-8651-25fe4920d4e2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.148655 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.148626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:01.287975 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.287951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b"] Jun 09 10:05:01.290989 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:05:01.290959 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc824cc31_0663_4471_8651_25fe4920d4e2.slice/crio-0022168d2f4a8c25d5086ff660d4e4f0e4ebe4e25fc0fd57375ed3c62566c789 WatchSource:0}: Error finding container 0022168d2f4a8c25d5086ff660d4e4f0e4ebe4e25fc0fd57375ed3c62566c789: Status 404 returned error can't find the container with id 0022168d2f4a8c25d5086ff660d4e4f0e4ebe4e25fc0fd57375ed3c62566c789 Jun 09 10:05:01.323162 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.323126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:05:01.887054 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:01.887021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" event={"ID":"c824cc31-0663-4471-8651-25fe4920d4e2","Type":"ContainerStarted","Data":"0022168d2f4a8c25d5086ff660d4e4f0e4ebe4e25fc0fd57375ed3c62566c789"} Jun 09 10:05:05.911174 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:05.911134 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" event={"ID":"c824cc31-0663-4471-8651-25fe4920d4e2","Type":"ContainerStarted","Data":"8a6714e4f68a11901ce17858e8cc267f6eb07f0986cff354b19f19cf5f266b82"} Jun 09 10:05:06.917724 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:06.917688 2561 generic.go:356] "Generic (PLEG): container finished" podID="c824cc31-0663-4471-8651-25fe4920d4e2" containerID="8a6714e4f68a11901ce17858e8cc267f6eb07f0986cff354b19f19cf5f266b82" exitCode=0 Jun 09 10:05:06.918157 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:06.917775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" event={"ID":"c824cc31-0663-4471-8651-25fe4920d4e2","Type":"ContainerDied","Data":"8a6714e4f68a11901ce17858e8cc267f6eb07f0986cff354b19f19cf5f266b82"} Jun 09 10:05:08.930516 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:08.930477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" event={"ID":"c824cc31-0663-4471-8651-25fe4920d4e2","Type":"ContainerStarted","Data":"aa1640fc58f6303a616ed973899f336fa3b5dceb9c9e3b671527ed81e708a040"} Jun 09 10:05:08.949577 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:08.949520 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" podStartSLOduration=2.601143799 podStartE2EDuration="8.949503057s" totalImagesPullingTime="5.035390363s" totalInitContainerRuntime="1.312968895s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:05:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:05:08.946882896 +0000 UTC m=+915.285047290" watchObservedRunningTime="2026-06-09 10:05:08.949503057 +0000 UTC m=+915.287667449" Jun 09 10:05:11.149683 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:11.149637 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:11.150105 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:11.149747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:11.166283 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:11.166257 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:11.959351 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:11.959320 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b" Jun 09 10:05:17.941898 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:17.941863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:05:18.405044 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:18.405009 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:05:28.037192 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:28.037152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:05:28.512960 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:28.512922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:05:50.818183 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.818148 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp"] Jun 09 10:05:50.820950 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.820934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.824735 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.824712 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 10:05:50.842406 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.842379 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp"] Jun 09 10:05:50.899908 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.899878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcbh8\" (UniqueName: \"kubernetes.io/projected/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kube-api-access-fcbh8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.900106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.899935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.900106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.899982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.900106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.900015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.900106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.900056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.900106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.900088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:50.947986 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:50.947945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:05:51.000539 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000731 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000731 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000731 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000731 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000731 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcbh8\" (UniqueName: \"kubernetes.io/projected/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kube-api-access-fcbh8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.000985 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000906 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.001046 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.000995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.001046 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.001022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.002933 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.002909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.003175 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.003156 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.008891 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.008873 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcbh8\" (UniqueName: \"kubernetes.io/projected/f0b5539b-2e78-4cbc-8f65-3ec6e413d913-kube-api-access-fcbh8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp\" (UID: \"f0b5539b-2e78-4cbc-8f65-3ec6e413d913\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.131508 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.131475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:05:51.270245 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.270215 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp"] Jun 09 10:05:51.272451 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:05:51.272421 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b5539b_2e78_4cbc_8f65_3ec6e413d913.slice/crio-8c55086c78d369e49c46c71f91a870916dd8b84ab74a7e695b9d6c12df2aab88 WatchSource:0}: Error finding container 8c55086c78d369e49c46c71f91a870916dd8b84ab74a7e695b9d6c12df2aab88: Status 404 returned error can't find the container with id 8c55086c78d369e49c46c71f91a870916dd8b84ab74a7e695b9d6c12df2aab88 Jun 09 10:05:51.523840 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:51.523745 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:05:52.135528 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:52.135496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" event={"ID":"f0b5539b-2e78-4cbc-8f65-3ec6e413d913","Type":"ContainerStarted","Data":"67d038f04cd58cc9955641e91fa1d8992fc990fd8cc88c5fe856e155ccf467ad"} Jun 09 10:05:52.135936 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:52.135545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" event={"ID":"f0b5539b-2e78-4cbc-8f65-3ec6e413d913","Type":"ContainerStarted","Data":"8c55086c78d369e49c46c71f91a870916dd8b84ab74a7e695b9d6c12df2aab88"} Jun 09 10:05:53.141394 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:53.141355 2561 generic.go:356] "Generic (PLEG): container finished" podID="f0b5539b-2e78-4cbc-8f65-3ec6e413d913" containerID="67d038f04cd58cc9955641e91fa1d8992fc990fd8cc88c5fe856e155ccf467ad" exitCode=0 Jun 09 10:05:53.141844 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:53.141441 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" event={"ID":"f0b5539b-2e78-4cbc-8f65-3ec6e413d913","Type":"ContainerDied","Data":"67d038f04cd58cc9955641e91fa1d8992fc990fd8cc88c5fe856e155ccf467ad"} Jun 09 10:05:53.141942 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:53.141928 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 10:05:54.147834 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:54.147786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" event={"ID":"f0b5539b-2e78-4cbc-8f65-3ec6e413d913","Type":"ContainerStarted","Data":"214b9622005e5033873332749f7187dcfaa586462ae192b8da704ced423007ca"} Jun 09 10:05:54.166634 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:05:54.166580 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" podStartSLOduration=2.697520276 podStartE2EDuration="4.166560245s" totalImagesPullingTime="212.999034ms" totalInitContainerRuntime="1.256040935s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:05:54.16542851 +0000 UTC m=+960.503592903" watchObservedRunningTime="2026-06-09 10:05:54.166560245 +0000 UTC m=+960.504724637" Jun 09 10:06:01.132596 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:01.132558 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:06:01.133145 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:01.132858 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:06:01.145320 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:01.145294 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:06:01.193409 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:01.193377 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp" Jun 09 10:06:02.167634 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:02.167602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:06:02.269696 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:02.269630 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:06:14.793345 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.793252 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r"] Jun 09 10:06:14.796330 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.796294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.798390 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.798368 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 10:06:14.817628 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.817593 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r"] Jun 09 10:06:14.826405 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.826642 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.826739 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.826803 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9xj\" (UniqueName: \"kubernetes.io/projected/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kube-api-access-8d9xj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.826865 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.826865 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.826853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.868347 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.868307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:06:14.927980 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.927946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928209 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928209 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928209 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928209 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9xj\" (UniqueName: \"kubernetes.io/projected/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kube-api-access-8d9xj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928209 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928696 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928819 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.928819 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.928733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.930566 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.930548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.930881 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.930864 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:14.946084 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:14.946039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9xj\" (UniqueName: \"kubernetes.io/projected/7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb-kube-api-access-8d9xj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r\" (UID: \"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:15.107480 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:15.107439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:06:15.246951 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:15.246916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r"] Jun 09 10:06:15.251231 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:06:15.251205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7dd37e_2a6f_4cfe_8800_a4df25ef62bb.slice/crio-d0479735a82219dfbc0cfdf2f8541de4b3b024f22e987ead4f968c95f6536a03 WatchSource:0}: Error finding container d0479735a82219dfbc0cfdf2f8541de4b3b024f22e987ead4f968c95f6536a03: Status 404 returned error can't find the container with id d0479735a82219dfbc0cfdf2f8541de4b3b024f22e987ead4f968c95f6536a03 Jun 09 10:06:15.607254 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:15.607216 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:06:16.259898 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:16.259863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" event={"ID":"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb","Type":"ContainerStarted","Data":"d76bddeb952198bcfa81b200cab2fafcd595102783911f42fed6c6328cf8ce4a"} Jun 09 10:06:16.260426 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:16.259922 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" event={"ID":"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb","Type":"ContainerStarted","Data":"d0479735a82219dfbc0cfdf2f8541de4b3b024f22e987ead4f968c95f6536a03"} Jun 09 10:06:23.057451 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:23.057414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:06:23.921559 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:23.921521 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:06:54.156127 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:06:54.156092 2561 scope.go:117] "RemoveContainer" containerID="e0543c675ed139c1f0b5810212f153ee9403d277fce52b1fda24acedc4ffc28e" Jun 09 10:07:57.771627 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:07:57.771590 2561 generic.go:356] "Generic (PLEG): container finished" podID="7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb" containerID="d76bddeb952198bcfa81b200cab2fafcd595102783911f42fed6c6328cf8ce4a" exitCode=0 Jun 09 10:07:57.772242 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:07:57.771665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" event={"ID":"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb","Type":"ContainerDied","Data":"d76bddeb952198bcfa81b200cab2fafcd595102783911f42fed6c6328cf8ce4a"} Jun 09 10:07:58.777688 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:07:58.777652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" event={"ID":"7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb","Type":"ContainerStarted","Data":"8875f23087005860a7b43ff7cba8fcf87a675c53eae4a58bcb6def86e88746c4"} Jun 09 10:07:58.795166 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:07:58.795110 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" podStartSLOduration=2.184400837 podStartE2EDuration="1m44.795090325s" totalImagesPullingTime="255.569367ms" totalInitContainerRuntime="1m42.355120121s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:07:58.794166404 +0000 UTC m=+1085.132330796" watchObservedRunningTime="2026-06-09 10:07:58.795090325 +0000 UTC m=+1085.133254710" Jun 09 10:08:05.108433 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:05.108377 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:08:05.108433 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:05.108455 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:08:05.121121 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:05.121095 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:08:05.822013 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:05.821984 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r" Jun 09 10:08:07.792860 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:07.792827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:08:07.898978 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:07.898946 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:08:08.845476 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:08.845429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:08:08.941893 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:08.941859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:08:30.104169 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:30.104127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:08:30.154247 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:08:30.154205 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:09:13.115413 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:13.115321 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:09:22.841505 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:22.841467 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:09:32.023032 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:32.022996 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:09:42.310840 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:42.310809 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:09:43.270106 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:43.270053 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:09:51.514294 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:51.514253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:09:54.161937 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:54.161904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 10:09:54.165053 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:09:54.165026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj987_d1f0e0af-3cdc-4d75-8172-1fe2050b36e6/ovn-acl-logging/0.log" Jun 09 10:10:01.125692 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:01.125655 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:10:09.195132 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:09.195093 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:10:11.105543 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:11.105509 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:10:34.547693 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:34.547650 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:10:37.629779 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:37.629740 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qw6xc"] Jun 09 10:10:47.701733 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:47.701655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55f8bc7b47-hlk8p_617ee310-f557-4a68-b1f2-16ed1fba4131/nginx/0.log" Jun 09 10:10:47.817410 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:47.817377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mr86x_feddf805-7da0-4260-b34a-ece6a16fcc41/manager/0.log" Jun 09 10:10:47.940696 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:47.940652 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gqkc6_fae06b9a-9a33-482f-a4c6-5b2299a179e3/manager/0.log" Jun 09 10:10:48.289059 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:48.289033 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hm57j_8b7fe1ae-e432-48aa-b430-29536cf141e0/server/0.log" Jun 09 10:10:48.416668 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:48.416638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-n48lk_f6012752-aac5-465f-904c-1759a1f3ef5d/manager/0.log" Jun 09 10:10:48.681646 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:48.681619 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d57cfb98-bpljp_4ffa4c18-3d7a-4c98-befa-f2321c6d127a/copy-manifests/0.log" Jun 09 10:10:48.714991 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:48.714965 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d57cfb98-bpljp_4ffa4c18-3d7a-4c98-befa-f2321c6d127a/manager/0.log" Jun 09 10:10:50.860474 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:50.860442 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6cqdc_5c35e3e4-b0bd-47de-bddf-38ae709c51ed/manager/0.log" Jun 09 10:10:50.987993 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:50.987960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qw6xc_c7242bc9-5f30-4414-b557-95ef364a7a3b/limitador/0.log" Jun 09 10:10:51.579576 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:51.579547 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gw67p_58669dd3-b3c9-480e-800f-42f64a3d274b/discovery/0.log" Jun 09 10:10:51.806642 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:51.806615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5784d47dd-gwbqb_76afe536-214f-48fa-a317-a4b211734770/kube-auth-proxy/0.log" Jun 09 10:10:52.634279 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:52.634247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b_c824cc31-0663-4471-8651-25fe4920d4e2/storage-initializer/0.log" Jun 09 10:10:52.642118 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:52.642094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2hc5b_c824cc31-0663-4471-8651-25fe4920d4e2/main/0.log" Jun 09 10:10:53.011447 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:53.011371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp_f0b5539b-2e78-4cbc-8f65-3ec6e413d913/storage-initializer/0.log" Jun 09 10:10:53.019000 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:53.018980 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbw9sp_f0b5539b-2e78-4cbc-8f65-3ec6e413d913/main/0.log" Jun 09 10:10:53.129132 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:53.129105 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r_7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb/storage-initializer/0.log" Jun 09 10:10:53.136928 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:53.136904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-qwl7r_7d7dd37e-2a6f-4cfe-8800-a4df25ef62bb/main/0.log" Jun 09 10:10:57.942455 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:57.942420 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:10:58.173725 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:10:58.173694 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" limit=1024 Jun 09 10:11:01.225561 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:01.225531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kj5qw_c79d695d-1c50-4615-92b6-fdeb47568249/global-pull-secret-syncer/0.log" Jun 09 10:11:01.547432 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:01.547358 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6c2f5_2e14c76b-8aa3-40dc-b2c2-d5ff5b6e0ba4/konnectivity-agent/0.log" Jun 09 10:11:01.736844 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:01.736814 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-235.ec2.internal_7e8ac733885f854b6bb0b0e9b6af4d5b/haproxy/0.log" Jun 09 10:11:03.759272 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:03.759236 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-2grsd_310b5dd6-5cd4-4f34-9699-994734bbd206/sail-operator/0.log" Jun 09 10:11:06.720089 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:06.720028 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6cqdc_5c35e3e4-b0bd-47de-bddf-38ae709c51ed/manager/0.log" Jun 09 10:11:06.818168 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:06.818139 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qw6xc_c7242bc9-5f30-4414-b557-95ef364a7a3b/limitador/0.log" Jun 09 10:11:08.837033 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:08.837003 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/alertmanager/0.log" Jun 09 10:11:08.909349 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:08.909276 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/config-reloader/0.log" Jun 09 10:11:08.960424 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:08.960394 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/kube-rbac-proxy-web/0.log" Jun 09 10:11:09.029711 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.029683 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/kube-rbac-proxy/0.log" Jun 09 10:11:09.091121 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.091097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/kube-rbac-proxy-metric/0.log" Jun 09 10:11:09.176737 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.176660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/prom-label-proxy/0.log" Jun 09 10:11:09.226944 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.226915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2141d8ec-1f93-4306-8ac1-887ac66ce0ec/init-config-reloader/0.log" Jun 09 10:11:09.335521 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.335492 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-state-metrics/0.log" Jun 09 10:11:09.424737 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.424705 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-rbac-proxy-main/0.log" Jun 09 10:11:09.626383 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.626353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-6d7j4_a46209b2-e489-4720-9318-53769b4c500e/kube-rbac-proxy-self/0.log" Jun 09 10:11:09.944959 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:09.944870 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-xhgpd_00ff0fec-2750-4912-b0bc-fe137dd48992/monitoring-plugin/0.log" Jun 09 10:11:10.013470 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.013440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/node-exporter/0.log" Jun 09 10:11:10.146185 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.146157 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/kube-rbac-proxy/0.log" Jun 09 10:11:10.310277 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.310199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2mlmg_2a7888aa-638b-414f-9ab0-22055b65ac48/init-textfile/0.log" Jun 09 10:11:10.960675 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.960637 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv"] Jun 09 10:11:10.964277 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.964259 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.978031 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.978003 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzdnq\"/\"kube-root-ca.crt\"" Jun 09 10:11:10.978362 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.978346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzdnq\"/\"openshift-service-ca.crt\"" Jun 09 10:11:10.978419 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.978354 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fzdnq\"/\"default-dockercfg-m5l8x\"" Jun 09 10:11:10.990508 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-proc\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.990508 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9dvv\" (UniqueName: \"kubernetes.io/projected/f032688f-41b6-40c3-af5a-6bfe1ffec598-kube-api-access-v9dvv\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.990702 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-podres\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.990702 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-sys\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.990702 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-lib-modules\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:10.990702 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:10.990664 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv"] Jun 09 10:11:11.091562 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-proc\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091562 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9dvv\" (UniqueName: \"kubernetes.io/projected/f032688f-41b6-40c3-af5a-6bfe1ffec598-kube-api-access-v9dvv\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-podres\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-sys\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-lib-modules\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-proc\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-podres\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-sys\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.091824 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.091798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f032688f-41b6-40c3-af5a-6bfe1ffec598-lib-modules\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.110308 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.110278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9dvv\" (UniqueName: \"kubernetes.io/projected/f032688f-41b6-40c3-af5a-6bfe1ffec598-kube-api-access-v9dvv\") pod \"perf-node-gather-daemonset-54dfv\" (UID: \"f032688f-41b6-40c3-af5a-6bfe1ffec598\") " pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.274371 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.274276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.420544 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.420518 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv"] Jun 09 10:11:11.423343 ip-10-0-138-235 kubenswrapper[2561]: W0609 10:11:11.423312 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf032688f_41b6_40c3_af5a_6bfe1ffec598.slice/crio-4fe2b0a5b285d954a535e9b7bb20f05acf1381f57befd565499e87fd7e9277a6 WatchSource:0}: Error finding container 4fe2b0a5b285d954a535e9b7bb20f05acf1381f57befd565499e87fd7e9277a6: Status 404 returned error can't find the container with id 4fe2b0a5b285d954a535e9b7bb20f05acf1381f57befd565499e87fd7e9277a6 Jun 09 10:11:11.625423 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.625395 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f6c8ccf8-q75fb_1d62f279-3776-4ea2-b5b6-67f3ee6dd187/telemeter-client/0.log" Jun 09 10:11:11.689973 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.689945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f6c8ccf8-q75fb_1d62f279-3776-4ea2-b5b6-67f3ee6dd187/reload/0.log" Jun 09 10:11:11.748481 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.748451 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75f6c8ccf8-q75fb_1d62f279-3776-4ea2-b5b6-67f3ee6dd187/kube-rbac-proxy/0.log" Jun 09 10:11:11.749036 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.749012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" event={"ID":"f032688f-41b6-40c3-af5a-6bfe1ffec598","Type":"ContainerStarted","Data":"2621d7e1bad883553eecc4ed52a79dc7e7f556aa22f5e06341bc57b76584c53b"} Jun 09 10:11:11.749180 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.749065 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:11.749180 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.749107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" event={"ID":"f032688f-41b6-40c3-af5a-6bfe1ffec598","Type":"ContainerStarted","Data":"4fe2b0a5b285d954a535e9b7bb20f05acf1381f57befd565499e87fd7e9277a6"} Jun 09 10:11:11.783002 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:11.782953 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" podStartSLOduration=1.7829373689999999 podStartE2EDuration="1.782937369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:11:11.78129039 +0000 UTC m=+1278.119454783" watchObservedRunningTime="2026-06-09 10:11:11.782937369 +0000 UTC m=+1278.121101761" Jun 09 10:11:17.681894 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:17.681862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xx6cd_e9dfb9f7-31d4-4f80-a353-736d0c19f79d/dns/0.log" Jun 09 10:11:17.713530 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:17.713503 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xx6cd_e9dfb9f7-31d4-4f80-a353-736d0c19f79d/kube-rbac-proxy/0.log" Jun 09 10:11:17.764554 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:17.764524 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fzdnq/perf-node-gather-daemonset-54dfv" Jun 09 10:11:17.852785 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:17.852753 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hj5nf_8ab09d4b-c5e5-4718-b06c-b5625af33450/dns-node-resolver/0.log" Jun 09 10:11:18.762033 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:18.761991 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9p27q_a6457218-4f7e-453e-9a2f-7ef803c28adf/node-ca/0.log" Jun 09 10:11:20.209107 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:20.209050 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gw67p_58669dd3-b3c9-480e-800f-42f64a3d274b/discovery/0.log" Jun 09 10:11:20.265333 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:20.265299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5784d47dd-gwbqb_76afe536-214f-48fa-a317-a4b211734770/kube-auth-proxy/0.log" Jun 09 10:11:21.229129 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:21.229049 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4kvp_d7e001e2-a759-4934-8ec3-3e9ef644ec51/serve-healthcheck-canary/0.log" Jun 09 10:11:21.918222 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:21.918146 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tzxv_6517f9fe-5b98-44af-ac31-bf7bcecf4cb2/kube-rbac-proxy/0.log" Jun 09 10:11:21.950508 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:21.950479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tzxv_6517f9fe-5b98-44af-ac31-bf7bcecf4cb2/exporter/0.log" Jun 09 10:11:21.972287 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:21.972250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7tzxv_6517f9fe-5b98-44af-ac31-bf7bcecf4cb2/extractor/0.log" Jun 09 10:11:24.550626 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.550582 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55f8bc7b47-hlk8p_617ee310-f557-4a68-b1f2-16ed1fba4131/nginx/0.log" Jun 09 10:11:24.585595 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.585562 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mr86x_feddf805-7da0-4260-b34a-ece6a16fcc41/manager/0.log" Jun 09 10:11:24.638561 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.638525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gqkc6_fae06b9a-9a33-482f-a4c6-5b2299a179e3/manager/0.log" Jun 09 10:11:24.741817 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.741787 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hm57j_8b7fe1ae-e432-48aa-b430-29536cf141e0/server/0.log" Jun 09 10:11:24.790764 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.790731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-n48lk_f6012752-aac5-465f-904c-1759a1f3ef5d/manager/0.log" Jun 09 10:11:24.892039 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.892005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d57cfb98-bpljp_4ffa4c18-3d7a-4c98-befa-f2321c6d127a/manager/0.log" Jun 09 10:11:24.911238 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:24.911212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d57cfb98-bpljp_4ffa4c18-3d7a-4c98-befa-f2321c6d127a/copy-manifests/0.log" Jun 09 10:11:25.366937 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:25.366905 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gw67p_58669dd3-b3c9-480e-800f-42f64a3d274b/discovery/0.log" Jun 09 10:11:25.394234 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:25.394210 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5784d47dd-gwbqb_76afe536-214f-48fa-a317-a4b211734770/kube-auth-proxy/0.log" Jun 09 10:11:26.502993 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:26.502962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gw67p_58669dd3-b3c9-480e-800f-42f64a3d274b/discovery/0.log" Jun 09 10:11:26.536418 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:26.536391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5784d47dd-gwbqb_76afe536-214f-48fa-a317-a4b211734770/kube-auth-proxy/0.log" Jun 09 10:11:26.594356 ip-10-0-138-235 kubenswrapper[2561]: I0609 10:11:26.594323 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cfnrv_c617ebb5-e54d-4648-9b81-d93f99fce2ea/openshift-lws-operator/0.log"