Jul 09 14:39:59.170739 ip-10-0-135-41 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:39:59.610462 ip-10-0-135-41 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:39:59.610462 ip-10-0-135-41 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:39:59.610462 ip-10-0-135-41 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:39:59.610462 ip-10-0-135-41 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:39:59.610462 ip-10-0-135-41 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:39:59.611786 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.611692 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:39:59.616957 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616939 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.616957 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616957 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616961 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616966 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616969 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616973 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616976 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616980 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616983 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616986 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616989 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616992 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616995 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.616997 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617001 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617011 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617015 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617019 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617022 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617024 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617027 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.617024 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617030 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617034 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617036 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617040 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617043 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617046 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617049 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617051 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617054 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617057 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617060 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617062 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617065 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617068 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617071 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617073 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617076 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617079 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617084 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.617525 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617088 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617091 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617093 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617096 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617099 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617102 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617104 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617107 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617110 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617114 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617118 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617122 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617124 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617127 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617130 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617134 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617137 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617140 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617143 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.618009 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617146 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617149 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617151 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617154 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617157 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617160 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617163 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617166 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617168 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617171 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617174 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617177 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617179 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617182 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617184 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617188 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617191 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617194 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617196 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617199 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.618561 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617202 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617206 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617209 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617212 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617215 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617217 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617220 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617224 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617229 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617232 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617235 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617239 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617242 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617245 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617248 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617251 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617254 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617257 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617260 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.619069 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.617262 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618060 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618069 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618074 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618077 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618081 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618084 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618087 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618090 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618093 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618095 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618098 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618101 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618104 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618106 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618109 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618113 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618115 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618118 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.619563 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618121 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618124 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618127 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618130 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618133 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618136 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618138 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618141 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618144 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618147 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618149 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618152 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618154 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618157 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618160 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618162 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618166 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618169 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618171 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618174 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.620058 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618177 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618180 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618183 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618185 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618188 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618191 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618194 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618197 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618200 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618203 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618206 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618209 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618212 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618214 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618218 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618221 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618223 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618226 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618229 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618232 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618234 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.620600 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618237 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618240 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618243 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618245 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618248 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618252 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618256 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618260 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618263 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618266 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618269 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618271 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618274 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618277 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618279 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618282 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618285 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618287 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618290 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.621144 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618295 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618298 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618301 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618304 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618307 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618311 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618315 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618318 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618321 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618323 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618326 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618329 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618331 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618334 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618336 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618339 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618342 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618344 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618347 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.621658 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618350 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618353 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618779 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618786 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618789 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618793 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618796 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618799 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618802 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618805 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618808 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618810 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618813 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618816 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618819 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618822 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618825 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618828 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618831 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618834 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.622152 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618837 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618840 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618843 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618847 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618851 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618854 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618857 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618860 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618863 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618866 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618869 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618872 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618876 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618878 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618881 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618884 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618887 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618890 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618893 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.622683 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618895 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618898 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618901 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618903 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618906 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618908 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618911 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618921 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618925 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618928 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618932 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618936 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618938 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618941 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618945 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618949 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618952 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618955 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618958 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618960 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.623167 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618963 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618966 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618969 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618972 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618974 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618977 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618980 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618983 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618986 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618988 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618991 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618993 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618996 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.618999 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619001 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619004 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619008 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619011 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619014 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619016 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.623751 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619019 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619022 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619025 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619028 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619032 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619035 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619038 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619040 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619046 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619050 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619053 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619056 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619059 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619062 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619065 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619067 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619070 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619073 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619075 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.624281 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619078 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619081 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619084 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619160 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619176 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619187 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619194 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619201 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619205 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619210 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619214 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619218 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619221 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619225 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619228 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619232 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619237 2569 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619241 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619245 2569 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619248 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619251 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619258 2569 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619261 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:39:59.624806 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619264 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619268 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619271 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619275 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619279 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619282 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619286 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619289 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619293 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619296 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619299 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619302 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619307 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619310 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619313 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619316 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619319 2569 flags.go:64] FLAG: --enable-server="true" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619322 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619328 2569 flags.go:64] FLAG: --event-burst="100" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619331 2569 flags.go:64] FLAG: --event-qps="50" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619334 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619337 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619340 2569 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619344 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:39:59.625384 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619347 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619352 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619355 2569 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619359 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619362 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619365 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619370 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619373 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619376 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619379 2569 flags.go:64] FLAG: --feature-gates="" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619383 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619386 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619389 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619393 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619396 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619399 2569 flags.go:64] FLAG: --help="false" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619416 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619420 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619423 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619427 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619431 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619435 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619438 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:39:59.626012 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619441 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619444 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619447 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619451 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619454 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619457 2569 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619460 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619463 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619467 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619470 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619475 2569 flags.go:64] FLAG: --lock-file="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619478 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619481 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619485 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619491 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619495 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619498 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619502 2569 flags.go:64] FLAG: --logging-format="text" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619505 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619508 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619512 2569 flags.go:64] FLAG: --manifest-url="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619515 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619519 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619523 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619527 2569 flags.go:64] FLAG: --max-pods="110" Jul 09 14:39:59.626633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619530 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619533 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619536 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619540 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619543 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619546 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619550 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619557 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619560 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619564 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619568 2569 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619571 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619577 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619581 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619584 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619587 2569 flags.go:64] FLAG: --port="10250" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619590 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619594 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0adc9c17fbaf1fee7" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619598 2569 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619602 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619605 2569 flags.go:64] FLAG: --register-node="true" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619609 2569 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619617 2569 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619620 2569 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:39:59.627616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619623 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619626 2569 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619630 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619633 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619636 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619640 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619643 2569 flags.go:64] FLAG: --runonce="false" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619647 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619650 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619654 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619657 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619660 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619663 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619667 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619671 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619674 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619677 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619680 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619683 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619686 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619689 2569 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619693 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619698 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619701 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619704 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:39:59.628436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619708 2569 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619714 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619717 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619720 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619724 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619729 2569 flags.go:64] FLAG: --v="2" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619734 2569 flags.go:64] FLAG: --version="false" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619738 2569 flags.go:64] FLAG: --vmodule="" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619742 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.619745 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619876 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619880 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619883 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619886 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619889 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619892 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619895 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619898 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619900 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619903 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619905 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.629085 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619908 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619911 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619914 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619917 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619919 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619922 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619925 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619928 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619930 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619933 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619936 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619938 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619943 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619946 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619948 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619951 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619956 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619959 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619962 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619965 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.629636 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619967 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619970 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619973 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619975 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619978 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619981 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619984 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619987 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619990 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619992 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619995 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.619997 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620000 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620003 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620005 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620008 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620011 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620013 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620016 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620019 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.630158 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620022 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620025 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620027 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620030 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620034 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620036 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620039 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620042 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620047 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620049 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620054 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620058 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620061 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620064 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620067 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620070 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620074 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620076 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620079 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620082 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.630688 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620084 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620087 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620090 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620093 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620096 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620098 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620103 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620106 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620110 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620113 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620116 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620118 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620121 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620124 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620128 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620132 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620136 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620139 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620141 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.631328 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620145 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620148 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620151 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620154 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620157 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620159 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620162 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620165 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.620167 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.620173 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.629373 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.629391 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.630285 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.630294 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630359 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.631877 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630364 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630368 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630372 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630375 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630378 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630381 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630384 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630388 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630391 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630394 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630397 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630399 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630415 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630419 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630422 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630424 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630427 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630431 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630435 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630438 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.632288 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630441 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630443 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630448 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630452 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630456 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630458 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630462 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630464 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630467 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630470 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630473 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630476 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630479 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630482 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630485 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630488 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630491 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630494 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630499 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.632836 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630502 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630505 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630509 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630512 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630515 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630518 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630522 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630525 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630528 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630531 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630535 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630538 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630541 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630544 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630547 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630550 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630553 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630556 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630558 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630562 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.633337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630564 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630569 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630573 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630577 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630580 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630583 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630606 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630610 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630613 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630617 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630620 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630623 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630626 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630630 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630633 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630636 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630639 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630642 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630645 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630649 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.633908 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630652 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630655 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630658 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630661 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630664 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630666 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630669 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630672 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630675 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630677 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630680 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630683 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630685 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630689 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630692 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630695 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630698 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630701 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.634452 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630704 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.630710 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630841 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630847 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630851 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630856 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630859 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630863 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630866 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630869 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630872 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630875 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630878 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630881 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630885 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:39:59.634926 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630888 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630891 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630894 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630896 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630899 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630902 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630905 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630908 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630911 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630914 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630916 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630919 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630922 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630925 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630927 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630930 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630933 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630936 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630939 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630941 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:39:59.635320 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630944 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630947 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630951 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630955 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630958 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630961 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630964 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630967 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630970 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630973 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630976 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630978 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630982 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630985 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630988 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630991 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630993 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630996 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.630999 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:39:59.635953 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631002 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631005 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631008 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631011 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631013 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631016 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631019 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631021 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631024 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631027 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631030 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631032 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631035 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631039 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631042 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631045 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631047 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631050 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631053 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:39:59.636466 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631055 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631058 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631061 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631064 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631066 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631070 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631072 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631075 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631078 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631081 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631083 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631086 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631089 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631091 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631094 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631097 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631099 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631102 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631105 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631108 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:39:59.636943 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631110 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631113 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631116 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631119 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631121 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631124 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631127 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:39:59.631129 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.631135 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.631244 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.634518 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.636306 2569 server.go:1019] "Starting client certificate rotation" Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.636445 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:39:59.637512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.636487 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:39:59.639024 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.639008 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:39:59.643017 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.642999 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:39:59.653626 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.653600 2569 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:39:59.656947 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.656930 2569 log.go:25] "Validated CRI v1 image API" Jul 09 14:39:59.658604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.658590 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:39:59.660994 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.660974 2569 fs.go:135] Filesystem UUIDs: map[6cc483ac-fde7-4015-a740-81d2c2bcfc4c:/dev/nvme0n1p3 77ec13cd-68be-4bfc-884c-129414a97d2b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 14:39:59.661052 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.660995 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:39:59.667968 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.667934 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:39:59.671867 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.671744 2569 manager.go:216] Machine: {Timestamp:2026-07-09 14:39:59.66913251 +0000 UTC m=+0.370752952 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099523 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d97244d85ecbec3264c4daa976f8 SystemUUID:ec20d972-44d8-5ecb-ec32-64c4daa976f8 BootID:71a98d1b-1ba9-4c79-8741-38e332ee7bfa Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:4b:64:ec:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:4b:64:ec:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:14:d5:32:ca:6d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:39:59.671867 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.671857 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:39:59.672003 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.671952 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:39:59.676432 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.676389 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:39:59.676580 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.676435 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:39:59.677291 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.677281 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:39:59.677325 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.677294 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:39:59.677325 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.677302 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:39:59.678098 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.678087 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:39:59.679676 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.679665 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:39:59.683452 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683439 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:39:59.683584 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683574 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:39:59.683620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683608 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:39:59.683652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683622 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:39:59.683685 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683651 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:39:59.683685 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683666 2569 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:39:59.683685 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.683679 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:39:59.684138 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.684123 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:39:59.684199 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.684144 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:39:59.686888 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.686870 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:39:59.689348 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689331 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:39:59.689461 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689373 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:39:59.689602 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689589 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:39:59.689666 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689609 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:39:59.689666 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689619 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:39:59.689666 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689630 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:39:59.689666 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689642 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:39:59.689666 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.689651 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:39:59.690099 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690088 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:39:59.690150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690101 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:39:59.690150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690113 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:39:59.690150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690123 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:39:59.690150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690143 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:39:59.690286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.690158 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:39:59.691840 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.691827 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:39:59.691902 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.691842 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:39:59.695269 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.695251 2569 server.go:1268] "Started kubelet" Jul 09 14:39:59.695446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.695340 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:39:59.695446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.695410 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:39:59.695615 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.695496 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:39:59.695693 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.695663 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:39:59.695791 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.695768 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:39:59.695856 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.695840 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:39:59.696350 ip-10-0-135-41 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:39:59.697066 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.697050 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:39:59.698335 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.698318 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:39:59.701901 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.701880 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:39:59.704451 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.704430 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:39:59.705444 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.705427 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:39:59.705676 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.705608 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:39:59.706245 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706228 2569 factory.go:55] Registering systemd factory Jul 09 14:39:59.706319 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706267 2569 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:39:59.706389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706358 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:39:59.706438 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706363 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:39:59.706438 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706405 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:39:59.706511 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706486 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:39:59.706511 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706496 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:39:59.706578 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706546 2569 factory.go:153] Registering CRI-O factory Jul 09 14:39:59.706578 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706561 2569 factory.go:223] Registration of the crio container factory successfully Jul 09 14:39:59.706649 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706638 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:39:59.706682 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706660 2569 factory.go:103] Registering Raw factory Jul 09 14:39:59.706719 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.706682 2569 manager.go:1196] Started watching for new ooms in manager Jul 09 14:39:59.707372 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.707356 2569 manager.go:349] Starting recovery of all containers Jul 09 14:39:59.708424 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.708398 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:39:59.709502 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.708516 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069860f5b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.695222199 +0000 UTC m=+0.396842640,LastTimestamp:2026-07-09 14:39:59.695222199 +0000 UTC m=+0.396842640,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.716900 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.716783 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:39:59.719992 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.719976 2569 manager.go:354] Recovery completed Jul 09 14:39:59.724541 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.724527 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.726456 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726430 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.726547 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726468 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.726547 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726479 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.726983 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726967 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:39:59.726983 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726984 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:39:59.727132 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.727004 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:39:59.727132 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.726975 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.727925 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.727905 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.727989 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.727944 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.727989 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.727962 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.728246 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.728182 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3d831a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.72645353 +0000 UTC m=+0.428073974,LastTimestamp:2026-07-09 14:39:59.72645353 +0000 UTC m=+0.428073974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.728399 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.728388 2569 policy_none.go:49] "None policy: Start" Jul 09 14:39:59.728469 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.728402 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:39:59.728469 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.728414 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:39:59.729864 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.729852 2569 policy_none.go:47] "Start" Jul 09 14:39:59.741053 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.740980 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3dcf53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.726473043 +0000 UTC m=+0.428093484,LastTimestamp:2026-07-09 14:39:59.726473043 +0000 UTC m=+0.428093484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.753928 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.753853 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3df691 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.726483089 +0000 UTC m=+0.428103530,LastTimestamp:2026-07-09 14:39:59.726483089 +0000 UTC m=+0.428103530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.762228 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.762163 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18c0a6069a3d831a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3d831a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.72645353 +0000 UTC m=+0.428073974,LastTimestamp:2026-07-09 14:39:59.727926326 +0000 UTC m=+0.429546773,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.769031 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769014 2569 manager.go:337] "Starting Device Plugin manager" Jul 09 14:39:59.769096 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.769045 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:39:59.769096 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769055 2569 server.go:87] "Starting device plugin registration server" Jul 09 14:39:59.769381 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769357 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:39:59.769444 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769374 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:39:59.769520 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769465 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:39:59.769572 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769555 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:39:59.769572 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.769564 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:39:59.770168 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.770145 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:39:59.770256 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.770208 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:39:59.772419 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.772339 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18c0a6069a3dcf53\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3dcf53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.726473043 +0000 UTC m=+0.428093484,LastTimestamp:2026-07-09 14:39:59.727952446 +0000 UTC m=+0.429572887,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.786637 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.786541 2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-41.ec2.internal.18c0a6069a3df691\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069a3df691 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-41.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.726483089 +0000 UTC m=+0.428103530,LastTimestamp:2026-07-09 14:39:59.727968678 +0000 UTC m=+0.429589120,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.795346 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.795270 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-41.ec2.internal.18c0a6069ceac720 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-41.ec2.internal,UID:ip-10-0-135-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-41.ec2.internal,},FirstTimestamp:2026-07-09 14:39:59.771363104 +0000 UTC m=+0.472983531,LastTimestamp:2026-07-09 14:39:59.771363104 +0000 UTC m=+0.472983531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-41.ec2.internal,}" Jul 09 14:39:59.812086 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.799676 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nczwt" Jul 09 14:39:59.812086 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.808474 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nczwt" Jul 09 14:39:59.854641 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.854608 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:39:59.856002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.855982 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:39:59.856116 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.856029 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:39:59.856116 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.856063 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:39:59.856116 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.856108 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:39:59.869808 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.869754 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.870606 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.870589 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:39:59.870673 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.870592 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.870673 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.870639 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.870673 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.870650 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.870767 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.870677 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.878939 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.878922 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.878989 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.878948 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-41.ec2.internal\": node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:39:59.906944 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.906921 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:39:59.958809 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.958763 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal"] Jul 09 14:39:59.959000 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.958848 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.960760 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.960735 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.960877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.960773 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.960877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.960786 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.962235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962222 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.962399 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962383 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.962455 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962419 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.962975 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962954 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.962975 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962971 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.963092 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962984 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.963092 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962991 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.963092 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.962995 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.963092 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.963001 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.964222 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.964209 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.964271 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.964233 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:39:59.964915 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.964894 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:39:59.965030 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.964929 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:39:59.965030 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:39:59.964943 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:39:59.988348 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.988326 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal" Jul 09 14:39:59.993319 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:39:59.993296 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-41.ec2.internal\" not found" node="ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.007876 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.007850 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.007964 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.007909 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.007964 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.007933 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.007964 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.007961 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109064 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.109014 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.109064 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109302 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109302 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109148 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109302 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109171 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14ea56247a743af792af701f2d2e5eef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal\" (UID: \"14ea56247a743af792af701f2d2e5eef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109302 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.109302 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.109230 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/daf4e3bb9336c51a7b1e768dcaf8ad41-config\") pod \"kube-apiserver-proxy-ip-10-0-135-41.ec2.internal\" (UID: \"daf4e3bb9336c51a7b1e768dcaf8ad41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.209177 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.209091 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.297121 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.297092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.297213 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.297097 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:00.310040 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.310019 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.410820 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.410778 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.511158 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.511064 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.613180 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.613131 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.636002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.635980 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:40:00.636142 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.636125 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:40:00.713805 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.713780 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.773963 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.773871 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:00.775100 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.775080 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:00.775214 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.775112 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:00.775214 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.775129 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:00.812496 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.812462 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:35:00 +0000 UTC" deadline="2028-04-26 02:59:36.20509455 +0000 UTC" Jul 09 14:40:00.812496 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.812493 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15756h19m35.392604408s" Jul 09 14:40:00.814800 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.814785 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.915639 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:00.915589 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-41.ec2.internal\" not found" Jul 09 14:40:00.992896 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.992864 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:00.994560 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:00.994536 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:01.006198 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.006176 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" Jul 09 14:40:01.008854 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.008839 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:01.017686 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.017666 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:40:01.018517 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.018504 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" Jul 09 14:40:01.029205 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.029160 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:40:01.410865 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:01.410823 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ea56247a743af792af701f2d2e5eef.slice/crio-12cc065e1239182f9505f1e4263a70342e37fd630f2820c192a35657038d3485 WatchSource:0}: Error finding container 12cc065e1239182f9505f1e4263a70342e37fd630f2820c192a35657038d3485: Status 404 returned error can't find the container with id 12cc065e1239182f9505f1e4263a70342e37fd630f2820c192a35657038d3485 Jul 09 14:40:01.411337 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:01.411321 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf4e3bb9336c51a7b1e768dcaf8ad41.slice/crio-dad6ab01e9dd6e6b027e38dca9802f189c5d983a15934ff3a3959d07c2ee75ae WatchSource:0}: Error finding container dad6ab01e9dd6e6b027e38dca9802f189c5d983a15934ff3a3959d07c2ee75ae: Status 404 returned error can't find the container with id dad6ab01e9dd6e6b027e38dca9802f189c5d983a15934ff3a3959d07c2ee75ae Jul 09 14:40:01.417277 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.417260 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:40:01.563240 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.563155 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:01.687543 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.687505 2569 apiserver.go:52] "Watching apiserver" Jul 09 14:40:01.693264 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.693240 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:40:01.693638 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.693618 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-r4b2g","kube-system/global-pull-secret-syncer-l4n4r","kube-system/konnectivity-agent-s55sb","openshift-dns/node-resolver-t7xxx","openshift-image-registry/node-ca-lgg82","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal","openshift-multus/multus-additional-cni-plugins-59v8j","openshift-ovn-kubernetes/ovnkube-node-x72nh","kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676","openshift-cluster-node-tuning-operator/tuned-twhx4","openshift-multus/multus-gfclj","openshift-multus/network-metrics-daemon-xqjx7","openshift-network-diagnostics/network-check-target-7f8wm"] Jul 09 14:40:01.696445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.696425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.697670 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.697649 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.697787 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.697712 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:01.698626 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.698607 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.698724 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.698658 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:40:01.698783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.698734 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:40:01.698908 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.698890 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.698981 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.698965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.699322 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.699293 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:40:01.699435 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.699395 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wcdb9\"" Jul 09 14:40:01.700405 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.700390 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.701317 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.701302 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:40:01.701533 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.701520 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqv4r\"" Jul 09 14:40:01.701619 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.701585 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:40:01.701844 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.701826 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.702773 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.702755 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d8hhh\"" Jul 09 14:40:01.702873 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.702758 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.702924 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.702888 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.703488 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.703473 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:01.703584 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.703551 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:01.704151 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.704137 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.704338 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.704325 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.704986 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.704964 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:40:01.705067 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.705003 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:40:01.705123 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.704970 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pnmf4\"" Jul 09 14:40:01.705277 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.705259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.706772 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.706754 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.707612 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.707594 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6h7mm\"" Jul 09 14:40:01.707788 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.707769 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.707888 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.707771 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.707888 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.707798 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:40:01.709309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.708647 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:40:01.709309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.708712 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.709309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.708771 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:40:01.709309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.708739 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:40:01.709309 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.709119 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:01.710858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.709728 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.710858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.709998 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:40:01.710858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.710015 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.710858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.710284 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4h5c\"" Jul 09 14:40:01.711892 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.711871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.713421 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.713394 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.714286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.714266 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zbz4v\"" Jul 09 14:40:01.714286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.714278 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.714445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.714352 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:40:01.714503 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.714456 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.714871 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.714854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.715790 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.715773 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:40:01.715891 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.715878 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:40:01.715944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.715884 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9dqsr\"" Jul 09 14:40:01.717178 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.717161 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-92dm4\"" Jul 09 14:40:01.717369 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.717351 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:40:01.717469 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.717357 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:40:01.719665 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/454445ef-0672-4b55-b7b4-ccc1e90eba18-hosts-file\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.719755 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719672 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-netns\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.719755 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.719755 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719708 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-binary-copy\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719755 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c366322-4058-4fd0-bda1-5edf4ce439dd-agent-certs\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719781 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56gqh\" (UniqueName: \"kubernetes.io/projected/38445a72-385b-405f-a40f-6f6ba0884485-kube-api-access-56gqh\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454445ef-0672-4b55-b7b4-ccc1e90eba18-tmp-dir\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719829 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-etc-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-bin\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719879 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a5168d-d402-4305-a122-530e2de8dcbb-host-slash\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.719928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-kubelet-config\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719940 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-system-cni-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cnibin\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.719999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-systemd-units\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720050 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-slash\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720067 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-node-log\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720082 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbth\" (UniqueName: \"kubernetes.io/projected/adf8b128-91ac-4ba2-9a4c-ada8c492c327-kube-api-access-sqbth\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c366322-4058-4fd0-bda1-5edf4ce439dd-konnectivity-ca\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720137 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720154 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-serviceca\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-kubelet\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720197 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-log-socket\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720219 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-netd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720235 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxgn\" (UniqueName: \"kubernetes.io/projected/46a5168d-d402-4305-a122-530e2de8dcbb-kube-api-access-8wxgn\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-os-release\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720266 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.720288 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720298 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-env-overrides\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720313 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720329 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh5zj\" (UniqueName: \"kubernetes.io/projected/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-kube-api-access-jh5zj\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-systemd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hzq\" (UniqueName: \"kubernetes.io/projected/454445ef-0672-4b55-b7b4-ccc1e90eba18-kube-api-access-44hzq\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db74f\" (UniqueName: \"kubernetes.io/projected/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-kube-api-access-db74f\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-dbus\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720499 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-host\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-var-lib-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-ovn\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-config\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720612 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovn-node-metrics-cert\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721153 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720632 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-script-lib\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.721978 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46a5168d-d402-4305-a122-530e2de8dcbb-iptables-alerter-script\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.721978 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.720662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.807717 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.807687 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:40:01.820948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.820885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-k8s-cni-cncf-io\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.820948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.820921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.820948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.820944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-env-overrides\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.820969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.820997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-modprobe-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-sys\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821067 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-host\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821102 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hzq\" (UniqueName: \"kubernetes.io/projected/454445ef-0672-4b55-b7b4-ccc1e90eba18-kube-api-access-44hzq\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.821144 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821122 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db74f\" (UniqueName: \"kubernetes.io/projected/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-kube-api-access-db74f\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821204 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-kubernetes\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821229 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-system-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821255 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-host\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821282 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-var-lib-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821306 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-script-lib\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46a5168d-d402-4305-a122-530e2de8dcbb-iptables-alerter-script\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821432 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-host\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821438 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821441 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-var-lib-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.821620 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-os-release\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.822166 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-socket-dir-parent\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.822166 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-netns\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.822166 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-binary-copy\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.822166 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.821807 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:01.822166 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.821893 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:02.321851295 +0000 UTC m=+3.023471737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:01.822427 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822279 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-netns\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.822427 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822336 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46a5168d-d402-4305-a122-530e2de8dcbb-iptables-alerter-script\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.822533 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822464 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.822533 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c366322-4058-4fd0-bda1-5edf4ce439dd-agent-certs\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.822626 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822568 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.822626 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.821959 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-env-overrides\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822843 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-registration-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.822878 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-script-lib\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823019 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-multus\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823049 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cni-binary-copy\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823056 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-multus-certs\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt8mb\" (UniqueName: \"kubernetes.io/projected/50960eb3-25d0-42ee-b719-a4463f7bc070-kube-api-access-nt8mb\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a5168d-d402-4305-a122-530e2de8dcbb-host-slash\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-kubelet-config\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.823273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823245 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvh9\" (UniqueName: \"kubernetes.io/projected/c9f4078c-938c-4825-a090-75d114aa5a3e-kube-api-access-lkvh9\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823289 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46a5168d-d402-4305-a122-530e2de8dcbb-host-slash\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823341 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-kubelet-config\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823326 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823384 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-cnibin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823432 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-bin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-systemd-units\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-slash\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823530 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-systemd-units\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823579 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c366322-4058-4fd0-bda1-5edf4ce439dd-konnectivity-ca\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823626 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-systemd\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-lib-modules\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrwr\" (UniqueName: \"kubernetes.io/projected/8b524f13-dbca-4d08-bb97-763ca29ce08b-kube-api-access-8lrwr\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.823782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-serviceca\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-kubelet\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823841 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxgn\" (UniqueName: \"kubernetes.io/projected/46a5168d-d402-4305-a122-530e2de8dcbb-kube-api-access-8wxgn\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-os-release\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.823992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-socket-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824076 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-kubelet\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824114 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c366322-4058-4fd0-bda1-5edf4ce439dd-konnectivity-ca\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-var-lib-kubelet\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.824388 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824221 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-slash\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.824870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824636 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-serviceca\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.824870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824697 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-kubelet\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.824870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824734 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-os-release\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.824870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824746 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh5zj\" (UniqueName: \"kubernetes.io/projected/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-kube-api-access-jh5zj\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.825093 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.824942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-systemd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825093 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825054 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysconfig\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.825235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-conf-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.825235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-dbus\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.825235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-tmp\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825276 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf8b128-91ac-4ba2-9a4c-ada8c492c327-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-ovn\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-systemd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-config\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825446 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovn-node-metrics-cert\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825395 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-run-ovn\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825447 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-dbus\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-conf\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825562 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-run\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-hostroot\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825646 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-daemon-config\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825678 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-etc-kubernetes\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/454445ef-0672-4b55-b7b4-ccc1e90eba18-hosts-file\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.825776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56gqh\" (UniqueName: \"kubernetes.io/projected/38445a72-385b-405f-a40f-6f6ba0884485-kube-api-access-56gqh\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825812 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-tuned\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454445ef-0672-4b55-b7b4-ccc1e90eba18-tmp-dir\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-etc-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-bin\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.825977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-system-cni-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cnibin\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826036 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbth\" (UniqueName: \"kubernetes.io/projected/adf8b128-91ac-4ba2-9a4c-ada8c492c327-kube-api-access-sqbth\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.826190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-sys-fs\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-node-log\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.826238 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-cni-binary-copy\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.826304 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:02.326285439 +0000 UTC m=+3.027905883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826368 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-run-ovn-kubernetes\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-netns\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826429 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/454445ef-0672-4b55-b7b4-ccc1e90eba18-hosts-file\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826475 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-cnibin\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826489 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-etc-openvswitch\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826539 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-log-socket\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-netd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826647 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-bin\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826652 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-log-socket\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.826711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826668 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovnkube-config\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.827389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826727 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-host-cni-netd\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.827389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826567 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-node-log\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.827389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/454445ef-0672-4b55-b7b4-ccc1e90eba18-tmp-dir\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.827389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826812 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf8b128-91ac-4ba2-9a4c-ada8c492c327-system-cni-dir\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.827389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.826845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-device-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.828128 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.828101 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c366322-4058-4fd0-bda1-5edf4ce439dd-agent-certs\") pod \"konnectivity-agent-s55sb\" (UID: \"6c366322-4058-4fd0-bda1-5edf4ce439dd\") " pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:01.828219 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.828138 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-ovn-node-metrics-cert\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.832732 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.832573 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:01.832732 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.832603 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:01.832732 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.832620 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:01.832732 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:01.832699 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:02.332682101 +0000 UTC m=+3.034302536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:01.832948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.832776 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hzq\" (UniqueName: \"kubernetes.io/projected/454445ef-0672-4b55-b7b4-ccc1e90eba18-kube-api-access-44hzq\") pod \"node-resolver-t7xxx\" (UID: \"454445ef-0672-4b55-b7b4-ccc1e90eba18\") " pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:01.833190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.833141 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db74f\" (UniqueName: \"kubernetes.io/projected/79a64e1b-df4a-4f7c-aed5-e750b5adf05e-kube-api-access-db74f\") pod \"ovnkube-node-x72nh\" (UID: \"79a64e1b-df4a-4f7c-aed5-e750b5adf05e\") " pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:01.833355 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.833325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxgn\" (UniqueName: \"kubernetes.io/projected/46a5168d-d402-4305-a122-530e2de8dcbb-kube-api-access-8wxgn\") pod \"iptables-alerter-r4b2g\" (UID: \"46a5168d-d402-4305-a122-530e2de8dcbb\") " pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:01.834475 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.834446 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh5zj\" (UniqueName: \"kubernetes.io/projected/b80bf0cc-0978-41b7-bf1b-7a620ea31f44-kube-api-access-jh5zj\") pod \"node-ca-lgg82\" (UID: \"b80bf0cc-0978-41b7-bf1b-7a620ea31f44\") " pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:01.834812 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.834795 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gqh\" (UniqueName: \"kubernetes.io/projected/38445a72-385b-405f-a40f-6f6ba0884485-kube-api-access-56gqh\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:01.834927 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.834910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbth\" (UniqueName: \"kubernetes.io/projected/adf8b128-91ac-4ba2-9a4c-ada8c492c327-kube-api-access-sqbth\") pod \"multus-additional-cni-plugins-59v8j\" (UID: \"adf8b128-91ac-4ba2-9a4c-ada8c492c327\") " pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:01.840321 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.840305 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7jrn" Jul 09 14:40:01.848058 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.848043 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7jrn" Jul 09 14:40:01.861995 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.861952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"daf4e3bb9336c51a7b1e768dcaf8ad41","Type":"ContainerStarted","Data":"dad6ab01e9dd6e6b027e38dca9802f189c5d983a15934ff3a3959d07c2ee75ae"} Jul 09 14:40:01.862981 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.862962 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"12cc065e1239182f9505f1e4263a70342e37fd630f2820c192a35657038d3485"} Jul 09 14:40:01.927466 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927436 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-socket-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.927604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-kubelet\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927519 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-var-lib-kubelet\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927547 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysconfig\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-conf-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927640 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-socket-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927640 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-var-lib-kubelet\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927667 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysconfig\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927667 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-kubelet\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-tmp\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927707 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-conf-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-conf\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927756 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-run\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-hostroot\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-daemon-config\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.927825 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-etc-kubernetes\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927833 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-run\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-conf\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927854 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-hostroot\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927863 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-tuned\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927883 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-etc-kubernetes\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-sys-fs\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-sys-fs\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-cni-binary-copy\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.927992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-netns\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-device-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928047 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-k8s-cni-cncf-io\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-device-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928173 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-k8s-cni-cncf-io\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928188 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-netns\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928192 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928231 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-modprobe-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928248 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.928339 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-sys\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928282 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-host\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928323 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-kubernetes\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928367 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-modprobe-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-daemon-config\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928425 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-system-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-system-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-sys\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928479 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-host\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928511 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50960eb3-25d0-42ee-b719-a4463f7bc070-cni-binary-copy\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928530 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-kubernetes\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928538 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-os-release\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-socket-dir-parent\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928602 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-cni-dir\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928609 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-os-release\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-registration-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-multus-socket-dir-parent\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-multus\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9f4078c-938c-4825-a090-75d114aa5a3e-registration-dir\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928700 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-multus-certs\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt8mb\" (UniqueName: \"kubernetes.io/projected/50960eb3-25d0-42ee-b719-a4463f7bc070-kube-api-access-nt8mb\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-multus\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-run-multus-certs\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvh9\" (UniqueName: \"kubernetes.io/projected/c9f4078c-938c-4825-a090-75d114aa5a3e-kube-api-access-lkvh9\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928817 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928844 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-cnibin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-bin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928921 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-host-var-lib-cni-bin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928951 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-systemd\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-lib-modules\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928981 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-sysctl-d\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.929016 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrwr\" (UniqueName: \"kubernetes.io/projected/8b524f13-dbca-4d08-bb97-763ca29ce08b-kube-api-access-8lrwr\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.928951 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50960eb3-25d0-42ee-b719-a4463f7bc070-cnibin\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.929060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-systemd\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.929839 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.929084 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b524f13-dbca-4d08-bb97-763ca29ce08b-lib-modules\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.930560 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.930309 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-tmp\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.930560 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.930395 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b524f13-dbca-4d08-bb97-763ca29ce08b-etc-tuned\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.936855 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.936828 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt8mb\" (UniqueName: \"kubernetes.io/projected/50960eb3-25d0-42ee-b719-a4463f7bc070-kube-api-access-nt8mb\") pod \"multus-gfclj\" (UID: \"50960eb3-25d0-42ee-b719-a4463f7bc070\") " pod="openshift-multus/multus-gfclj" Jul 09 14:40:01.937191 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.937173 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrwr\" (UniqueName: \"kubernetes.io/projected/8b524f13-dbca-4d08-bb97-763ca29ce08b-kube-api-access-8lrwr\") pod \"tuned-twhx4\" (UID: \"8b524f13-dbca-4d08-bb97-763ca29ce08b\") " pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:01.937230 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:01.937187 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvh9\" (UniqueName: \"kubernetes.io/projected/c9f4078c-938c-4825-a090-75d114aa5a3e-kube-api-access-lkvh9\") pod \"aws-ebs-csi-driver-node-l5676\" (UID: \"c9f4078c-938c-4825-a090-75d114aa5a3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:02.009774 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.009727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59v8j" Jul 09 14:40:02.016013 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.015996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7xxx" Jul 09 14:40:02.019310 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.019281 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf8b128_91ac_4ba2_9a4c_ada8c492c327.slice/crio-1dd8399db77701f31ecbc846311a06503e1d452d3d21a0aebef520f5ed1d9aaf WatchSource:0}: Error finding container 1dd8399db77701f31ecbc846311a06503e1d452d3d21a0aebef520f5ed1d9aaf: Status 404 returned error can't find the container with id 1dd8399db77701f31ecbc846311a06503e1d452d3d21a0aebef520f5ed1d9aaf Jul 09 14:40:02.024011 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.023992 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454445ef_0672_4b55_b7b4_ccc1e90eba18.slice/crio-bf77142ca51f64b174e7c40bc3d5d9694b31e4a56fc6115a9f65f64d092292c1 WatchSource:0}: Error finding container bf77142ca51f64b174e7c40bc3d5d9694b31e4a56fc6115a9f65f64d092292c1: Status 404 returned error can't find the container with id bf77142ca51f64b174e7c40bc3d5d9694b31e4a56fc6115a9f65f64d092292c1 Jul 09 14:40:02.024625 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.024602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:02.028850 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.028829 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lgg82" Jul 09 14:40:02.033310 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.033290 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c366322_4058_4fd0_bda1_5edf4ce439dd.slice/crio-6978d62019af4e8f401d0c28f3337d8c30eefd022963dc6dbf4523583e1d3578 WatchSource:0}: Error finding container 6978d62019af4e8f401d0c28f3337d8c30eefd022963dc6dbf4523583e1d3578: Status 404 returned error can't find the container with id 6978d62019af4e8f401d0c28f3337d8c30eefd022963dc6dbf4523583e1d3578 Jul 09 14:40:02.034348 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.034312 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:02.037176 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.037150 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80bf0cc_0978_41b7_bf1b_7a620ea31f44.slice/crio-eb2f476311f109840203bef8aaf542bcf6e6cff6c79d7adf330bbf6051690dba WatchSource:0}: Error finding container eb2f476311f109840203bef8aaf542bcf6e6cff6c79d7adf330bbf6051690dba: Status 404 returned error can't find the container with id eb2f476311f109840203bef8aaf542bcf6e6cff6c79d7adf330bbf6051690dba Jul 09 14:40:02.041236 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.041213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r4b2g" Jul 09 14:40:02.041657 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.041635 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a64e1b_df4a_4f7c_aed5_e750b5adf05e.slice/crio-c18187ecb7e50016df0cc277268553d463bc6f9d3cf4f42af384d0c35be71999 WatchSource:0}: Error finding container c18187ecb7e50016df0cc277268553d463bc6f9d3cf4f42af384d0c35be71999: Status 404 returned error can't find the container with id c18187ecb7e50016df0cc277268553d463bc6f9d3cf4f42af384d0c35be71999 Jul 09 14:40:02.046785 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.046768 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" Jul 09 14:40:02.049330 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.049305 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a5168d_d402_4305_a122_530e2de8dcbb.slice/crio-824b08add3903a8869e49ceb15b68129d12188a8b28df2f78b7db5c83ad711d8 WatchSource:0}: Error finding container 824b08add3903a8869e49ceb15b68129d12188a8b28df2f78b7db5c83ad711d8: Status 404 returned error can't find the container with id 824b08add3903a8869e49ceb15b68129d12188a8b28df2f78b7db5c83ad711d8 Jul 09 14:40:02.052728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.052711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-twhx4" Jul 09 14:40:02.054159 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.054133 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f4078c_938c_4825_a090_75d114aa5a3e.slice/crio-89e3d7e7a1d70dbe05622c05e49c343b1e0d3e4f03a3c2059ed42faf6af43f71 WatchSource:0}: Error finding container 89e3d7e7a1d70dbe05622c05e49c343b1e0d3e4f03a3c2059ed42faf6af43f71: Status 404 returned error can't find the container with id 89e3d7e7a1d70dbe05622c05e49c343b1e0d3e4f03a3c2059ed42faf6af43f71 Jul 09 14:40:02.055032 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.055010 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gfclj" Jul 09 14:40:02.061708 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.061688 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b524f13_dbca_4d08_bb97_763ca29ce08b.slice/crio-f276c436218e063aac5927e4b8a492f82c8150f3e1aba1fbddc7d540dda185d6 WatchSource:0}: Error finding container f276c436218e063aac5927e4b8a492f82c8150f3e1aba1fbddc7d540dda185d6: Status 404 returned error can't find the container with id f276c436218e063aac5927e4b8a492f82c8150f3e1aba1fbddc7d540dda185d6 Jul 09 14:40:02.064762 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:02.064744 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50960eb3_25d0_42ee_b719_a4463f7bc070.slice/crio-3fd452b3fdd47978c94ccd5b0ac198f274ae0bf614d4e77a3af55563b3b95655 WatchSource:0}: Error finding container 3fd452b3fdd47978c94ccd5b0ac198f274ae0bf614d4e77a3af55563b3b95655: Status 404 returned error can't find the container with id 3fd452b3fdd47978c94ccd5b0ac198f274ae0bf614d4e77a3af55563b3b95655 Jul 09 14:40:02.332421 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.332385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:02.332606 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.332454 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:02.332606 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.332587 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:02.332606 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.332589 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:02.332773 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.332658 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:03.332638834 +0000 UTC m=+4.034259264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:02.332773 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.332681 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:03.332668983 +0000 UTC m=+4.034289419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:02.433878 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.433842 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:02.434062 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.434014 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:02.434062 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.434035 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:02.434062 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.434049 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:02.434225 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.434115 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:03.434095101 +0000 UTC m=+4.135715531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:02.851160 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.851104 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:35:02 +0000 UTC" deadline="2028-01-13 11:43:56.663065316 +0000 UTC" Jul 09 14:40:02.851160 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.851152 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13269h3m53.811919334s" Jul 09 14:40:02.856496 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.856468 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:02.856649 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.856612 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:02.856715 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.856673 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:02.856822 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:02.856794 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:02.866348 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.866309 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerStarted","Data":"1dd8399db77701f31ecbc846311a06503e1d452d3d21a0aebef520f5ed1d9aaf"} Jul 09 14:40:02.867800 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.867774 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twhx4" event={"ID":"8b524f13-dbca-4d08-bb97-763ca29ce08b","Type":"ContainerStarted","Data":"f276c436218e063aac5927e4b8a492f82c8150f3e1aba1fbddc7d540dda185d6"} Jul 09 14:40:02.869574 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.869549 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" event={"ID":"c9f4078c-938c-4825-a090-75d114aa5a3e","Type":"ContainerStarted","Data":"89e3d7e7a1d70dbe05622c05e49c343b1e0d3e4f03a3c2059ed42faf6af43f71"} Jul 09 14:40:02.870999 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.870932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r4b2g" event={"ID":"46a5168d-d402-4305-a122-530e2de8dcbb","Type":"ContainerStarted","Data":"824b08add3903a8869e49ceb15b68129d12188a8b28df2f78b7db5c83ad711d8"} Jul 09 14:40:02.872598 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.872560 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s55sb" event={"ID":"6c366322-4058-4fd0-bda1-5edf4ce439dd","Type":"ContainerStarted","Data":"6978d62019af4e8f401d0c28f3337d8c30eefd022963dc6dbf4523583e1d3578"} Jul 09 14:40:02.874059 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.874026 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gfclj" event={"ID":"50960eb3-25d0-42ee-b719-a4463f7bc070","Type":"ContainerStarted","Data":"3fd452b3fdd47978c94ccd5b0ac198f274ae0bf614d4e77a3af55563b3b95655"} Jul 09 14:40:02.875456 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.875411 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"c18187ecb7e50016df0cc277268553d463bc6f9d3cf4f42af384d0c35be71999"} Jul 09 14:40:02.876747 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.876725 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lgg82" event={"ID":"b80bf0cc-0978-41b7-bf1b-7a620ea31f44","Type":"ContainerStarted","Data":"eb2f476311f109840203bef8aaf542bcf6e6cff6c79d7adf330bbf6051690dba"} Jul 09 14:40:02.878156 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:02.878127 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7xxx" event={"ID":"454445ef-0672-4b55-b7b4-ccc1e90eba18","Type":"ContainerStarted","Data":"bf77142ca51f64b174e7c40bc3d5d9694b31e4a56fc6115a9f65f64d092292c1"} Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.343654 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.343937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.344100 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.344119 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.344173 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:05.344151734 +0000 UTC m=+6.045772184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:03.344225 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.344196 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:05.344183899 +0000 UTC m=+6.045804330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:03.444636 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.444542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:03.444820 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.444762 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:03.444820 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.444786 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:03.444820 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.444799 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:03.444997 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.444863 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:05.444842816 +0000 UTC m=+6.146463246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:03.852020 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.851921 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:35:02 +0000 UTC" deadline="2028-03-08 12:38:48.194843679 +0000 UTC" Jul 09 14:40:03.852020 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.851974 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14589h58m44.342874475s" Jul 09 14:40:03.858974 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:03.858938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:03.859120 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:03.859076 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:04.856973 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:04.856264 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:04.856973 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:04.856419 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:04.856973 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:04.856802 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:04.856973 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:04.856907 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:05.362895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:05.362959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.363120 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.363198 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:09.363177395 +0000 UTC m=+10.064797835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.363630 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:05.363743 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.363685 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:09.363667998 +0000 UTC m=+10.065288431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:05.464229 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:05.463561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:05.464229 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.463782 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:05.464229 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.463809 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:05.464229 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.463821 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:05.464229 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.463881 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:09.463861732 +0000 UTC m=+10.165482160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:05.858286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:05.858204 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:05.858787 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:05.858332 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:06.856958 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:06.856921 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:06.857126 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:06.857076 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:06.857506 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:06.857214 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:06.857506 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:06.857413 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:07.856976 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:07.856939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:07.857419 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:07.857070 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:08.857265 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:08.857227 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:08.857662 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:08.857372 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:08.857662 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:08.857430 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:08.857662 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:08.857545 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:09.395975 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:09.395939 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:09.396151 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:09.395996 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:09.396151 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.396107 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:09.396151 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.396123 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:09.396307 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.396187 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:17.396166362 +0000 UTC m=+18.097786807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:09.396307 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.396227 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:17.39620154 +0000 UTC m=+18.097821971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:09.496588 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:09.496548 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:09.496751 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.496709 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:09.496751 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.496730 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:09.496751 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.496743 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:09.496896 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.496805 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:17.49678591 +0000 UTC m=+18.198406337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:09.857699 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:09.857639 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:09.858061 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:09.857736 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:10.856832 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:10.856794 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:10.856832 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:10.856818 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:10.857073 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:10.856906 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:10.857138 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:10.857112 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:11.857935 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:11.857706 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:11.857935 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:11.857834 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:12.856951 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:12.856869 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:12.857104 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:12.857006 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:12.857491 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:12.857291 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:12.857491 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:12.857423 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:13.856992 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:13.856909 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:13.857497 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:13.857056 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:13.909428 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:13.909391 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-twhx4" event={"ID":"8b524f13-dbca-4d08-bb97-763ca29ce08b","Type":"ContainerStarted","Data":"4c7aed24137e32c3cf8f57738c242d1cec7cc311d65cc456bb68f087ac3025db"} Jul 09 14:40:13.911010 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:13.910961 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" event={"ID":"daf4e3bb9336c51a7b1e768dcaf8ad41","Type":"ContainerStarted","Data":"4ac5de6839085adc6d9ca93db85088f3a6d22da066e32de46805b36d487e6417"} Jul 09 14:40:13.927094 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:13.927042 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-twhx4" podStartSLOduration=2.907520758 podStartE2EDuration="13.927027031s" totalImagesPullingTime="11.019506273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:13.92658335 +0000 UTC m=+14.628203815" watchObservedRunningTime="2026-07-09 14:40:13.927027031 +0000 UTC m=+14.628647520" Jul 09 14:40:13.939237 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:13.939195 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-41.ec2.internal" podStartSLOduration=12.93918106 podStartE2EDuration="12.93918106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:13.93878339 +0000 UTC m=+14.640403838" watchObservedRunningTime="2026-07-09 14:40:13.93918106 +0000 UTC m=+14.640801508" Jul 09 14:40:14.856768 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.856553 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:14.856889 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.856617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:14.856931 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:14.856878 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:14.856991 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:14.856934 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:14.915016 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.914962 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" event={"ID":"c9f4078c-938c-4825-a090-75d114aa5a3e","Type":"ContainerStarted","Data":"8110ee49ae1f1ecd1fc3b63ebc3f7285a1697dc70a39747a9a6470a6e43b14a1"} Jul 09 14:40:14.916723 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.916691 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r4b2g" event={"ID":"46a5168d-d402-4305-a122-530e2de8dcbb","Type":"ContainerStarted","Data":"4bb453693e3feaf8b8e24b34bea0de6587a2c7ac864dbc6887b2b0ff04eaff10"} Jul 09 14:40:14.918421 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.918375 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s55sb" event={"ID":"6c366322-4058-4fd0-bda1-5edf4ce439dd","Type":"ContainerStarted","Data":"a40bd74597b099261107e9f9e8e1ecdf2669c86952f42a07c2f0d4642aad9d54"} Jul 09 14:40:14.919993 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.919964 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lgg82" event={"ID":"b80bf0cc-0978-41b7-bf1b-7a620ea31f44","Type":"ContainerStarted","Data":"2ade04ebe2942f16deca0a403787effddb627cf111046cb66db6733b742cc1b9"} Jul 09 14:40:14.921722 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.921698 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7xxx" event={"ID":"454445ef-0672-4b55-b7b4-ccc1e90eba18","Type":"ContainerStarted","Data":"9ee9784d6c15f4aecde49a2c8c7add2a6dbfaab8885bb0bde4a55ab7bf7749b9"} Jul 09 14:40:14.923213 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.923182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerStarted","Data":"aefa00f5a08befc565ae1ee83a5ab169775cfb3000b400ebb6cb3f989e8eece2"} Jul 09 14:40:14.924724 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.924702 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"7a7bd30f24d8c6f37872fc8afc14db353c929985f49d5b5f757ee4ffc895c270"} Jul 09 14:40:14.931140 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.931096 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r4b2g" podStartSLOduration=3.943730987 podStartE2EDuration="14.931084216s" totalImagesPullingTime="10.987353229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:14.93065804 +0000 UTC m=+15.632278477" watchObservedRunningTime="2026-07-09 14:40:14.931084216 +0000 UTC m=+15.632704663" Jul 09 14:40:14.982311 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:14.982260 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s55sb" podStartSLOduration=3.7110486480000002 podStartE2EDuration="14.982242264s" totalImagesPullingTime="11.271193616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:14.981697803 +0000 UTC m=+15.683318256" watchObservedRunningTime="2026-07-09 14:40:14.982242264 +0000 UTC m=+15.683862712" Jul 09 14:40:15.001723 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:15.001665 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t7xxx" podStartSLOduration=4.540336982 podStartE2EDuration="15.001647793s" totalImagesPullingTime="10.461310811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:15.001185086 +0000 UTC m=+15.702805565" watchObservedRunningTime="2026-07-09 14:40:15.001647793 +0000 UTC m=+15.703268240" Jul 09 14:40:15.017760 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:15.017707 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lgg82" podStartSLOduration=3.929587443 podStartE2EDuration="15.017693417s" totalImagesPullingTime="11.088105974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:15.017177719 +0000 UTC m=+15.718798166" watchObservedRunningTime="2026-07-09 14:40:15.017693417 +0000 UTC m=+15.719313863" Jul 09 14:40:15.856612 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:15.856583 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:15.856789 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:15.856700 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:16.289870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:16.289785 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:16.290449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:16.290412 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:16.856436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:16.856405 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:16.856663 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:16.856455 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:16.856663 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:16.856591 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:16.856773 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:16.856735 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:17.457081 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.457045 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:17.457660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.457109 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:17.457660 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.457277 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:17.457660 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.457350 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:40:33.45732129 +0000 UTC m=+34.158941716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:17.457660 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.457279 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:17.457660 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.457427 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:33.457408143 +0000 UTC m=+34.159028573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:17.558031 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.557936 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:17.558184 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.558073 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:17.558184 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.558098 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:17.558184 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.558113 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:17.558184 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.558178 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:33.558156595 +0000 UTC m=+34.259777025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:17.856949 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.856845 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:17.857109 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:17.857030 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:17.933254 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.933209 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="aefa00f5a08befc565ae1ee83a5ab169775cfb3000b400ebb6cb3f989e8eece2" exitCode=0 Jul 09 14:40:17.933414 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.933290 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"aefa00f5a08befc565ae1ee83a5ab169775cfb3000b400ebb6cb3f989e8eece2"} Jul 09 14:40:17.933414 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:17.933343 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:40:18.856538 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:18.856501 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:18.856966 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:18.856514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:18.856966 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:18.856620 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:18.856966 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:18.856728 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:19.858026 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:19.857837 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:19.858459 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:19.858094 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:20.856460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:20.856417 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:20.856460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:20.856446 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:20.856665 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:20.856550 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:20.856665 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:20.856650 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:21.856840 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:21.856807 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:21.857298 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:21.856947 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:21.943864 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:21.943779 2569 generic.go:356] "Generic (PLEG): container finished" podID="14ea56247a743af792af701f2d2e5eef" containerID="7a7bd30f24d8c6f37872fc8afc14db353c929985f49d5b5f757ee4ffc895c270" exitCode=0 Jul 09 14:40:21.943864 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:21.943831 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerDied","Data":"7a7bd30f24d8c6f37872fc8afc14db353c929985f49d5b5f757ee4ffc895c270"} Jul 09 14:40:22.367408 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.367385 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:40:22.787983 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.787626 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:40:22.367405172Z","UUID":"ca8b389c-47ff-4a4c-894c-d4535b4a1c6e","Handler":null,"Name":"","Endpoint":""} Jul 09 14:40:22.789706 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.789676 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:40:22.789829 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.789722 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:40:22.856299 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.856271 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:22.856476 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.856312 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:22.856476 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:22.856404 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:22.856594 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:22.856513 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:22.949533 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.949499 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" event={"ID":"14ea56247a743af792af701f2d2e5eef","Type":"ContainerStarted","Data":"c540bbd4eaabb8ffb83422247ade78b1014e7289742b11c91f49605724fd92e1"} Jul 09 14:40:22.951674 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.951642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" event={"ID":"c9f4078c-938c-4825-a090-75d114aa5a3e","Type":"ContainerStarted","Data":"b91f44a778dcbc0766d39506777a57373d6d0e4b4201e34902419eaef1cefaf5"} Jul 09 14:40:22.956874 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.954557 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gfclj" event={"ID":"50960eb3-25d0-42ee-b719-a4463f7bc070","Type":"ContainerStarted","Data":"b8107cf64f836983db0e4ae4ca4aa94f589acf4b46559f7a7984aecfaaa1aa54"} Jul 09 14:40:22.958952 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.958928 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:40:22.959486 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959458 2569 generic.go:356] "Generic (PLEG): container finished" podID="79a64e1b-df4a-4f7c-aed5-e750b5adf05e" containerID="278be1b154fd748789c57cd34a22460178f76b5b63f29cc6458b0cb392413f1a" exitCode=1 Jul 09 14:40:22.959609 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959504 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"d366bc0991df44bd559eb4618c4c34ef901c5f9621c924100c0db8e1d7a48b6b"} Jul 09 14:40:22.959609 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959606 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"3878c70a23747737dcb0096405246249c57006b62b280397ab6a1b87789a5e75"} Jul 09 14:40:22.959703 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959654 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"73232a76c32e2ff37df3da1b7c4336a19b479fbc974c4d503bd843e422dca8ad"} Jul 09 14:40:22.959750 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959701 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"da06ef1c6667a05a2e3f7ac8cb9160ac616cb8a1836d97f151e8b43e12943841"} Jul 09 14:40:22.959788 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerDied","Data":"278be1b154fd748789c57cd34a22460178f76b5b63f29cc6458b0cb392413f1a"} Jul 09 14:40:22.959829 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.959806 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"47fac31ca60063295bb396cb799a80824b703f428f54f3d0291a377a26ac0ca4"} Jul 09 14:40:22.966674 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.966633 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-41.ec2.internal" podStartSLOduration=21.966620609 podStartE2EDuration="21.966620609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:22.965981008 +0000 UTC m=+23.667601461" watchObservedRunningTime="2026-07-09 14:40:22.966620609 +0000 UTC m=+23.668241055" Jul 09 14:40:22.982951 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:22.982858 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gfclj" podStartSLOduration=2.963920197 podStartE2EDuration="22.982838123s" totalImagesPullingTime="20.018917926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:22.982246965 +0000 UTC m=+23.683867413" watchObservedRunningTime="2026-07-09 14:40:22.982838123 +0000 UTC m=+23.684458571" Jul 09 14:40:23.857054 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:23.857031 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:23.857231 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:23.857158 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:23.963179 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:23.963147 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" event={"ID":"c9f4078c-938c-4825-a090-75d114aa5a3e","Type":"ContainerStarted","Data":"2925a95a270e697a97ebdd44232069626163c4e8721b8c33d7391a9ea2c87d86"} Jul 09 14:40:23.982804 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:23.982752 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5676" podStartSLOduration=3.645029179 podStartE2EDuration="23.982734672s" totalImagesPullingTime="20.337705493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:23.982681672 +0000 UTC m=+24.684302111" watchObservedRunningTime="2026-07-09 14:40:23.982734672 +0000 UTC m=+24.684355119" Jul 09 14:40:24.856400 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:24.856374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:24.856400 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:24.856395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:24.856548 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:24.856473 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:24.856601 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:24.856584 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:24.970182 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:24.970140 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:40:24.970673 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:24.970642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"1c4a49de334c592395e35b25c1d0eacd77f86458af74cca1fb7d9bb944af9e2a"} Jul 09 14:40:25.856404 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:25.856373 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:25.856576 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:25.856503 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:26.857119 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:26.857082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:26.857522 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:26.857091 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:26.857522 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:26.857212 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:26.857522 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:26.857254 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:27.857145 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.856905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:27.857650 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:27.857248 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:27.980813 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.980786 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:40:27.981169 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.981148 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"06064f3bd017ee1f08051c99d399c20a2296eeac61de8060bf7109090aed947f"} Jul 09 14:40:27.981389 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.981364 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:27.981501 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.981438 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:27.981646 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.981621 2569 scope.go:117] "RemoveContainer" containerID="278be1b154fd748789c57cd34a22460178f76b5b63f29cc6458b0cb392413f1a" Jul 09 14:40:27.983177 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.983153 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="d10c02fbc2aa6f112f53bd4e5b9bf0986cc40db8b07a85c1188644884777e219" exitCode=0 Jul 09 14:40:27.983276 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.983188 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"d10c02fbc2aa6f112f53bd4e5b9bf0986cc40db8b07a85c1188644884777e219"} Jul 09 14:40:27.997519 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:27.997496 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:28.856291 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.856251 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:28.856291 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.856288 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:28.856497 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:28.856385 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:28.856537 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:28.856507 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:28.988978 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.988954 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:40:28.989455 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.989371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" event={"ID":"79a64e1b-df4a-4f7c-aed5-e750b5adf05e","Type":"ContainerStarted","Data":"e5ed2bbb66253bb3496c358dab4225fd6f997d64815719f002befe65b7f1579f"} Jul 09 14:40:28.989584 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.989559 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:28.991789 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.991769 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="22757243f2cb902b9490bf5e05c9f59dad31a75be3c0fbee3921a07c200070db" exitCode=0 Jul 09 14:40:28.991889 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:28.991798 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"22757243f2cb902b9490bf5e05c9f59dad31a75be3c0fbee3921a07c200070db"} Jul 09 14:40:29.005599 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.005573 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:40:29.018405 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.018349 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" podStartSLOduration=8.975736934 podStartE2EDuration="29.018312807s" totalImagesPullingTime="20.042575873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:29.018010169 +0000 UTC m=+29.719630630" watchObservedRunningTime="2026-07-09 14:40:29.018312807 +0000 UTC m=+29.719933254" Jul 09 14:40:29.273235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.273190 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f8wm"] Jul 09 14:40:29.273393 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.273305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:29.273431 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:29.273398 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:29.276475 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.276449 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xqjx7"] Jul 09 14:40:29.276601 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.276546 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:29.276714 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:29.276651 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:29.277033 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.277008 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4n4r"] Jul 09 14:40:29.277155 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:29.277105 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:29.277218 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:29.277195 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:30.857396 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:30.857208 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:30.857872 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:30.857223 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:30.857872 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:30.857482 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:30.857872 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:30.857235 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:30.857872 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:30.857553 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:30.857872 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:30.857663 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:30.999281 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:30.999252 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="1b233dbd9d34954cf47c3e73f86a49ce5044b24afc59cd8ea89af7d58ccbe57e" exitCode=0 Jul 09 14:40:30.999443 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:30.999320 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"1b233dbd9d34954cf47c3e73f86a49ce5044b24afc59cd8ea89af7d58ccbe57e"} Jul 09 14:40:32.016113 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.016080 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:32.016763 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.016271 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:40:32.017023 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.017006 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s55sb" Jul 09 14:40:32.856637 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.856603 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:32.856637 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.856636 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:32.856884 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:32.856647 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:32.856884 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:32.856731 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4n4r" podUID="5d1a3533-eb8d-41e4-8f2d-54654e1ff97f" Jul 09 14:40:32.856884 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:32.856872 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:40:32.856995 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:32.856949 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7f8wm" podUID="f59a7dad-0565-4e42-8fcb-5b70a355fe26" Jul 09 14:40:33.472968 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:33.472929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:33.472968 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:33.472975 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:33.473496 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.473085 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:33.473496 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.473097 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:33.473496 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.473139 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret podName:5d1a3533-eb8d-41e4-8f2d-54654e1ff97f nodeName:}" failed. No retries permitted until 2026-07-09 14:41:05.473126208 +0000 UTC m=+66.174746634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret") pod "global-pull-secret-syncer-l4n4r" (UID: "5d1a3533-eb8d-41e4-8f2d-54654e1ff97f") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:33.473496 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.473164 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:05.473145281 +0000 UTC m=+66.174765724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:33.574383 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:33.574350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:33.574557 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.574472 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:33.574557 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.574486 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:33.574557 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.574495 2569 projected.go:196] Error preparing data for projected volume kube-api-access-q845n for pod openshift-network-diagnostics/network-check-target-7f8wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:33.574557 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:33.574544 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n podName:f59a7dad-0565-4e42-8fcb-5b70a355fe26 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:05.574529403 +0000 UTC m=+66.276149828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q845n" (UniqueName: "kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n") pod "network-check-target-7f8wm" (UID: "f59a7dad-0565-4e42-8fcb-5b70a355fe26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:34.634847 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.634823 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-41.ec2.internal" event="NodeReady" Jul 09 14:40:34.635241 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.634972 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:40:34.681445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.681386 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8cjcn"] Jul 09 14:40:34.684023 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.684005 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.686540 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.686518 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lk5mg"] Jul 09 14:40:34.687585 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.687566 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:40:34.687717 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.687697 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7btb\"" Jul 09 14:40:34.687797 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.687712 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:40:34.688515 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.688496 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.691003 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.690975 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5rhd4\"" Jul 09 14:40:34.691088 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.691004 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:40:34.691764 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.691742 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:40:34.691971 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.691948 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:40:34.698098 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.698077 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8cjcn"] Jul 09 14:40:34.700044 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.700021 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lk5mg"] Jul 09 14:40:34.783231 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783152 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbr94\" (UniqueName: \"kubernetes.io/projected/97be1e53-860f-4ece-81af-b06c64fdbb42-kube-api-access-dbr94\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.783231 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5e95c4-facf-4527-a862-c640b448ce6b-cert\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.783489 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783285 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97be1e53-860f-4ece-81af-b06c64fdbb42-config-volume\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.783489 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783313 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.783489 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783422 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1e53-860f-4ece-81af-b06c64fdbb42-tmp-dir\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.783489 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.783451 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7vm5\" (UniqueName: \"kubernetes.io/projected/9a5e95c4-facf-4527-a862-c640b448ce6b-kube-api-access-v7vm5\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.857117 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.857083 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:40:34.857117 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.857113 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:40:34.857324 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.857113 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:40:34.860324 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860297 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:40:34.860583 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860567 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d62s8\"" Jul 09 14:40:34.860655 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860592 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgrr9\"" Jul 09 14:40:34.860655 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860608 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:40:34.860749 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860736 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:40:34.860795 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.860752 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:40:34.884124 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5e95c4-facf-4527-a862-c640b448ce6b-cert\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.884243 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884136 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97be1e53-860f-4ece-81af-b06c64fdbb42-config-volume\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.884243 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.884243 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1e53-860f-4ece-81af-b06c64fdbb42-tmp-dir\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.884243 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884229 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7vm5\" (UniqueName: \"kubernetes.io/projected/9a5e95c4-facf-4527-a862-c640b448ce6b-kube-api-access-v7vm5\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.884467 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbr94\" (UniqueName: \"kubernetes.io/projected/97be1e53-860f-4ece-81af-b06c64fdbb42-kube-api-access-dbr94\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.884757 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:34.884701 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:34.884860 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:34.884777 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:35.384757682 +0000 UTC m=+36.086378113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:40:34.884860 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884785 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97be1e53-860f-4ece-81af-b06c64fdbb42-config-volume\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.884987 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.884874 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97be1e53-860f-4ece-81af-b06c64fdbb42-tmp-dir\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.889217 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.889049 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a5e95c4-facf-4527-a862-c640b448ce6b-cert\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:34.893701 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.893656 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbr94\" (UniqueName: \"kubernetes.io/projected/97be1e53-860f-4ece-81af-b06c64fdbb42-kube-api-access-dbr94\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:34.893935 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:34.893913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7vm5\" (UniqueName: \"kubernetes.io/projected/9a5e95c4-facf-4527-a862-c640b448ce6b-kube-api-access-v7vm5\") pod \"ingress-canary-lk5mg\" (UID: \"9a5e95c4-facf-4527-a862-c640b448ce6b\") " pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:35.006086 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:35.006051 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lk5mg" Jul 09 14:40:35.388702 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:35.388667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:35.388880 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:35.388819 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:35.388939 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:35.388889 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:36.38886761 +0000 UTC m=+37.090488039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:40:36.215716 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:36.215692 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lk5mg"] Jul 09 14:40:36.220222 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:40:36.220195 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5e95c4_facf_4527_a862_c640b448ce6b.slice/crio-f9af89253223475863490493032f0f8a70a2feca0b7fafae7cd4b5e27f501286 WatchSource:0}: Error finding container f9af89253223475863490493032f0f8a70a2feca0b7fafae7cd4b5e27f501286: Status 404 returned error can't find the container with id f9af89253223475863490493032f0f8a70a2feca0b7fafae7cd4b5e27f501286 Jul 09 14:40:36.396574 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:36.396501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:36.396711 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:36.396609 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:36.396711 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:36.396667 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:38.396651595 +0000 UTC m=+39.098272023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:40:37.013176 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:37.013143 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lk5mg" event={"ID":"9a5e95c4-facf-4527-a862-c640b448ce6b","Type":"ContainerStarted","Data":"f9af89253223475863490493032f0f8a70a2feca0b7fafae7cd4b5e27f501286"} Jul 09 14:40:37.015774 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:37.015752 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="f776bd8a91d1a89c980d3515ef180ff0cae739efb86902255ef4ed79032e8b04" exitCode=0 Jul 09 14:40:37.015877 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:37.015781 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"f776bd8a91d1a89c980d3515ef180ff0cae739efb86902255ef4ed79032e8b04"} Jul 09 14:40:38.021956 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:38.021784 2569 generic.go:356] "Generic (PLEG): container finished" podID="adf8b128-91ac-4ba2-9a4c-ada8c492c327" containerID="88c91dcc88e66dff83974adb2be55787070052479588435b02f797a5d913320e" exitCode=0 Jul 09 14:40:38.021956 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:38.021862 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerDied","Data":"88c91dcc88e66dff83974adb2be55787070052479588435b02f797a5d913320e"} Jul 09 14:40:38.415187 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:38.415111 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:38.415320 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:38.415215 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:38.415320 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:38.415276 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:42.415262677 +0000 UTC m=+43.116883102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:40:39.029257 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:39.029224 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59v8j" event={"ID":"adf8b128-91ac-4ba2-9a4c-ada8c492c327","Type":"ContainerStarted","Data":"3058e40a51b73681de0b6293f2609f72cac72f0c409d5d7b8537ceff85b62042"} Jul 09 14:40:39.054850 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:39.054802 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-59v8j" podStartSLOduration=11.335719641 podStartE2EDuration="39.054781299s" totalImagesPullingTime="27.719061658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:39.053143473 +0000 UTC m=+39.754763921" watchObservedRunningTime="2026-07-09 14:40:39.054781299 +0000 UTC m=+39.756401749" Jul 09 14:40:40.032926 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:40.032892 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lk5mg" event={"ID":"9a5e95c4-facf-4527-a862-c640b448ce6b","Type":"ContainerStarted","Data":"a9ae0cbfe3b061216b776a80e0bd00f8865c78183086af5107899f3f24399a68"} Jul 09 14:40:40.048182 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:40.048139 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lk5mg" podStartSLOduration=3.044034819 podStartE2EDuration="6.048125154s" totalImagesPullingTime="3.004090335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:40.04709739 +0000 UTC m=+40.748717837" watchObservedRunningTime="2026-07-09 14:40:40.048125154 +0000 UTC m=+40.749745592" Jul 09 14:40:42.446074 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:42.446038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:42.446575 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:42.446197 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:42.446575 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:42.446263 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:50.446246793 +0000 UTC m=+51.147867224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:40:50.501248 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:40:50.501214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:40:50.501735 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:50.501381 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:50.501735 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:40:50.501441 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:06.501422958 +0000 UTC m=+67.203043392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:41:01.019539 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:01.019513 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x72nh" Jul 09 14:41:05.506999 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.506945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:41:05.507424 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.507037 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:41:05.509747 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.509729 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:41:05.509820 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.509804 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:41:05.517965 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:05.517944 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:41:05.518022 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:05.518002 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:42:09.517986334 +0000 UTC m=+130.219606759 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : secret "metrics-daemon-secret" not found Jul 09 14:41:05.521435 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.521412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d1a3533-eb8d-41e4-8f2d-54654e1ff97f-original-pull-secret\") pod \"global-pull-secret-syncer-l4n4r\" (UID: \"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f\") " pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:41:05.607918 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.607864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:41:05.610750 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.610733 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:41:05.620610 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.620595 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:41:05.631684 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.631663 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q845n\" (UniqueName: \"kubernetes.io/projected/f59a7dad-0565-4e42-8fcb-5b70a355fe26-kube-api-access-q845n\") pod \"network-check-target-7f8wm\" (UID: \"f59a7dad-0565-4e42-8fcb-5b70a355fe26\") " pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:41:05.775194 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.775106 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4n4r" Jul 09 14:41:05.783813 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.783789 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgrr9\"" Jul 09 14:41:05.791735 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.791711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:41:05.905734 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.905701 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4n4r"] Jul 09 14:41:05.908606 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:41:05.908576 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1a3533_eb8d_41e4_8f2d_54654e1ff97f.slice/crio-c08f2daeb110a58ff7459cf51e91644f549dfa9bbca362c9c48c3a6c0a31a042 WatchSource:0}: Error finding container c08f2daeb110a58ff7459cf51e91644f549dfa9bbca362c9c48c3a6c0a31a042: Status 404 returned error can't find the container with id c08f2daeb110a58ff7459cf51e91644f549dfa9bbca362c9c48c3a6c0a31a042 Jul 09 14:41:05.922857 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:05.922835 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7f8wm"] Jul 09 14:41:05.925560 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:41:05.925537 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59a7dad_0565_4e42_8fcb_5b70a355fe26.slice/crio-614ef2b6231c9bbc29549f53aa9d3f5ec0bdb5a1c26acd9beb45313890b17277 WatchSource:0}: Error finding container 614ef2b6231c9bbc29549f53aa9d3f5ec0bdb5a1c26acd9beb45313890b17277: Status 404 returned error can't find the container with id 614ef2b6231c9bbc29549f53aa9d3f5ec0bdb5a1c26acd9beb45313890b17277 Jul 09 14:41:06.092235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:06.092150 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l4n4r" event={"ID":"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f","Type":"ContainerStarted","Data":"c08f2daeb110a58ff7459cf51e91644f549dfa9bbca362c9c48c3a6c0a31a042"} Jul 09 14:41:06.093164 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:06.093139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f8wm" event={"ID":"f59a7dad-0565-4e42-8fcb-5b70a355fe26","Type":"ContainerStarted","Data":"614ef2b6231c9bbc29549f53aa9d3f5ec0bdb5a1c26acd9beb45313890b17277"} Jul 09 14:41:06.514206 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:06.514160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:41:06.514757 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:06.514320 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:41:06.514757 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:06.514409 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:38.514388832 +0000 UTC m=+99.216009278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:41:11.108090 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:11.108051 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l4n4r" event={"ID":"5d1a3533-eb8d-41e4-8f2d-54654e1ff97f","Type":"ContainerStarted","Data":"847b81ed5bb93da5bac86c54f75a7e462d87864ef6cd25bc58ef743d73863cf6"} Jul 09 14:41:11.109531 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:11.109508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7f8wm" event={"ID":"f59a7dad-0565-4e42-8fcb-5b70a355fe26","Type":"ContainerStarted","Data":"64f24472a1e5353f35eac222dba1a246bfb8475ccc28ee451c233cb39ad56d1e"} Jul 09 14:41:11.109634 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:11.109628 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:41:11.123851 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:11.123805 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l4n4r" podStartSLOduration=66.325464307 podStartE2EDuration="1m11.123791451s" totalImagesPullingTime="4.798327144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:11.122961374 +0000 UTC m=+71.824581823" watchObservedRunningTime="2026-07-09 14:41:11.123791451 +0000 UTC m=+71.825411898" Jul 09 14:41:11.138213 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:11.138166 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7f8wm" podStartSLOduration=66.359704384 podStartE2EDuration="1m11.138151676s" totalImagesPullingTime="4.778447292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:11.137700099 +0000 UTC m=+71.839320545" watchObservedRunningTime="2026-07-09 14:41:11.138151676 +0000 UTC m=+71.839772123" Jul 09 14:41:38.528636 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:38.528602 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:41:38.529163 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:38.528732 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:41:38.529163 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:41:38.528791 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:42:42.528773412 +0000 UTC m=+163.230393839 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:41:42.114223 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:41:42.114187 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7f8wm" Jul 09 14:42:09.545032 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:42:09.544981 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:42:09.545520 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:09.545147 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:42:09.545520 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:09.545224 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:11.545207804 +0000 UTC m=+252.246828230 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : secret "metrics-daemon-secret" not found Jul 09 14:42:37.700557 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:37.700494 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8cjcn" podUID="97be1e53-860f-4ece-81af-b06c64fdbb42" Jul 09 14:42:37.868083 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:37.868049 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:42:38.320589 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:42:38.320560 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:42:42.566023 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:42:42.565983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:42:42.566493 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:42.566133 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:42:42.566493 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:42:42.566205 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls podName:97be1e53-860f-4ece-81af-b06c64fdbb42 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:44.566188299 +0000 UTC m=+285.267808724 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls") pod "dns-default-8cjcn" (UID: "97be1e53-860f-4ece-81af-b06c64fdbb42") : secret "dns-default-metrics-tls" not found Jul 09 14:42:48.856263 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:42:48.856216 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:44:11.557092 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:11.557056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:44:11.557592 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:11.557179 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:44:11.557592 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:11.557239 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs podName:38445a72-385b-405f-a40f-6f6ba0884485 nodeName:}" failed. No retries permitted until 2026-07-09 14:46:13.557225159 +0000 UTC m=+374.258845584 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs") pod "network-metrics-daemon-xqjx7" (UID: "38445a72-385b-405f-a40f-6f6ba0884485") : secret "metrics-daemon-secret" not found Jul 09 14:44:17.202391 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.202356 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-gsklc"] Jul 09 14:44:17.204176 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.204159 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.206897 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.206877 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 14:44:17.207162 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.207145 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 14:44:17.207250 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.207151 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.208014 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.207997 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fl42m\"" Jul 09 14:44:17.208105 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.208029 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.217979 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.217960 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 14:44:17.225480 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.225462 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-gsklc"] Jul 09 14:44:17.298449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82abea7-baca-4366-93e1-d1e8e47344f9-serving-cert\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.298726 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-tmp\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.298810 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-snapshots\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.298810 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.298930 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.298981 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.298962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxwr\" (UniqueName: \"kubernetes.io/projected/c82abea7-baca-4366-93e1-d1e8e47344f9-kube-api-access-pmxwr\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.299170 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.299151 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc"] Jul 09 14:44:17.301122 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.301108 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5759c5999f-fpmdg"] Jul 09 14:44:17.301254 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.301237 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.302902 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.302885 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68fd675d64-pjh4c"] Jul 09 14:44:17.303008 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.302994 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.303559 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.303532 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 14:44:17.303660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.303566 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rf5wc\"" Jul 09 14:44:17.303660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.303574 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 14:44:17.303831 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.303816 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.304191 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.304175 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.304625 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.304609 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.305124 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.305095 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:44:17.305779 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.305763 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:44:17.305867 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.305818 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hz89z\"" Jul 09 14:44:17.305867 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.305824 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:44:17.307057 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.307041 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 14:44:17.310136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.309984 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 14:44:17.310136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.310008 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 14:44:17.310136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.310023 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.310136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.310035 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 14:44:17.310136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.310076 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vg7km\"" Jul 09 14:44:17.310428 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.310243 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.313948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.313930 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:44:17.314229 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.314207 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc"] Jul 09 14:44:17.323739 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.323719 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68fd675d64-pjh4c"] Jul 09 14:44:17.324481 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.324463 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5759c5999f-fpmdg"] Jul 09 14:44:17.399847 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-stats-auth\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.399847 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-tmp\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-snapshots\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399911 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zth2l\" (UniqueName: \"kubernetes.io/projected/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-kube-api-access-zth2l\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.399986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2222f119-3213-4aeb-a13b-b0acbae9a1d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400006 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.400062 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2222f119-3213-4aeb-a13b-b0acbae9a1d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400128 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400176 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc4zt\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400210 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxwr\" (UniqueName: \"kubernetes.io/projected/c82abea7-baca-4366-93e1-d1e8e47344f9-kube-api-access-pmxwr\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhr6g\" (UniqueName: \"kubernetes.io/projected/2222f119-3213-4aeb-a13b-b0acbae9a1d1-kube-api-access-xhr6g\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400322 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400373 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400372 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-tmp\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-default-certificate\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400424 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c82abea7-baca-4366-93e1-d1e8e47344f9-snapshots\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400478 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82abea7-baca-4366-93e1-d1e8e47344f9-serving-cert\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.400895 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.400895 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.400824 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.401049 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.401032 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82abea7-baca-4366-93e1-d1e8e47344f9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.402745 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.402728 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82abea7-baca-4366-93e1-d1e8e47344f9-serving-cert\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.408410 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.408390 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxwr\" (UniqueName: \"kubernetes.io/projected/c82abea7-baca-4366-93e1-d1e8e47344f9-kube-api-access-pmxwr\") pod \"insights-operator-68d9dd94cf-gsklc\" (UID: \"c82abea7-baca-4366-93e1-d1e8e47344f9\") " pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.501125 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501272 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501131 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501272 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501151 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc4zt\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501272 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhr6g\" (UniqueName: \"kubernetes.io/projected/2222f119-3213-4aeb-a13b-b0acbae9a1d1-kube-api-access-xhr6g\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.501420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501287 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-default-certificate\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.501420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501404 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501436 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.501467 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.501484 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.501517 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.501537 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:18.001516816 +0000 UTC m=+258.703137257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.501567 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:18.001558189 +0000 UTC m=+258.703178614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501583 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-stats-auth\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.501647 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zth2l\" (UniqueName: \"kubernetes.io/projected/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-kube-api-access-zth2l\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501790 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2222f119-3213-4aeb-a13b-b0acbae9a1d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501889 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.501909 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2222f119-3213-4aeb-a13b-b0acbae9a1d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.502083 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:17.502010 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:18.0019961 +0000 UTC m=+258.703616541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:17.502458 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.502221 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.502611 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.502536 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2222f119-3213-4aeb-a13b-b0acbae9a1d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.502826 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.502807 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.504136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.504113 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-stats-auth\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.504253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.504232 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-default-certificate\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.504312 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.504249 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.504414 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.504388 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.504604 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.504589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2222f119-3213-4aeb-a13b-b0acbae9a1d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.509765 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.509735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zth2l\" (UniqueName: \"kubernetes.io/projected/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-kube-api-access-zth2l\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:17.509970 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.509946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc4zt\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.510938 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.510913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:17.511041 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.510946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhr6g\" (UniqueName: \"kubernetes.io/projected/2222f119-3213-4aeb-a13b-b0acbae9a1d1-kube-api-access-xhr6g\") pod \"kube-storage-version-migrator-operator-799cb7f958-n6dfc\" (UID: \"2222f119-3213-4aeb-a13b-b0acbae9a1d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.512829 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.512811 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" Jul 09 14:44:17.612535 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.612509 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" Jul 09 14:44:17.632382 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.632353 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-gsklc"] Jul 09 14:44:17.635701 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:17.635677 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82abea7_baca_4366_93e1_d1e8e47344f9.slice/crio-c89cfd4243b9dc7b7e1e7a1dc43a9bfa69e7c7e27a1ba0a8c74bdb716319812e WatchSource:0}: Error finding container c89cfd4243b9dc7b7e1e7a1dc43a9bfa69e7c7e27a1ba0a8c74bdb716319812e: Status 404 returned error can't find the container with id c89cfd4243b9dc7b7e1e7a1dc43a9bfa69e7c7e27a1ba0a8c74bdb716319812e Jul 09 14:44:17.728045 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:17.728004 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc"] Jul 09 14:44:17.731003 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:17.730979 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2222f119_3213_4aeb_a13b_b0acbae9a1d1.slice/crio-a1d79b465c52a9ebcccac9d541526299fa543a4656d4b5edeb7f3df0e6e347d0 WatchSource:0}: Error finding container a1d79b465c52a9ebcccac9d541526299fa543a4656d4b5edeb7f3df0e6e347d0: Status 404 returned error can't find the container with id a1d79b465c52a9ebcccac9d541526299fa543a4656d4b5edeb7f3df0e6e347d0 Jul 09 14:44:18.006690 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:18.006665 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:18.006836 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:18.006712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:18.006836 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:18.006739 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:18.006836 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006821 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:19.006805104 +0000 UTC m=+259.708425529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:18.006836 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006822 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:18.007002 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006860 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:19.006850527 +0000 UTC m=+259.708470951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:18.007002 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006826 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:18.007002 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006873 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:18.007002 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:18.006891 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:19.006886091 +0000 UTC m=+259.708506515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:18.558447 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:18.558411 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" event={"ID":"c82abea7-baca-4366-93e1-d1e8e47344f9","Type":"ContainerStarted","Data":"c89cfd4243b9dc7b7e1e7a1dc43a9bfa69e7c7e27a1ba0a8c74bdb716319812e"} Jul 09 14:44:18.559419 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:18.559399 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" event={"ID":"2222f119-3213-4aeb-a13b-b0acbae9a1d1","Type":"ContainerStarted","Data":"a1d79b465c52a9ebcccac9d541526299fa543a4656d4b5edeb7f3df0e6e347d0"} Jul 09 14:44:19.015178 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:19.015148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:19.015354 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:19.015200 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:19.015354 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:19.015225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:19.015354 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015323 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:19.015354 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015355 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:19.015534 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015357 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:19.015534 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015341 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:21.015310796 +0000 UTC m=+261.716931221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:19.015534 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015412 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:21.015396875 +0000 UTC m=+261.717017308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:19.015534 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:19.015423 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:21.015417324 +0000 UTC m=+261.717037751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:20.565919 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:20.565892 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" event={"ID":"c82abea7-baca-4366-93e1-d1e8e47344f9","Type":"ContainerStarted","Data":"8b2099986970fb33b2cbcc69ba38feec4b50cbff66014ad9a35ff0c5d0baf1c2"} Jul 09 14:44:20.583440 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:20.583385 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" podStartSLOduration=1.462581466 podStartE2EDuration="3.583364737s" totalImagesPullingTime="2.120783271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:20.582625546 +0000 UTC m=+261.284246013" watchObservedRunningTime="2026-07-09 14:44:20.583364737 +0000 UTC m=+261.284985185" Jul 09 14:44:21.034317 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.034278 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:21.034317 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.034325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034461 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.034476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034483 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034542 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.034520719 +0000 UTC m=+265.736141162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034580 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.034568908 +0000 UTC m=+265.736189334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:21.034595 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034586 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:21.034898 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:21.034635 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.034623479 +0000 UTC m=+265.736243908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:21.571662 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.571617 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" event={"ID":"2222f119-3213-4aeb-a13b-b0acbae9a1d1","Type":"ContainerStarted","Data":"8601226d8e887200b4bbfbe9459dc7f712ef52dcd0396eb24ab113f42bbbb2e7"} Jul 09 14:44:21.587218 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.587173 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" podStartSLOduration=1.7749328260000001 podStartE2EDuration="4.587153269s" totalImagesPullingTime="2.812220443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:21.586301295 +0000 UTC m=+262.287921763" watchObservedRunningTime="2026-07-09 14:44:21.587153269 +0000 UTC m=+262.288773739" Jul 09 14:44:21.820019 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.819989 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xsc4k"] Jul 09 14:44:21.822360 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.822290 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:21.824687 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.824663 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:44:21.824817 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.824798 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:44:21.824919 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.824903 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd2rk\"" Jul 09 14:44:21.833023 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.833000 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xsc4k"] Jul 09 14:44:21.943456 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.943415 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:21.943456 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.943452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/119a6b27-bb75-46b5-851c-914066b83d51-data-volume\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:21.943660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.943476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/119a6b27-bb75-46b5-851c-914066b83d51-crio-socket\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:21.943660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.943560 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:21.943660 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:21.943606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dschx\" (UniqueName: \"kubernetes.io/projected/119a6b27-bb75-46b5-851c-914066b83d51-kube-api-access-dschx\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.044844 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.044805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.044844 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.044849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dschx\" (UniqueName: \"kubernetes.io/projected/119a6b27-bb75-46b5-851c-914066b83d51-kube-api-access-dschx\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.045038 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.044923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.045038 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.044934 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:22.045038 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.045011 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:22.54499095 +0000 UTC m=+263.246611393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : configmap "kube-rbac-proxy" not found Jul 09 14:44:22.045142 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.045036 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:22.045142 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.044939 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/119a6b27-bb75-46b5-851c-914066b83d51-data-volume\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.045142 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.045078 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:22.54506536 +0000 UTC m=+263.246685797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:22.045142 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.045111 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/119a6b27-bb75-46b5-851c-914066b83d51-crio-socket\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.045274 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.045211 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/119a6b27-bb75-46b5-851c-914066b83d51-crio-socket\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.045274 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.045213 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/119a6b27-bb75-46b5-851c-914066b83d51-data-volume\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.055313 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.055287 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dschx\" (UniqueName: \"kubernetes.io/projected/119a6b27-bb75-46b5-851c-914066b83d51-kube-api-access-dschx\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.549013 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.548966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.549013 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:22.549029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:22.549235 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.549091 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:22.549235 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.549114 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:22.549235 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.549142 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:23.549130181 +0000 UTC m=+264.250750606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : configmap "kube-rbac-proxy" not found Jul 09 14:44:22.549235 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:22.549163 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:23.549150539 +0000 UTC m=+264.250770964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:23.557001 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:23.556966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:23.557415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:23.557068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:23.557415 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:23.557093 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:23.557415 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:23.557162 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.557145968 +0000 UTC m=+266.258766393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : configmap "kube-rbac-proxy" not found Jul 09 14:44:23.557415 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:23.557172 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:23.557415 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:23.557209 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.557198666 +0000 UTC m=+266.258819091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:24.605087 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:24.605057 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7xxx_454445ef-0672-4b55-b7b4-ccc1e90eba18/dns-node-resolver/0.log" Jul 09 14:44:25.069315 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.069276 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:25.069315 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.069319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.069395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069454 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069476 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069484 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069495 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:33.069481777 +0000 UTC m=+273.771102201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:25.069529 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069528 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:33.06951077 +0000 UTC m=+273.771131215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:25.069711 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.069544 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:33.069537801 +0000 UTC m=+273.771158226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:25.103565 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.103539 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mxhmg"] Jul 09 14:44:25.105737 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.105723 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.112605 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.112584 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 14:44:25.112693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.112584 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 14:44:25.113077 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.113063 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 14:44:25.113966 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.113948 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 14:44:25.114017 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.113986 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pmvk6\"" Jul 09 14:44:25.125734 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.125710 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mxhmg"] Jul 09 14:44:25.271000 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.270966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-key\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.271185 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.271049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.271185 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.271116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc7zp\" (UniqueName: \"kubernetes.io/projected/9ab007d0-0481-4225-ae25-c49e10a7404a-kube-api-access-rc7zp\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.372577 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.372493 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7zp\" (UniqueName: \"kubernetes.io/projected/9ab007d0-0481-4225-ae25-c49e10a7404a-kube-api-access-rc7zp\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.372577 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.372536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-key\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.372757 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.372587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.373143 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.373127 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.374914 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.374887 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ab007d0-0481-4225-ae25-c49e10a7404a-signing-key\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.380352 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.380315 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7zp\" (UniqueName: \"kubernetes.io/projected/9ab007d0-0481-4225-ae25-c49e10a7404a-kube-api-access-rc7zp\") pod \"service-ca-79f68b9f4f-mxhmg\" (UID: \"9ab007d0-0481-4225-ae25-c49e10a7404a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.414135 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.414108 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" Jul 09 14:44:25.534595 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.534565 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mxhmg"] Jul 09 14:44:25.537262 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:25.537238 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab007d0_0481_4225_ae25_c49e10a7404a.slice/crio-a08049bfc7c9a97f53794f72ac798ce6a8f44eedd0faf099930bdec804e0ad57 WatchSource:0}: Error finding container a08049bfc7c9a97f53794f72ac798ce6a8f44eedd0faf099930bdec804e0ad57: Status 404 returned error can't find the container with id a08049bfc7c9a97f53794f72ac798ce6a8f44eedd0faf099930bdec804e0ad57 Jul 09 14:44:25.574280 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.574252 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:25.574416 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.574358 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:25.574416 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.574388 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:25.574489 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.574448 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:29.574430203 +0000 UTC m=+270.276050629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : configmap "kube-rbac-proxy" not found Jul 09 14:44:25.574489 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.574457 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:25.574556 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:25.574517 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:29.574500698 +0000 UTC m=+270.276121124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:25.585418 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.585394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" event={"ID":"9ab007d0-0481-4225-ae25-c49e10a7404a","Type":"ContainerStarted","Data":"a08049bfc7c9a97f53794f72ac798ce6a8f44eedd0faf099930bdec804e0ad57"} Jul 09 14:44:25.605690 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:25.605665 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lgg82_b80bf0cc-0978-41b7-bf1b-7a620ea31f44/node-ca/0.log" Jul 09 14:44:26.407173 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:26.407133 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lk5mg_9a5e95c4-facf-4527-a862-c640b448ce6b/serve-healthcheck-canary/0.log" Jul 09 14:44:27.206658 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:27.206624 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-n6dfc_2222f119-3213-4aeb-a13b-b0acbae9a1d1/kube-storage-version-migrator-operator/0.log" Jul 09 14:44:28.596394 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:28.596354 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" event={"ID":"9ab007d0-0481-4225-ae25-c49e10a7404a","Type":"ContainerStarted","Data":"c7510558f73a7c4e789bef899ab1419df7c2675bdb498d3e9889efb95b7025dc"} Jul 09 14:44:28.612204 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:28.612158 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mxhmg" podStartSLOduration=1.26677113 podStartE2EDuration="3.612145435s" totalImagesPullingTime="2.345374305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:28.611194778 +0000 UTC m=+269.312815238" watchObservedRunningTime="2026-07-09 14:44:28.612145435 +0000 UTC m=+269.313765881" Jul 09 14:44:29.608878 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:29.608846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:29.609383 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:29.608972 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:29.609383 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:29.609310 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:29.609507 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:29.609386 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:37.609360468 +0000 UTC m=+278.310980898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:29.609507 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:29.609424 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:29.609507 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:29.609473 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:37.609457691 +0000 UTC m=+278.311078121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : configmap "kube-rbac-proxy" not found Jul 09 14:44:33.140120 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:33.140082 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:33.140120 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:33.140125 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:33.140185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140259 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140286 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759c5999f-fpmdg: secret "image-registry-tls" not found Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140313 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140365 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls podName:e831adab-8ed5-4e76-a4cd-5c8de9a2eb22 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:49.140324448 +0000 UTC m=+289.841944881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls") pod "image-registry-5759c5999f-fpmdg" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22") : secret "image-registry-tls" not found Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140383 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:49.140374277 +0000 UTC m=+289.841994717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : configmap references non-existent config key: service-ca.crt Jul 09 14:44:33.140633 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:33.140406 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs podName:8a6a0729-ee12-44fa-b303-b4b0c1ef0c80 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:49.140397621 +0000 UTC m=+289.842018048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs") pod "router-default-68fd675d64-pjh4c" (UID: "8a6a0729-ee12-44fa-b303-b4b0c1ef0c80") : secret "router-metrics-certs-default" not found Jul 09 14:44:37.678110 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:37.678068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:37.678590 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:37.678227 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:37.678590 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:37.678235 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:37.678590 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:37.678298 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls podName:119a6b27-bb75-46b5-851c-914066b83d51 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:53.678282673 +0000 UTC m=+294.379903098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xsc4k" (UID: "119a6b27-bb75-46b5-851c-914066b83d51") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:37.678853 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:37.678834 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/119a6b27-bb75-46b5-851c-914066b83d51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:41.321196 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:41.321141 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8cjcn" podUID="97be1e53-860f-4ece-81af-b06c64fdbb42" Jul 09 14:44:41.636681 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:41.636596 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:44.638323 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:44.638294 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:44.640519 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:44.640502 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97be1e53-860f-4ece-81af-b06c64fdbb42-metrics-tls\") pod \"dns-default-8cjcn\" (UID: \"97be1e53-860f-4ece-81af-b06c64fdbb42\") " pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:44.940585 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:44.940508 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7btb\"" Jul 09 14:44:44.948485 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:44.948469 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:45.071387 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:45.071354 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8cjcn"] Jul 09 14:44:45.074000 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:45.073973 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97be1e53_860f_4ece_81af_b06c64fdbb42.slice/crio-aac2bb4e95bdec96e97bf2b43d661a73f8b2a46e8859bfc2829689624892ea55 WatchSource:0}: Error finding container aac2bb4e95bdec96e97bf2b43d661a73f8b2a46e8859bfc2829689624892ea55: Status 404 returned error can't find the container with id aac2bb4e95bdec96e97bf2b43d661a73f8b2a46e8859bfc2829689624892ea55 Jul 09 14:44:45.649751 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:45.649709 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cjcn" event={"ID":"97be1e53-860f-4ece-81af-b06c64fdbb42","Type":"ContainerStarted","Data":"aac2bb4e95bdec96e97bf2b43d661a73f8b2a46e8859bfc2829689624892ea55"} Jul 09 14:44:47.657104 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:47.657066 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cjcn" event={"ID":"97be1e53-860f-4ece-81af-b06c64fdbb42","Type":"ContainerStarted","Data":"29212672278c219fcab5fae4eae096463a4c50e185e826dd60373ec3cd65091a"} Jul 09 14:44:47.657495 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:47.657121 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8cjcn" event={"ID":"97be1e53-860f-4ece-81af-b06c64fdbb42","Type":"ContainerStarted","Data":"2de3e4e429ef5feca83d75a7ab5e79d167aad1d4a55d326f0741a19e3367276a"} Jul 09 14:44:47.657495 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:47.657195 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:47.679875 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:47.679826 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8cjcn" podStartSLOduration=252.166070739 podStartE2EDuration="4m13.679809475s" totalImagesPullingTime="1.513738736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:47.678168498 +0000 UTC m=+288.379788945" watchObservedRunningTime="2026-07-09 14:44:47.679809475 +0000 UTC m=+288.381429922" Jul 09 14:44:48.084685 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.084648 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5759c5999f-fpmdg"] Jul 09 14:44:48.084902 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:48.084883 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" podUID="e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" Jul 09 14:44:48.659630 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.659599 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:48.664789 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.664770 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:48.772156 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772121 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772156 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772165 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772395 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772182 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772395 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772213 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc4zt\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772395 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772252 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772395 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772269 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772395 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772306 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:48.772648 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772552 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:44:48.772744 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772689 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:44:48.772976 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.772949 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:44:48.774459 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.774433 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:44:48.774557 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.774505 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:44:48.774606 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.774558 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:44:48.774606 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.774594 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt" (OuterVolumeSpecName: "kube-api-access-gc4zt") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "kube-api-access-gc4zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:44:48.873067 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873035 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-ca-trust-extracted\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873067 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873061 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-installation-pull-secrets\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873067 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873070 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-certificates\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873287 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873080 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-bound-sa-token\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873287 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873089 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc4zt\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-kube-api-access-gc4zt\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873287 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873097 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-trusted-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:48.873287 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:48.873106 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-image-registry-private-configuration\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:49.174717 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.174671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:49.174717 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.174722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:49.174938 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.174772 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:49.175376 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.175347 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-service-ca-bundle\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:49.177242 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.177219 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"image-registry-5759c5999f-fpmdg\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:49.177291 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.177227 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6a0729-ee12-44fa-b303-b4b0c1ef0c80-metrics-certs\") pod \"router-default-68fd675d64-pjh4c\" (UID: \"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80\") " pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:49.275095 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.275043 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") pod \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\" (UID: \"e831adab-8ed5-4e76-a4cd-5c8de9a2eb22\") " Jul 09 14:44:49.277026 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.277002 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" (UID: "e831adab-8ed5-4e76-a4cd-5c8de9a2eb22"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:44:49.376580 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.376533 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22-registry-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:44:49.424562 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.424530 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:49.547089 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.547046 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68fd675d64-pjh4c"] Jul 09 14:44:49.550002 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:49.549981 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6a0729_ee12_44fa_b303_b4b0c1ef0c80.slice/crio-2ac92b2e953ad70e3422d52a2453f69b73685a16669e9b09f74f58431ec8e320 WatchSource:0}: Error finding container 2ac92b2e953ad70e3422d52a2453f69b73685a16669e9b09f74f58431ec8e320: Status 404 returned error can't find the container with id 2ac92b2e953ad70e3422d52a2453f69b73685a16669e9b09f74f58431ec8e320 Jul 09 14:44:49.664913 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.664889 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759c5999f-fpmdg" Jul 09 14:44:49.664913 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.664890 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68fd675d64-pjh4c" event={"ID":"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80","Type":"ContainerStarted","Data":"b6088bdcb6987b6c1fa27af0691513238d4673cae2f5e810893288e16b3316e6"} Jul 09 14:44:49.665386 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.664951 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68fd675d64-pjh4c" event={"ID":"8a6a0729-ee12-44fa-b303-b4b0c1ef0c80","Type":"ContainerStarted","Data":"2ac92b2e953ad70e3422d52a2453f69b73685a16669e9b09f74f58431ec8e320"} Jul 09 14:44:49.685434 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.685352 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68fd675d64-pjh4c" podStartSLOduration=32.68531314 podStartE2EDuration="32.68531314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:49.684123699 +0000 UTC m=+290.385744163" watchObservedRunningTime="2026-07-09 14:44:49.68531314 +0000 UTC m=+290.386933587" Jul 09 14:44:49.711552 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.711525 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5759c5999f-fpmdg"] Jul 09 14:44:49.716976 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.716949 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5759c5999f-fpmdg"] Jul 09 14:44:49.859883 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:49.859850 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e831adab-8ed5-4e76-a4cd-5c8de9a2eb22" path="/var/lib/kubelet/pods/e831adab-8ed5-4e76-a4cd-5c8de9a2eb22/volumes" Jul 09 14:44:50.425030 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:50.424986 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:50.427556 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:50.427535 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:50.668543 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:50.668517 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:50.669717 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:50.669700 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68fd675d64-pjh4c" Jul 09 14:44:51.490542 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.490506 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb"] Jul 09 14:44:51.493378 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.493361 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:51.496959 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.496940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-phtlt\"" Jul 09 14:44:51.497482 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.497467 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 14:44:51.510849 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.510828 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb"] Jul 09 14:44:51.594423 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.594380 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b53c829b-cea9-4875-b753-76be045008b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-mntrb\" (UID: \"b53c829b-cea9-4875-b753-76be045008b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:51.694953 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.694924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b53c829b-cea9-4875-b753-76be045008b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-mntrb\" (UID: \"b53c829b-cea9-4875-b753-76be045008b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:51.697383 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.697359 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b53c829b-cea9-4875-b753-76be045008b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-mntrb\" (UID: \"b53c829b-cea9-4875-b753-76be045008b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:51.802555 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.802476 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:51.858412 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:44:51.858375 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xqjx7" podUID="38445a72-385b-405f-a40f-6f6ba0884485" Jul 09 14:44:51.923522 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:51.923492 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb"] Jul 09 14:44:51.926963 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:51.926932 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53c829b_cea9_4875_b753_76be045008b8.slice/crio-bf836dc7e7c7c58c2f320c9f8031f33000200cb5332db13738462630dc3c3db9 WatchSource:0}: Error finding container bf836dc7e7c7c58c2f320c9f8031f33000200cb5332db13738462630dc3c3db9: Status 404 returned error can't find the container with id bf836dc7e7c7c58c2f320c9f8031f33000200cb5332db13738462630dc3c3db9 Jul 09 14:44:52.676427 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:52.676394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" event={"ID":"b53c829b-cea9-4875-b753-76be045008b8","Type":"ContainerStarted","Data":"bf836dc7e7c7c58c2f320c9f8031f33000200cb5332db13738462630dc3c3db9"} Jul 09 14:44:53.681006 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.680973 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" event={"ID":"b53c829b-cea9-4875-b753-76be045008b8","Type":"ContainerStarted","Data":"830f8a1f775ef56085a50bed06d8cf71c9a58932341bf36c32f328f2e89fb1f9"} Jul 09 14:44:53.681405 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.681253 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:53.685756 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.685737 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" Jul 09 14:44:53.696537 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.696500 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-mntrb" podStartSLOduration=1.632412564 podStartE2EDuration="2.696485624s" totalImagesPullingTime="1.06407306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:53.695872781 +0000 UTC m=+294.397493253" watchObservedRunningTime="2026-07-09 14:44:53.696485624 +0000 UTC m=+294.398106111" Jul 09 14:44:53.711007 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.710982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:53.713215 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.713192 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/119a6b27-bb75-46b5-851c-914066b83d51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xsc4k\" (UID: \"119a6b27-bb75-46b5-851c-914066b83d51\") " pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:53.930082 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:53.930048 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xsc4k" Jul 09 14:44:54.050102 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.050067 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xsc4k"] Jul 09 14:44:54.053661 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:54.053632 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119a6b27_bb75_46b5_851c_914066b83d51.slice/crio-e12ea40b48b0d630d038cec08ea8ff38ad4aa69ede21fb439fcf96f47a1b99f1 WatchSource:0}: Error finding container e12ea40b48b0d630d038cec08ea8ff38ad4aa69ede21fb439fcf96f47a1b99f1: Status 404 returned error can't find the container with id e12ea40b48b0d630d038cec08ea8ff38ad4aa69ede21fb439fcf96f47a1b99f1 Jul 09 14:44:54.565270 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.565231 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lzglt"] Jul 09 14:44:54.569483 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.569467 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.573087 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573052 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 14:44:54.573087 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573078 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:44:54.573273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v9wf8\"" Jul 09 14:44:54.573273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573132 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:44:54.573273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573057 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 14:44:54.573273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.573273 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:44:54.577319 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.577300 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lzglt"] Jul 09 14:44:54.617846 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.617820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb5bb\" (UniqueName: \"kubernetes.io/projected/2ec18b87-b73d-4950-9802-66a00482e080-kube-api-access-zb5bb\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.617987 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.617857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.617987 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.617889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.617987 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.617965 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec18b87-b73d-4950-9802-66a00482e080-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.687024 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.686986 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xsc4k" event={"ID":"119a6b27-bb75-46b5-851c-914066b83d51","Type":"ContainerStarted","Data":"e12ea40b48b0d630d038cec08ea8ff38ad4aa69ede21fb439fcf96f47a1b99f1"} Jul 09 14:44:54.718758 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.718723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb5bb\" (UniqueName: \"kubernetes.io/projected/2ec18b87-b73d-4950-9802-66a00482e080-kube-api-access-zb5bb\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.718946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.718782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.718946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.718814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.718946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.718870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec18b87-b73d-4950-9802-66a00482e080-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.719696 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.719669 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ec18b87-b73d-4950-9802-66a00482e080-metrics-client-ca\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.722905 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.722840 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.723375 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.723313 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ec18b87-b73d-4950-9802-66a00482e080-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.733519 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.733492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb5bb\" (UniqueName: \"kubernetes.io/projected/2ec18b87-b73d-4950-9802-66a00482e080-kube-api-access-zb5bb\") pod \"prometheus-operator-64785b6675-lzglt\" (UID: \"2ec18b87-b73d-4950-9802-66a00482e080\") " pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:54.879549 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:54.879458 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" Jul 09 14:44:55.041859 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:55.041830 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-lzglt"] Jul 09 14:44:55.047273 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:44:55.047241 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec18b87_b73d_4950_9802_66a00482e080.slice/crio-052fa1d417c04d713b626df1c17a531f6244095e4a601e3d2f63639fb4cd34ce WatchSource:0}: Error finding container 052fa1d417c04d713b626df1c17a531f6244095e4a601e3d2f63639fb4cd34ce: Status 404 returned error can't find the container with id 052fa1d417c04d713b626df1c17a531f6244095e4a601e3d2f63639fb4cd34ce Jul 09 14:44:55.692708 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:55.692642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" event={"ID":"2ec18b87-b73d-4950-9802-66a00482e080","Type":"ContainerStarted","Data":"052fa1d417c04d713b626df1c17a531f6244095e4a601e3d2f63639fb4cd34ce"} Jul 09 14:44:57.661941 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:57.661903 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8cjcn" Jul 09 14:44:58.705378 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:58.705271 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xsc4k" event={"ID":"119a6b27-bb75-46b5-851c-914066b83d51","Type":"ContainerStarted","Data":"dc43ce22c8b652890d83ccf417c1b683eff3ce3fa79f8b4c36c33d32b2805620"} Jul 09 14:44:58.706920 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:58.706897 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" event={"ID":"2ec18b87-b73d-4950-9802-66a00482e080","Type":"ContainerStarted","Data":"54b23abf3a9213b65d71d94cb6112e932abb0fc2534d6290762cf4fc5166ddbd"} Jul 09 14:44:58.707046 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:58.706936 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" event={"ID":"2ec18b87-b73d-4950-9802-66a00482e080","Type":"ContainerStarted","Data":"03065d57a5613e4b9c69d397d1560b11bd7ccc0dbc9a731b535744645ec386fa"} Jul 09 14:44:58.724428 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:58.724359 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-lzglt" podStartSLOduration=1.461951328 podStartE2EDuration="4.724343585s" totalImagesPullingTime="3.262392257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:58.723382652 +0000 UTC m=+299.425003101" watchObservedRunningTime="2026-07-09 14:44:58.724343585 +0000 UTC m=+299.425964022" Jul 09 14:44:59.713932 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:59.713883 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xsc4k" event={"ID":"119a6b27-bb75-46b5-851c-914066b83d51","Type":"ContainerStarted","Data":"3e083d8029dcef8f09ed6f73f3f1ae58e3c1ab37a5eba1427f4575ead0daef44"} Jul 09 14:44:59.723510 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:59.723482 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:44:59.723659 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:59.723482 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:44:59.729421 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:44:59.729390 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:45:01.722695 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:01.722658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xsc4k" event={"ID":"119a6b27-bb75-46b5-851c-914066b83d51","Type":"ContainerStarted","Data":"244fa1f4ade5488adf34809097ceb4926f0e875a73d81469c6247bca67bb9bb5"} Jul 09 14:45:01.741622 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:01.741580 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xsc4k" podStartSLOduration=33.367789945 podStartE2EDuration="40.741564812s" totalImagesPullingTime="7.373774867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:44:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:01.739857243 +0000 UTC m=+302.441477705" watchObservedRunningTime="2026-07-09 14:45:01.741564812 +0000 UTC m=+302.443185258" Jul 09 14:45:05.831011 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.830971 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8"] Jul 09 14:45:05.834627 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.834608 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:05.838361 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.838315 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8gfj4\"" Jul 09 14:45:05.838541 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.838521 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:45:05.838745 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.838731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 14:45:05.844609 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.844578 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8"] Jul 09 14:45:05.849322 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.849300 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-69hrq"] Jul 09 14:45:05.852436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.852418 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:05.855883 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.855863 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 14:45:05.856591 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.856572 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:45:05.856859 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.856694 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rh7fr\"" Jul 09 14:45:05.856859 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.856793 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 14:45:05.866848 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.866827 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-69hrq"] Jul 09 14:45:05.887283 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.887258 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dzr2"] Jul 09 14:45:05.890919 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.890903 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:05.894210 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.894024 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:45:05.894210 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.894074 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:45:05.894210 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.894138 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:45:05.894474 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.894233 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4wfv\"" Jul 09 14:45:05.910306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.910278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:05.910426 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.910316 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d09a0e9-277e-45a3-8487-12148ccb09a4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:05.910426 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.910365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6f9\" (UniqueName: \"kubernetes.io/projected/8d09a0e9-277e-45a3-8487-12148ccb09a4-kube-api-access-df6f9\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:05.910509 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:05.910488 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.011071 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-root\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011241 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9r77\" (UniqueName: \"kubernetes.io/projected/61064ba9-7859-407e-a7d3-66023effcadf-kube-api-access-q9r77\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.011241 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj57n\" (UniqueName: \"kubernetes.io/projected/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-kube-api-access-zj57n\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011241 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.011241 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011222 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011287 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-wtmp\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011314 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011362 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-metrics-client-ca\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011409 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-textfile\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.011652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011495 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d09a0e9-277e-45a3-8487-12148ccb09a4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.011652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011544 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6f9\" (UniqueName: \"kubernetes.io/projected/8d09a0e9-277e-45a3-8487-12148ccb09a4-kube-api-access-df6f9\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.011652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011599 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.011831 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011749 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.011831 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61064ba9-7859-407e-a7d3-66023effcadf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.011923 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.011842 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 14:45:06.011923 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.011806 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-sys\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.012018 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.011946 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls podName:8d09a0e9-277e-45a3-8487-12148ccb09a4 nodeName:}" failed. No retries permitted until 2026-07-09 14:45:06.511878338 +0000 UTC m=+307.213498769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-8bsq8" (UID: "8d09a0e9-277e-45a3-8487-12148ccb09a4") : secret "openshift-state-metrics-tls" not found Jul 09 14:45:06.012018 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.012006 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.012204 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.012182 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d09a0e9-277e-45a3-8487-12148ccb09a4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.014122 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.014100 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.021528 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.021505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6f9\" (UniqueName: \"kubernetes.io/projected/8d09a0e9-277e-45a3-8487-12148ccb09a4-kube-api-access-df6f9\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.113145 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113145 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113145 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113119 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-wtmp\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113145 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113176 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-metrics-client-ca\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113197 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-textfile\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113322 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61064ba9-7859-407e-a7d3-66023effcadf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113396 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-sys\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113499 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-root\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113893 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113505 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9r77\" (UniqueName: \"kubernetes.io/projected/61064ba9-7859-407e-a7d3-66023effcadf-kube-api-access-q9r77\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.113893 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj57n\" (UniqueName: \"kubernetes.io/projected/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-kube-api-access-zj57n\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.113893 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.113868 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.114171 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114145 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-sys\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.114423 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114398 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.114571 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114545 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.114644 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114621 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-textfile\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.114700 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.114673 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:45:06.114700 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-root\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.114806 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.114754 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls podName:f748e4ae-8cfd-4f46-b208-6e7616a38e4a nodeName:}" failed. No retries permitted until 2026-07-09 14:45:06.614721081 +0000 UTC m=+307.316341511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls") pod "node-exporter-8dzr2" (UID: "f748e4ae-8cfd-4f46-b208-6e7616a38e4a") : secret "node-exporter-tls" not found Jul 09 14:45:06.115028 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/61064ba9-7859-407e-a7d3-66023effcadf-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.115028 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.114990 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-wtmp\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.115467 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.115444 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-metrics-client-ca\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.117179 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.117154 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.117472 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.117453 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.117927 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.117905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61064ba9-7859-407e-a7d3-66023effcadf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.121597 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.121567 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj57n\" (UniqueName: \"kubernetes.io/projected/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-kube-api-access-zj57n\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.123637 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.123619 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9r77\" (UniqueName: \"kubernetes.io/projected/61064ba9-7859-407e-a7d3-66023effcadf-kube-api-access-q9r77\") pod \"kube-state-metrics-785778ff74-69hrq\" (UID: \"61064ba9-7859-407e-a7d3-66023effcadf\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.161693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.161659 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" Jul 09 14:45:06.310695 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.310628 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-69hrq"] Jul 09 14:45:06.314530 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:06.314501 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61064ba9_7859_407e_a7d3_66023effcadf.slice/crio-d61d9ba26e2ef1bb431e0b3eaad760f5b45d9cbb7e2c6bbf7e86448ee5ab5f23 WatchSource:0}: Error finding container d61d9ba26e2ef1bb431e0b3eaad760f5b45d9cbb7e2c6bbf7e86448ee5ab5f23: Status 404 returned error can't find the container with id d61d9ba26e2ef1bb431e0b3eaad760f5b45d9cbb7e2c6bbf7e86448ee5ab5f23 Jul 09 14:45:06.316630 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.316611 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:45:06.517345 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.517298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:06.517518 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.517466 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 14:45:06.517559 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:06.517549 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls podName:8d09a0e9-277e-45a3-8487-12148ccb09a4 nodeName:}" failed. No retries permitted until 2026-07-09 14:45:07.517527603 +0000 UTC m=+308.219148034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-8bsq8" (UID: "8d09a0e9-277e-45a3-8487-12148ccb09a4") : secret "openshift-state-metrics-tls" not found Jul 09 14:45:06.618165 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.618134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.620356 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.620324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f748e4ae-8cfd-4f46-b208-6e7616a38e4a-node-exporter-tls\") pod \"node-exporter-8dzr2\" (UID: \"f748e4ae-8cfd-4f46-b208-6e7616a38e4a\") " pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.739305 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.739272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" event={"ID":"61064ba9-7859-407e-a7d3-66023effcadf","Type":"ContainerStarted","Data":"d61d9ba26e2ef1bb431e0b3eaad760f5b45d9cbb7e2c6bbf7e86448ee5ab5f23"} Jul 09 14:45:06.800778 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.800696 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dzr2" Jul 09 14:45:06.813474 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:06.813450 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf748e4ae_8cfd_4f46_b208_6e7616a38e4a.slice/crio-906c4e73d81a929d6823afda7a5151a1c22b37ac18f4e93ab9991b2d85420e56 WatchSource:0}: Error finding container 906c4e73d81a929d6823afda7a5151a1c22b37ac18f4e93ab9991b2d85420e56: Status 404 returned error can't find the container with id 906c4e73d81a929d6823afda7a5151a1c22b37ac18f4e93ab9991b2d85420e56 Jul 09 14:45:06.856648 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:06.856617 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:45:07.526134 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.526087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:07.529136 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.529107 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d09a0e9-277e-45a3-8487-12148ccb09a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8bsq8\" (UID: \"8d09a0e9-277e-45a3-8487-12148ccb09a4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:07.646484 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.646450 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" Jul 09 14:45:07.744404 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.744369 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dzr2" event={"ID":"f748e4ae-8cfd-4f46-b208-6e7616a38e4a","Type":"ContainerStarted","Data":"906c4e73d81a929d6823afda7a5151a1c22b37ac18f4e93ab9991b2d85420e56"} Jul 09 14:45:07.853137 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.853051 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d7679cb87-x7k97"] Jul 09 14:45:07.856728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.856699 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.859983 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.859958 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 14:45:07.860205 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.860185 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 14:45:07.860299 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.860220 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 14:45:07.860705 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.860685 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 14:45:07.860972 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.860954 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9k6vf8g16jsbu\"" Jul 09 14:45:07.861068 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.861019 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 14:45:07.861134 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.861103 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vrpt6\"" Jul 09 14:45:07.871517 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.871485 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d7679cb87-x7k97"] Jul 09 14:45:07.930862 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.930826 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.930862 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.930867 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-grpc-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.930911 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.930933 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a49f7692-c4ed-47fe-b550-abb10cb28f51-metrics-client-ca\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.930966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.931000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.931069 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:07.931126 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:07.931118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2fk\" (UniqueName: \"kubernetes.io/projected/a49f7692-c4ed-47fe-b550-abb10cb28f51-kube-api-access-bs2fk\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032128 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032091 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2fk\" (UniqueName: \"kubernetes.io/projected/a49f7692-c4ed-47fe-b550-abb10cb28f51-kube-api-access-bs2fk\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-grpc-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032288 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032555 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a49f7692-c4ed-47fe-b550-abb10cb28f51-metrics-client-ca\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.032555 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.032364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.033589 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.033516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a49f7692-c4ed-47fe-b550-abb10cb28f51-metrics-client-ca\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.035324 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.035166 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.035324 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.035271 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.035521 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.035477 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.035700 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.035678 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-grpc-tls\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.035937 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.035916 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.036055 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.036028 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a49f7692-c4ed-47fe-b550-abb10cb28f51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.040461 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.040442 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2fk\" (UniqueName: \"kubernetes.io/projected/a49f7692-c4ed-47fe-b550-abb10cb28f51-kube-api-access-bs2fk\") pod \"thanos-querier-5d7679cb87-x7k97\" (UID: \"a49f7692-c4ed-47fe-b550-abb10cb28f51\") " pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.170306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.170273 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:08.314758 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.314581 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8"] Jul 09 14:45:08.344698 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.344672 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d7679cb87-x7k97"] Jul 09 14:45:08.394739 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:08.394713 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49f7692_c4ed_47fe_b550_abb10cb28f51.slice/crio-4d2a7a1b07f492a9274d8893749d3908321c7f2f0436573259635f776486a817 WatchSource:0}: Error finding container 4d2a7a1b07f492a9274d8893749d3908321c7f2f0436573259635f776486a817: Status 404 returned error can't find the container with id 4d2a7a1b07f492a9274d8893749d3908321c7f2f0436573259635f776486a817 Jul 09 14:45:08.750711 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.750679 2569 generic.go:356] "Generic (PLEG): container finished" podID="f748e4ae-8cfd-4f46-b208-6e7616a38e4a" containerID="d0c4d486a3e2c21a64fd2def4b7477a34acb5d48d8eef47308caeebd39386cc7" exitCode=0 Jul 09 14:45:08.750905 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.750760 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dzr2" event={"ID":"f748e4ae-8cfd-4f46-b208-6e7616a38e4a","Type":"ContainerDied","Data":"d0c4d486a3e2c21a64fd2def4b7477a34acb5d48d8eef47308caeebd39386cc7"} Jul 09 14:45:08.752173 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.752144 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"4d2a7a1b07f492a9274d8893749d3908321c7f2f0436573259635f776486a817"} Jul 09 14:45:08.754523 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.754500 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" event={"ID":"8d09a0e9-277e-45a3-8487-12148ccb09a4","Type":"ContainerStarted","Data":"4881f648d865ef44569f70dfb7eb8f8371f0400074b09ceac765e0f083012b88"} Jul 09 14:45:08.754669 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.754555 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" event={"ID":"8d09a0e9-277e-45a3-8487-12148ccb09a4","Type":"ContainerStarted","Data":"1d5eb532acf4d8a37a83cf89022816202d934e10e25a727bc8a53c03795eb1c8"} Jul 09 14:45:08.754669 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.754584 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" event={"ID":"8d09a0e9-277e-45a3-8487-12148ccb09a4","Type":"ContainerStarted","Data":"ac30ee9c3762db7f97d13609711bf9d8332fa895eaf05093209bc3991b8da2e8"} Jul 09 14:45:08.757094 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.757072 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" event={"ID":"61064ba9-7859-407e-a7d3-66023effcadf","Type":"ContainerStarted","Data":"7d832508794442cb6ad01be6767c629d9a8836e698f6f38cc061e50b682d137b"} Jul 09 14:45:08.757229 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.757123 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" event={"ID":"61064ba9-7859-407e-a7d3-66023effcadf","Type":"ContainerStarted","Data":"304a8ad2531aa8aed1673fc99f582505989fb74da1c6b12d317acab48a90af49"} Jul 09 14:45:08.757229 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.757156 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" event={"ID":"61064ba9-7859-407e-a7d3-66023effcadf","Type":"ContainerStarted","Data":"26080402563fe9788d1d1cf0ccf1fbcd7b922ca26d2b2a4d252fe1e8b92e7cf0"} Jul 09 14:45:08.788820 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:08.788779 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-69hrq" podStartSLOduration=1.94877512 podStartE2EDuration="3.788764524s" totalImagesPullingTime="1.839989404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:08.787593303 +0000 UTC m=+309.489213763" watchObservedRunningTime="2026-07-09 14:45:08.788764524 +0000 UTC m=+309.490384949" Jul 09 14:45:09.764321 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:09.764282 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dzr2" event={"ID":"f748e4ae-8cfd-4f46-b208-6e7616a38e4a","Type":"ContainerStarted","Data":"22c7251ecfbbb0f2211032a55c807056db1e783659c0a5d32c35be5d0a25ebf3"} Jul 09 14:45:09.764767 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:09.764376 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dzr2" event={"ID":"f748e4ae-8cfd-4f46-b208-6e7616a38e4a","Type":"ContainerStarted","Data":"ca63bcc02be07ee22cbc2263fab50c24a620957337ad782940856462ff9935b5"} Jul 09 14:45:09.766543 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:09.766504 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" event={"ID":"8d09a0e9-277e-45a3-8487-12148ccb09a4","Type":"ContainerStarted","Data":"739f5f89bc93c1153a7d2a31f093beb8e228c342d644232cbdd9c09392641154"} Jul 09 14:45:09.783599 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:09.783549 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dzr2" podStartSLOduration=3.337695822 podStartE2EDuration="4.783531539s" totalImagesPullingTime="1.339871049s" totalInitContainerRuntime="105.964668ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:09.782678906 +0000 UTC m=+310.484299353" watchObservedRunningTime="2026-07-09 14:45:09.783531539 +0000 UTC m=+310.485151986" Jul 09 14:45:09.799760 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:09.799713 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8bsq8" podStartSLOduration=3.672379281 podStartE2EDuration="4.799697709s" totalImagesPullingTime="1.127318428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:09.79881433 +0000 UTC m=+310.500434778" watchObservedRunningTime="2026-07-09 14:45:09.799697709 +0000 UTC m=+310.501318155" Jul 09 14:45:10.148800 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.148767 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7689cdf8cf-ncd87"] Jul 09 14:45:10.152379 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.152319 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.154985 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.154898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 14:45:10.154985 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.154898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 14:45:10.155190 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.155042 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2r09p7hm03t6s\"" Jul 09 14:45:10.155921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.155900 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 14:45:10.156035 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.155916 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2smx7\"" Jul 09 14:45:10.156292 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.156183 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 14:45:10.162866 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.162829 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7689cdf8cf-ncd87"] Jul 09 14:45:10.253982 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.253946 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rlpr\" (UniqueName: \"kubernetes.io/projected/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-kube-api-access-9rlpr\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254152 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254152 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-metrics-server-audit-profiles\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254152 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-client-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254152 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-client-certs\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-tls\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.254308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.254213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-audit-log\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355344 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rlpr\" (UniqueName: \"kubernetes.io/projected/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-kube-api-access-9rlpr\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-metrics-server-audit-profiles\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-client-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355431 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-client-certs\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-tls\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-audit-log\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.355921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.355893 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-audit-log\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.356530 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.356501 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.356652 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.356596 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-metrics-server-audit-profiles\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.358351 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.358311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-tls\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.358463 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.358443 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-client-ca-bundle\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.358546 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.358512 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-secret-metrics-server-client-certs\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.363683 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.363665 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rlpr\" (UniqueName: \"kubernetes.io/projected/13265cc8-74dd-4533-9fbf-d6b1f4cb2185-kube-api-access-9rlpr\") pod \"metrics-server-7689cdf8cf-ncd87\" (UID: \"13265cc8-74dd-4533-9fbf-d6b1f4cb2185\") " pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.464708 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.464629 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:10.609702 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.609304 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l"] Jul 09 14:45:10.613538 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.613514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:10.616036 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.615808 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 14:45:10.616036 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.615828 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mf87p\"" Jul 09 14:45:10.621018 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.620887 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l"] Jul 09 14:45:10.759540 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.759513 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:10.759676 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.759567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9s9n\" (UniqueName: \"kubernetes.io/projected/8994032b-30ae-402c-93a1-083d5e5b8095-kube-api-access-d9s9n\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:10.770447 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.770417 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7689cdf8cf-ncd87"] Jul 09 14:45:10.774684 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:10.774661 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13265cc8_74dd_4533_9fbf_d6b1f4cb2185.slice/crio-770cdf86dc6e26d29f819b362985ac73f654d849a526141d2df0ebcdb8871db8 WatchSource:0}: Error finding container 770cdf86dc6e26d29f819b362985ac73f654d849a526141d2df0ebcdb8871db8: Status 404 returned error can't find the container with id 770cdf86dc6e26d29f819b362985ac73f654d849a526141d2df0ebcdb8871db8 Jul 09 14:45:10.859996 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.859968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9s9n\" (UniqueName: \"kubernetes.io/projected/8994032b-30ae-402c-93a1-083d5e5b8095-kube-api-access-d9s9n\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:10.860082 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.860060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:10.860706 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:10.860686 2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 14:45:10.860823 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:45:10.860751 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert podName:8994032b-30ae-402c-93a1-083d5e5b8095 nodeName:}" failed. No retries permitted until 2026-07-09 14:45:11.360729371 +0000 UTC m=+312.062349799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-hx54l" (UID: "8994032b-30ae-402c-93a1-083d5e5b8095") : secret "monitoring-plugin-cert" not found Jul 09 14:45:10.868731 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:10.868693 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9s9n\" (UniqueName: \"kubernetes.io/projected/8994032b-30ae-402c-93a1-083d5e5b8095-kube-api-access-d9s9n\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:11.050059 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.049971 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85876f7b4d-tpdnw"] Jul 09 14:45:11.053318 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.053301 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.055847 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.055823 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d5tnp\"" Jul 09 14:45:11.055965 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.055864 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 14:45:11.055965 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.055942 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 14:45:11.056133 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.056110 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 14:45:11.056133 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.056125 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 14:45:11.056297 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.056237 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 14:45:11.060951 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.060930 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 14:45:11.065448 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.065427 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85876f7b4d-tpdnw"] Jul 09 14:45:11.162544 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162509 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-serving-certs-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162544 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162551 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162764 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162573 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162764 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162635 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162764 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsh2\" (UniqueName: \"kubernetes.io/projected/d0078578-34b0-47c6-8b7d-9d228eaab428-kube-api-access-jhsh2\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162764 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162751 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-federate-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162907 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-metrics-client-ca\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.162907 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.162845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.263967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264003 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-serving-certs-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264187 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264187 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264252 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264315 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsh2\" (UniqueName: \"kubernetes.io/projected/d0078578-34b0-47c6-8b7d-9d228eaab428-kube-api-access-jhsh2\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264385 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264359 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-federate-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264433 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-metrics-client-ca\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.264936 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.264905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-serving-certs-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.265137 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.265112 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-metrics-client-ca\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.265396 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.265374 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.266542 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.266524 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-telemeter-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.266750 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.266735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-federate-client-tls\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.266789 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.266756 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.266789 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.266754 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0078578-34b0-47c6-8b7d-9d228eaab428-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.272720 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.272701 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsh2\" (UniqueName: \"kubernetes.io/projected/d0078578-34b0-47c6-8b7d-9d228eaab428-kube-api-access-jhsh2\") pod \"telemeter-client-85876f7b4d-tpdnw\" (UID: \"d0078578-34b0-47c6-8b7d-9d228eaab428\") " pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.363161 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.363068 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" Jul 09 14:45:11.366006 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.365487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:11.368647 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.368624 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8994032b-30ae-402c-93a1-083d5e5b8095-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-hx54l\" (UID: \"8994032b-30ae-402c-93a1-083d5e5b8095\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:11.494355 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.494308 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85876f7b4d-tpdnw"] Jul 09 14:45:11.495980 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:11.495954 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0078578_34b0_47c6_8b7d_9d228eaab428.slice/crio-6bc11734de32eda8ceca12b3a3f06b21a1e085aabf6a06228f73ed4bbd95cbb5 WatchSource:0}: Error finding container 6bc11734de32eda8ceca12b3a3f06b21a1e085aabf6a06228f73ed4bbd95cbb5: Status 404 returned error can't find the container with id 6bc11734de32eda8ceca12b3a3f06b21a1e085aabf6a06228f73ed4bbd95cbb5 Jul 09 14:45:11.528923 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.528892 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:11.670710 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.670617 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l"] Jul 09 14:45:11.673626 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:11.673596 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8994032b_30ae_402c_93a1_083d5e5b8095.slice/crio-d5bebf39eb31ba9ee740cb24d97845a2cbe1bf8855851844adb43f14498378ba WatchSource:0}: Error finding container d5bebf39eb31ba9ee740cb24d97845a2cbe1bf8855851844adb43f14498378ba: Status 404 returned error can't find the container with id d5bebf39eb31ba9ee740cb24d97845a2cbe1bf8855851844adb43f14498378ba Jul 09 14:45:11.779883 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.779800 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" event={"ID":"d0078578-34b0-47c6-8b7d-9d228eaab428","Type":"ContainerStarted","Data":"6bc11734de32eda8ceca12b3a3f06b21a1e085aabf6a06228f73ed4bbd95cbb5"} Jul 09 14:45:11.781574 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.781510 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" event={"ID":"13265cc8-74dd-4533-9fbf-d6b1f4cb2185","Type":"ContainerStarted","Data":"770cdf86dc6e26d29f819b362985ac73f654d849a526141d2df0ebcdb8871db8"} Jul 09 14:45:11.783083 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.783025 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" event={"ID":"8994032b-30ae-402c-93a1-083d5e5b8095","Type":"ContainerStarted","Data":"d5bebf39eb31ba9ee740cb24d97845a2cbe1bf8855851844adb43f14498378ba"} Jul 09 14:45:11.786131 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.786106 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"d2aff851037b295720a1f8adb0500ec7898a8a8d771adef79e7744651116a593"} Jul 09 14:45:11.786261 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.786173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"74734d6f6d8fd24480238feb338c42633e36f620ce31666349a9bcfdf8bce03e"} Jul 09 14:45:11.786261 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:11.786214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"5bd8c77eb97ac0d25f9f0591a421f519fe83bb0968cb322a9299b7c8b11fa091"} Jul 09 14:45:12.041349 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.041296 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:45:12.047354 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.047305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.050460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050173 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 14:45:12.050460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050190 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 14:45:12.050460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050205 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 14:45:12.050460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050242 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-255e7e2ma14l9\"" Jul 09 14:45:12.050776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050466 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 14:45:12.050776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050596 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 14:45:12.050776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050633 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 14:45:12.050931 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050843 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 14:45:12.050931 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.050878 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 14:45:12.051162 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.051040 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 14:45:12.051396 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.051379 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 14:45:12.052554 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.052534 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 14:45:12.052799 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.052783 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 14:45:12.053024 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.053009 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 14:45:12.053175 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.053052 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 14:45:12.053828 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.051307 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hj774\"" Jul 09 14:45:12.063316 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.063294 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:45:12.172567 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172536 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172693 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172691 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172833 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.172944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172925 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.172997 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.173061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.173136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.173161 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4kcz\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.173191 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.173452 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.173217 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274708 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274755 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4kcz\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274924 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274956 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.274985 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275018 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275152 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275181 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275244 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.278805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275270 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275317 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.275370 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.276458 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.277418 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.278037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.279759 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.278522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.285817 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.283537 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.285817 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.284136 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.287357 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.287293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.289865 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.289517 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.291271 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.290993 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.291842 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.291783 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.294809 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.294587 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.294998 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295146 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295344 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295796 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.295843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4kcz\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.296185 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.295856 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.296449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.296406 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.296732 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.296711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.365053 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.364783 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:12.796201 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.796169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"5dde75ffd7d7032dffc5cbcf7fba913cbd008e652b267309f105c0bff5d5a101"} Jul 09 14:45:12.796599 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.796257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"08215f2f4a5c529ca9ffa5ac9da8f3d8be7341396ba61532ee5db1bdadfd6b33"} Jul 09 14:45:12.925804 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:12.925706 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:45:13.181016 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:45:13.180925 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfff6025_de91_4779_8dc8_d967a877de52.slice/crio-32dc710b649b47dc8e2627eb1f8219c018579735b0671556a1e5fbd66c4c626e WatchSource:0}: Error finding container 32dc710b649b47dc8e2627eb1f8219c018579735b0671556a1e5fbd66c4c626e: Status 404 returned error can't find the container with id 32dc710b649b47dc8e2627eb1f8219c018579735b0671556a1e5fbd66c4c626e Jul 09 14:45:13.801920 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.801883 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" event={"ID":"13265cc8-74dd-4533-9fbf-d6b1f4cb2185","Type":"ContainerStarted","Data":"6d4334a91acb488343c97733838b2848c928c6c93a7e8039bdbdfae1c9a11e07"} Jul 09 14:45:13.803422 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.803397 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" event={"ID":"8994032b-30ae-402c-93a1-083d5e5b8095","Type":"ContainerStarted","Data":"f16fb55f426c81fe8677da9363db1fa96758b86be29e0e14e1ae9f0c1df63f60"} Jul 09 14:45:13.803572 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.803553 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:13.804744 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.804723 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"32dc710b649b47dc8e2627eb1f8219c018579735b0671556a1e5fbd66c4c626e"} Jul 09 14:45:13.807751 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.807729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" event={"ID":"a49f7692-c4ed-47fe-b550-abb10cb28f51","Type":"ContainerStarted","Data":"3e316448c093ab181b22fe1082a23210c7dbe6202704cf50395feb38298350b9"} Jul 09 14:45:13.807892 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.807881 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:13.808947 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.808930 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" Jul 09 14:45:13.819235 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.819197 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" podStartSLOduration=1.406761866 podStartE2EDuration="3.819181632s" totalImagesPullingTime="2.412419766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:13.818360619 +0000 UTC m=+314.519981066" watchObservedRunningTime="2026-07-09 14:45:13.819181632 +0000 UTC m=+314.520802084" Jul 09 14:45:13.840515 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.840476 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" podStartSLOduration=3.358061802 podStartE2EDuration="6.840464529s" totalImagesPullingTime="3.482402727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:13.839846482 +0000 UTC m=+314.541466954" watchObservedRunningTime="2026-07-09 14:45:13.840464529 +0000 UTC m=+314.542084976" Jul 09 14:45:13.854516 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:13.854457 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-hx54l" podStartSLOduration=2.299087916 podStartE2EDuration="3.854439872s" totalImagesPullingTime="1.555351956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:13.854374316 +0000 UTC m=+314.555994764" watchObservedRunningTime="2026-07-09 14:45:13.854439872 +0000 UTC m=+314.556060319" Jul 09 14:45:14.814411 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.814310 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" exitCode=0 Jul 09 14:45:14.814846 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.814402 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} Jul 09 14:45:14.816628 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.816607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" event={"ID":"d0078578-34b0-47c6-8b7d-9d228eaab428","Type":"ContainerStarted","Data":"3ac059cf2a6267c22e2d6d12b4ec00ad03161b4b536b953afcdaeb02cd849638"} Jul 09 14:45:14.816729 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.816655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" event={"ID":"d0078578-34b0-47c6-8b7d-9d228eaab428","Type":"ContainerStarted","Data":"fb5f7b79e1848bea6850547fc5b086db61ea958dfcb9ef7d4e88d388f8b1054e"} Jul 09 14:45:14.816729 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.816675 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" event={"ID":"d0078578-34b0-47c6-8b7d-9d228eaab428","Type":"ContainerStarted","Data":"c7f4ddb0c48edbc12ba6b2a9234041517a97eb9bb7259d513cc0466ccb1c9f7b"} Jul 09 14:45:14.866139 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:14.866080 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85876f7b4d-tpdnw" podStartSLOduration=0.893783243 podStartE2EDuration="3.866060824s" totalImagesPullingTime="2.972277581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:14.865142889 +0000 UTC m=+315.566763370" watchObservedRunningTime="2026-07-09 14:45:14.866060824 +0000 UTC m=+315.567681272" Jul 09 14:45:18.836390 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836304 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} Jul 09 14:45:18.836390 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836387 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} Jul 09 14:45:18.836815 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836421 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} Jul 09 14:45:18.836815 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836448 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} Jul 09 14:45:18.836815 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} Jul 09 14:45:18.836815 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.836503 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerStarted","Data":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} Jul 09 14:45:18.877899 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:18.877824 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.030948921 podStartE2EDuration="6.877804752s" totalImagesPullingTime="4.820473267s" totalInitContainerRuntime="26.382564ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:18.87380902 +0000 UTC m=+319.575429466" watchObservedRunningTime="2026-07-09 14:45:18.877804752 +0000 UTC m=+319.579425199" Jul 09 14:45:19.825018 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:19.824989 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d7679cb87-x7k97" Jul 09 14:45:22.365520 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:22.365489 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:45:30.465155 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:30.465124 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:30.465583 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:30.465198 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:40.925852 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:40.925819 2569 generic.go:356] "Generic (PLEG): container finished" podID="2222f119-3213-4aeb-a13b-b0acbae9a1d1" containerID="8601226d8e887200b4bbfbe9459dc7f712ef52dcd0396eb24ab113f42bbbb2e7" exitCode=0 Jul 09 14:45:40.926189 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:40.925890 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" event={"ID":"2222f119-3213-4aeb-a13b-b0acbae9a1d1","Type":"ContainerDied","Data":"8601226d8e887200b4bbfbe9459dc7f712ef52dcd0396eb24ab113f42bbbb2e7"} Jul 09 14:45:40.926245 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:40.926224 2569 scope.go:117] "RemoveContainer" containerID="8601226d8e887200b4bbfbe9459dc7f712ef52dcd0396eb24ab113f42bbbb2e7" Jul 09 14:45:41.931253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:41.931220 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n6dfc" event={"ID":"2222f119-3213-4aeb-a13b-b0acbae9a1d1","Type":"ContainerStarted","Data":"c669ed352bf064e4e4389b58524c22fac3b6384835821345ea279fbb01fc6909"} Jul 09 14:45:50.470436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:50.470368 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:50.474014 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:50.473992 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7689cdf8cf-ncd87" Jul 09 14:45:50.966390 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:50.966362 2569 generic.go:356] "Generic (PLEG): container finished" podID="c82abea7-baca-4366-93e1-d1e8e47344f9" containerID="8b2099986970fb33b2cbcc69ba38feec4b50cbff66014ad9a35ff0c5d0baf1c2" exitCode=0 Jul 09 14:45:50.966510 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:50.966428 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" event={"ID":"c82abea7-baca-4366-93e1-d1e8e47344f9","Type":"ContainerDied","Data":"8b2099986970fb33b2cbcc69ba38feec4b50cbff66014ad9a35ff0c5d0baf1c2"} Jul 09 14:45:50.966945 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:50.966928 2569 scope.go:117] "RemoveContainer" containerID="8b2099986970fb33b2cbcc69ba38feec4b50cbff66014ad9a35ff0c5d0baf1c2" Jul 09 14:45:51.972468 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:45:51.972437 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-gsklc" event={"ID":"c82abea7-baca-4366-93e1-d1e8e47344f9","Type":"ContainerStarted","Data":"c21731387ceacfc54ae7934a54304150f52e673ddaf02c26809333d0770eca4c"} Jul 09 14:46:12.365406 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:12.365359 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:12.381293 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:12.381269 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:13.068282 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.068259 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:13.627487 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.627449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:46:13.629708 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.629691 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38445a72-385b-405f-a40f-6f6ba0884485-metrics-certs\") pod \"network-metrics-daemon-xqjx7\" (UID: \"38445a72-385b-405f-a40f-6f6ba0884485\") " pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:46:13.760057 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.760027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d62s8\"" Jul 09 14:46:13.768261 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.768243 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqjx7" Jul 09 14:46:13.896883 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:13.896810 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xqjx7"] Jul 09 14:46:13.899443 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:46:13.899417 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38445a72_385b_405f_a40f_6f6ba0884485.slice/crio-c7452788035afba835605a69994e34fac3eb51b1334afd661988e7f520bb391a WatchSource:0}: Error finding container c7452788035afba835605a69994e34fac3eb51b1334afd661988e7f520bb391a: Status 404 returned error can't find the container with id c7452788035afba835605a69994e34fac3eb51b1334afd661988e7f520bb391a Jul 09 14:46:14.057537 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:14.057498 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqjx7" event={"ID":"38445a72-385b-405f-a40f-6f6ba0884485","Type":"ContainerStarted","Data":"c7452788035afba835605a69994e34fac3eb51b1334afd661988e7f520bb391a"} Jul 09 14:46:16.068584 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:16.068543 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqjx7" event={"ID":"38445a72-385b-405f-a40f-6f6ba0884485","Type":"ContainerStarted","Data":"61a1a471161a6a70543aec3091c05f5807b9d332934046e0c4946f1c1b564e33"} Jul 09 14:46:16.068967 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:16.068603 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqjx7" event={"ID":"38445a72-385b-405f-a40f-6f6ba0884485","Type":"ContainerStarted","Data":"76e40deabe7e6105af743cc9a01f8646c3ccc534145d2192718093ee25d8c547"} Jul 09 14:46:16.087150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:16.087101 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xqjx7" podStartSLOduration=375.001354775 podStartE2EDuration="6m16.087086011s" totalImagesPullingTime="1.085731236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:46:16.084946769 +0000 UTC m=+376.786567210" watchObservedRunningTime="2026-07-09 14:46:16.087086011 +0000 UTC m=+376.788706457" Jul 09 14:46:30.447390 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.447354 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:30.448349 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448291 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="prometheus" containerID="cri-o://da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" gracePeriod=600 Jul 09 14:46:30.448933 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448686 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="thanos-sidecar" containerID="cri-o://342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" gracePeriod=600 Jul 09 14:46:30.448933 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448650 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-web" containerID="cri-o://4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" gracePeriod=600 Jul 09 14:46:30.448933 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448499 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy" containerID="cri-o://eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" gracePeriod=600 Jul 09 14:46:30.448933 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448816 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" gracePeriod=600 Jul 09 14:46:30.448933 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.448650 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="config-reloader" containerID="cri-o://1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" gracePeriod=600 Jul 09 14:46:30.709110 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.709085 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:30.794534 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794505 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794534 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794544 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794563 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794589 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794615 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794632 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794672 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794698 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794727 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.794783 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794770 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794796 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794830 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794908 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794918 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794938 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794963 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.794990 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795020 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795063 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795100 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795126 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4kcz\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz\") pod \"bfff6025-de91-4779-8dc8-d967a877de52\" (UID: \"bfff6025-de91-4779-8dc8-d967a877de52\") " Jul 09 14:46:30.795843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795232 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.795843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795450 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.795843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.795471 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.796474 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.796441 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.796790 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.796581 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.797748 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.796750 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.797863 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.796850 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:46:30.797927 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.797362 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.797927 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.797695 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:30.798051 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.797919 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.798581 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.798515 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.798581 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.798547 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz" (OuterVolumeSpecName: "kube-api-access-l4kcz") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "kube-api-access-l4kcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:46:30.799026 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.798999 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.799180 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.799154 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.799492 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.799466 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.799805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.799780 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.799998 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.799967 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config" (OuterVolumeSpecName: "config") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.800093 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.800081 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out" (OuterVolumeSpecName: "config-out") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:46:30.800202 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.800182 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:46:30.800507 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.800475 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.809354 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.809319 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config" (OuterVolumeSpecName: "web-config") pod "bfff6025-de91-4779-8dc8-d967a877de52" (UID: "bfff6025-de91-4779-8dc8-d967a877de52"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:30.896671 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896624 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-config-out\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896671 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896665 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896671 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896682 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896671 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896692 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-tls-assets\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896703 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896712 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896722 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-configmap-metrics-client-ca\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896733 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4kcz\" (UniqueName: \"kubernetes.io/projected/bfff6025-de91-4779-8dc8-d967a877de52-kube-api-access-l4kcz\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896741 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-kube-rbac-proxy\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896750 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-grpc-tls\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896759 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-web-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896766 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-db\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896773 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-config\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896780 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896790 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896799 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfff6025-de91-4779-8dc8-d967a877de52-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896807 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:30.896943 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:30.896815 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfff6025-de91-4779-8dc8-d967a877de52-secret-metrics-client-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:46:31.134668 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134636 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" exitCode=0 Jul 09 14:46:31.134668 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134663 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" exitCode=0 Jul 09 14:46:31.134668 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134674 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" exitCode=0 Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134682 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" exitCode=0 Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134690 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" exitCode=0 Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134698 2569 generic.go:356] "Generic (PLEG): container finished" podID="bfff6025-de91-4779-8dc8-d967a877de52" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" exitCode=0 Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134713 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134683 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134803 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134833 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134864 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134876 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.134921 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134900 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} Jul 09 14:46:31.135309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134941 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} Jul 09 14:46:31.135309 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.134979 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfff6025-de91-4779-8dc8-d967a877de52","Type":"ContainerDied","Data":"32dc710b649b47dc8e2627eb1f8219c018579735b0671556a1e5fbd66c4c626e"} Jul 09 14:46:31.143939 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.143923 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.151310 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.151294 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.158196 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.158162 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.160254 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.160234 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:31.164944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.164923 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:31.165960 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.165947 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.172412 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.172392 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.179412 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.179391 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.185881 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.185863 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.186119 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.186096 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.186300 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186132 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.186300 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186165 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.186558 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.186463 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.186558 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186507 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.186558 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186529 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.186870 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.186851 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.186938 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186877 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.186938 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.186898 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.187158 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.187141 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.187191 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187164 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.187191 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187178 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.187536 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.187518 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.187615 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187539 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.187615 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187554 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.187789 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.187772 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.187824 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187794 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.187824 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.187808 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.188038 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:46:31.188024 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.188072 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188044 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.188072 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188056 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.188266 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188246 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.188313 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188267 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.188495 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188475 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.188495 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188494 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.188938 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188910 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.189016 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.188940 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.189313 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189290 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.189407 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189316 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.189616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189594 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.189679 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189618 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.189847 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189826 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.189903 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.189849 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.190093 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190071 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.190147 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190096 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.190443 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190421 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.190522 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190445 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.190726 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190705 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.190781 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.190729 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.191054 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191026 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.191118 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191058 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.191420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191385 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.191420 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191421 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.191958 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191939 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.191958 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.191958 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.192143 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192128 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.192188 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192143 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.192418 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192401 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.192461 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192418 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.192636 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192617 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.192636 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192635 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.192832 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192818 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.192875 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.192833 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.193060 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193031 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.193060 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193052 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.193238 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193223 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.193295 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193238 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.193436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193418 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.193482 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193437 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.193617 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193602 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.193617 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193616 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.193791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193770 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.193865 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193793 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.194002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.193984 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.194044 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194004 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.194200 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194181 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.194200 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194197 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.194464 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194446 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.194529 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194466 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.194658 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194642 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.194658 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194658 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.194843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194826 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.194893 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.194843 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.195061 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195043 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.195111 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195061 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.195264 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195250 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.195305 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195265 2569 scope.go:117] "RemoveContainer" containerID="c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834" Jul 09 14:46:31.195498 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195482 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834"} err="failed to get container status \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": rpc error: code = NotFound desc = could not find container \"c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834\": container with ID starting with c40a90a682ac528d70f837d442c49631f38f2224e8c1af6fb4c3d41ca6a21834 not found: ID does not exist" Jul 09 14:46:31.195553 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195498 2569 scope.go:117] "RemoveContainer" containerID="eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2" Jul 09 14:46:31.195703 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195688 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2"} err="failed to get container status \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": rpc error: code = NotFound desc = could not find container \"eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2\": container with ID starting with eecf778be2f51deb91573c440522d0f6343e7f32890b2d8c40a448359a791bf2 not found: ID does not exist" Jul 09 14:46:31.195754 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195705 2569 scope.go:117] "RemoveContainer" containerID="4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f" Jul 09 14:46:31.195899 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195885 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f"} err="failed to get container status \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": rpc error: code = NotFound desc = could not find container \"4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f\": container with ID starting with 4b500e63c0249053dbfb404387c52cc70ea3318b5efa2b0d0b1536669a7c226f not found: ID does not exist" Jul 09 14:46:31.195939 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.195899 2569 scope.go:117] "RemoveContainer" containerID="342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9" Jul 09 14:46:31.196085 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196069 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9"} err="failed to get container status \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": rpc error: code = NotFound desc = could not find container \"342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9\": container with ID starting with 342807d37f5337b1c005d11ce3b0789c797e8cfe066f4ce86357c547c40608e9 not found: ID does not exist" Jul 09 14:46:31.196130 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196085 2569 scope.go:117] "RemoveContainer" containerID="1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d" Jul 09 14:46:31.196273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196257 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d"} err="failed to get container status \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": rpc error: code = NotFound desc = could not find container \"1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d\": container with ID starting with 1c4d466e0366c185ad48d0129aa92c4e552f692c8c078f7a78ff6f0f1c71103d not found: ID does not exist" Jul 09 14:46:31.196273 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196272 2569 scope.go:117] "RemoveContainer" containerID="da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616" Jul 09 14:46:31.196472 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196457 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616"} err="failed to get container status \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": rpc error: code = NotFound desc = could not find container \"da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616\": container with ID starting with da94735e68de957ec59593a7bfb1f8075b17559a9c11b8aad0b99b88d3fc4616 not found: ID does not exist" Jul 09 14:46:31.196509 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196472 2569 scope.go:117] "RemoveContainer" containerID="485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf" Jul 09 14:46:31.196686 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.196668 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf"} err="failed to get container status \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": rpc error: code = NotFound desc = could not find container \"485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf\": container with ID starting with 485ff39c2dc6bcfe4e8fda97ff22438feb6b3db17d86c6199d0f33aba1e6abcf not found: ID does not exist" Jul 09 14:46:31.200980 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.200960 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:31.201265 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201253 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="init-config-reloader" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201267 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="init-config-reloader" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201274 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="config-reloader" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201279 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="config-reloader" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201289 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="prometheus" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201294 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="prometheus" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201302 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy" Jul 09 14:46:31.201308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201307 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201340 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="thanos-sidecar" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201349 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="thanos-sidecar" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201355 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-thanos" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201360 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-thanos" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201368 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-web" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201373 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-web" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201419 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="config-reloader" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201429 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-thanos" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201435 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy-web" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201440 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="kube-rbac-proxy" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201444 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="prometheus" Jul 09 14:46:31.201548 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.201450 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfff6025-de91-4779-8dc8-d967a877de52" containerName="thanos-sidecar" Jul 09 14:46:31.205506 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.205492 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.211279 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.210609 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 14:46:31.211279 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.210627 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 14:46:31.211279 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.210855 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hj774\"" Jul 09 14:46:31.211667 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.211496 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.211845 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-255e7e2ma14l9\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.212128 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.212306 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.212441 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.212477 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 14:46:31.212639 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.212594 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 14:46:31.213207 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.213188 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 14:46:31.213296 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.213208 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 14:46:31.213962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.213946 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 14:46:31.214043 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.214028 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 14:46:31.214556 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.214536 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 14:46:31.221534 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.221512 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 14:46:31.223720 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.223703 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:31.301011 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.300981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301167 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301167 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301167 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301167 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301157 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config-out\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301204 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301233 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301260 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7lx\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-kube-api-access-fc7lx\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301317 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301415 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301441 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301467 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-web-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.301743 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.301667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402559 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402458 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402559 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402766 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402574 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402766 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402604 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-web-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402766 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402766 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402767 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402822 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402922 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.402962 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config-out\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.402997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403081 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7lx\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-kube-api-access-fc7lx\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403109 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403184 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403725 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403352 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403725 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403474 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403926 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403901 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.403994 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.403913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.404255 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.404231 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.405704 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.405670 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.405819 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.405751 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406310 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406082 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406468 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406451 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406543 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406471 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406691 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406875 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.406944 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406876 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-web-config\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.407002 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.406954 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6337cba1-d2cb-45e8-95b0-58c7eac3e718-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.407449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.407426 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.408300 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.408272 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.408404 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.408299 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6337cba1-d2cb-45e8-95b0-58c7eac3e718-config-out\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.408646 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.408626 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.408770 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.408754 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6337cba1-d2cb-45e8-95b0-58c7eac3e718-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.413710 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.413690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7lx\" (UniqueName: \"kubernetes.io/projected/6337cba1-d2cb-45e8-95b0-58c7eac3e718-kube-api-access-fc7lx\") pod \"prometheus-k8s-0\" (UID: \"6337cba1-d2cb-45e8-95b0-58c7eac3e718\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.522781 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.522747 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:46:31.660538 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.660492 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:46:31.662644 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:46:31.662617 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6337cba1_d2cb_45e8_95b0_58c7eac3e718.slice/crio-8b7bc4ea4dde6a6c4643c10316ecf9ac62a4d575f782f81135a7f7b0fbacd786 WatchSource:0}: Error finding container 8b7bc4ea4dde6a6c4643c10316ecf9ac62a4d575f782f81135a7f7b0fbacd786: Status 404 returned error can't find the container with id 8b7bc4ea4dde6a6c4643c10316ecf9ac62a4d575f782f81135a7f7b0fbacd786 Jul 09 14:46:31.862286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:31.862249 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfff6025-de91-4779-8dc8-d967a877de52" path="/var/lib/kubelet/pods/bfff6025-de91-4779-8dc8-d967a877de52/volumes" Jul 09 14:46:32.140512 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:32.140480 2569 generic.go:356] "Generic (PLEG): container finished" podID="6337cba1-d2cb-45e8-95b0-58c7eac3e718" containerID="dd1635d0312f04fe5f4786bf6c3abf573a27143d4f7566b849dc221c59f7ce45" exitCode=0 Jul 09 14:46:32.140679 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:32.140569 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerDied","Data":"dd1635d0312f04fe5f4786bf6c3abf573a27143d4f7566b849dc221c59f7ce45"} Jul 09 14:46:32.140679 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:32.140630 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"8b7bc4ea4dde6a6c4643c10316ecf9ac62a4d575f782f81135a7f7b0fbacd786"} Jul 09 14:46:33.147967 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.147932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"d8e4469fa2de8da3e370ecdfa422bfa3db66047ba157513192fe01b1c8a7750a"} Jul 09 14:46:33.148370 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.148012 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"07cff7d5b9617932b0c426779653eab0a2713d71e1a789616c3f6cdac677783b"} Jul 09 14:46:33.148370 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.148055 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"f9981af2b42a881445625b8b8c9f92a88d9b80eec9867cf9b7b9520f1a647a17"} Jul 09 14:46:33.148370 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.148092 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"279a05e63edeef8bd9138e824600dcbde333e2aceaf80c397e37d1dc677a31ad"} Jul 09 14:46:33.148370 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.148126 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"a251caee6bf2a943b4dd9fd19ade71d695d4a9d417bcb81624a440d396a2c42a"} Jul 09 14:46:33.148370 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.148161 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6337cba1-d2cb-45e8-95b0-58c7eac3e718","Type":"ContainerStarted","Data":"6547830453aafed184bfa171e395f792ef34402c9e78f797f004d1b472f305d4"} Jul 09 14:46:33.176115 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:33.176058 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.157223917 podStartE2EDuration="2.176036379s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.812462ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:46:33.174277956 +0000 UTC m=+393.875898403" watchObservedRunningTime="2026-07-09 14:46:33.176036379 +0000 UTC m=+393.877656829" Jul 09 14:46:36.523060 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:46:36.523002 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:47:31.523705 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:47:31.523662 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:47:31.539212 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:47:31.539182 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:47:32.399035 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:47:32.399003 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:48:13.189095 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.189052 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bmp4m"] Jul 09 14:48:13.191622 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.191601 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.194055 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.194036 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:48:13.195007 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.194992 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bpqcz\"" Jul 09 14:48:13.195066 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.195049 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:48:13.202433 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.202413 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bmp4m"] Jul 09 14:48:13.255770 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.255739 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-bound-sa-token\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.255924 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.255808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4kk6\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-kube-api-access-z4kk6\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.356885 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.356851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-bound-sa-token\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.357049 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.356902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4kk6\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-kube-api-access-z4kk6\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.375484 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.375443 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-bound-sa-token\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.376272 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.376251 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4kk6\" (UniqueName: \"kubernetes.io/projected/7836cc9b-d2e7-4371-905a-d0ab069be490-kube-api-access-z4kk6\") pod \"cert-manager-55b4d954d5-bmp4m\" (UID: \"7836cc9b-d2e7-4371-905a-d0ab069be490\") " pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.514603 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.514570 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bmp4m" Jul 09 14:48:13.640504 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:13.640451 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bmp4m"] Jul 09 14:48:13.642795 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:48:13.642770 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7836cc9b_d2e7_4371_905a_d0ab069be490.slice/crio-034e80b569d5dd36950ff41489de367370686fa19e4b2b3ee850ac52e0182642 WatchSource:0}: Error finding container 034e80b569d5dd36950ff41489de367370686fa19e4b2b3ee850ac52e0182642: Status 404 returned error can't find the container with id 034e80b569d5dd36950ff41489de367370686fa19e4b2b3ee850ac52e0182642 Jul 09 14:48:14.558232 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:14.558192 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bmp4m" event={"ID":"7836cc9b-d2e7-4371-905a-d0ab069be490","Type":"ContainerStarted","Data":"034e80b569d5dd36950ff41489de367370686fa19e4b2b3ee850ac52e0182642"} Jul 09 14:48:19.584162 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:19.584120 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bmp4m" event={"ID":"7836cc9b-d2e7-4371-905a-d0ab069be490","Type":"ContainerStarted","Data":"a6742247c376ab35876ddd06d51d4c717ed00b9b7499face4812284a5bec350c"} Jul 09 14:48:19.601238 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:19.601190 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bmp4m" podStartSLOduration=1.545582321 podStartE2EDuration="6.601173756s" totalImagesPullingTime="5.055591435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:19.599250684 +0000 UTC m=+500.300871131" watchObservedRunningTime="2026-07-09 14:48:19.601173756 +0000 UTC m=+500.302794203" Jul 09 14:48:34.856791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.856759 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx"] Jul 09 14:48:34.860352 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.860313 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:34.862800 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.862781 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:48:34.863046 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.863025 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9mjvj\"" Jul 09 14:48:34.863166 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.863054 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:48:34.863166 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.863123 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:48:34.866865 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.866743 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:48:34.875223 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.875200 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx"] Jul 09 14:48:34.943412 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.943374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:34.943594 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.943431 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:34.943594 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.943525 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:34.943594 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.943579 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:34.943725 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:34.943614 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfc2d\" (UniqueName: \"kubernetes.io/projected/7b801295-22e3-4f42-89da-741320bbde9a-kube-api-access-kfc2d\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044071 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044037 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044079 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044102 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044126 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfc2d\" (UniqueName: \"kubernetes.io/projected/7b801295-22e3-4f42-89da-741320bbde9a-kube-api-access-kfc2d\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044253 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.044565 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.044540 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.046487 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.046455 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b801295-22e3-4f42-89da-741320bbde9a-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.046600 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.046582 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.046641 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.046589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b801295-22e3-4f42-89da-741320bbde9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.065269 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.065239 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfc2d\" (UniqueName: \"kubernetes.io/projected/7b801295-22e3-4f42-89da-741320bbde9a-kube-api-access-kfc2d\") pod \"opendatahub-operator-controller-manager-6dd54665dd-zhqqx\" (UID: \"7b801295-22e3-4f42-89da-741320bbde9a\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.170257 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.170173 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:35.321681 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.321649 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx"] Jul 09 14:48:35.324446 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:48:35.324416 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b801295_22e3_4f42_89da_741320bbde9a.slice/crio-fb7d3626f747df89d0ba08c742c505851270dc8d857c4268d6d756b002347575 WatchSource:0}: Error finding container fb7d3626f747df89d0ba08c742c505851270dc8d857c4268d6d756b002347575: Status 404 returned error can't find the container with id fb7d3626f747df89d0ba08c742c505851270dc8d857c4268d6d756b002347575 Jul 09 14:48:35.649487 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:35.649446 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" event={"ID":"7b801295-22e3-4f42-89da-741320bbde9a","Type":"ContainerStarted","Data":"fb7d3626f747df89d0ba08c742c505851270dc8d857c4268d6d756b002347575"} Jul 09 14:48:38.665678 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:38.665591 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" event={"ID":"7b801295-22e3-4f42-89da-741320bbde9a","Type":"ContainerStarted","Data":"ff46e048a8f5fae24aae0b694a8db70151473c6a1a0f52d716e113fc98fc0d9e"} Jul 09 14:48:39.671067 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:39.671034 2569 generic.go:356] "Generic (PLEG): container finished" podID="7b801295-22e3-4f42-89da-741320bbde9a" containerID="ff46e048a8f5fae24aae0b694a8db70151473c6a1a0f52d716e113fc98fc0d9e" exitCode=0 Jul 09 14:48:39.671491 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:39.671119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" event={"ID":"7b801295-22e3-4f42-89da-741320bbde9a","Type":"ContainerDied","Data":"ff46e048a8f5fae24aae0b694a8db70151473c6a1a0f52d716e113fc98fc0d9e"} Jul 09 14:48:40.677321 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:40.677289 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" event={"ID":"7b801295-22e3-4f42-89da-741320bbde9a","Type":"ContainerStarted","Data":"0be36298ffb17dc627d5163be3323fc296a161f0cd7f8aedfbc3d7ab7bd1cf0d"} Jul 09 14:48:40.677741 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:40.677512 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:40.698290 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:40.698233 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" podStartSLOduration=2.253264638 podStartE2EDuration="6.698213064s" totalImagesPullingTime="3.423362072s" totalInitContainerRuntime="1.021586354s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:40.696922539 +0000 UTC m=+521.398543020" watchObservedRunningTime="2026-07-09 14:48:40.698213064 +0000 UTC m=+521.399833512" Jul 09 14:48:51.684674 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:51.684601 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-zhqqx" Jul 09 14:48:52.350483 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.350450 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx"] Jul 09 14:48:52.360025 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.359998 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.361521 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.361497 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx"] Jul 09 14:48:52.362546 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.362523 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:48:52.363791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.363547 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:48:52.363791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.363566 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r2xpw\"" Jul 09 14:48:52.363791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.363630 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:48:52.363791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.363665 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:48:52.363791 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.363717 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:48:52.397280 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.397244 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qjmh\" (UniqueName: \"kubernetes.io/projected/12c75c48-a417-4da0-bd4a-da52b93b2813-kube-api-access-4qjmh\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.397449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.397306 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12c75c48-a417-4da0-bd4a-da52b93b2813-manager-config\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.397449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.397393 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.397449 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.397447 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-metrics-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.498736 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.498705 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12c75c48-a417-4da0-bd4a-da52b93b2813-manager-config\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.498889 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.498757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.498889 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.498806 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-metrics-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.498889 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.498881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qjmh\" (UniqueName: \"kubernetes.io/projected/12c75c48-a417-4da0-bd4a-da52b93b2813-kube-api-access-4qjmh\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.501923 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.501899 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12c75c48-a417-4da0-bd4a-da52b93b2813-manager-config\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.522158 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.522128 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-metrics-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.522300 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.522128 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c75c48-a417-4da0-bd4a-da52b93b2813-cert\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.523967 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.523949 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qjmh\" (UniqueName: \"kubernetes.io/projected/12c75c48-a417-4da0-bd4a-da52b93b2813-kube-api-access-4qjmh\") pod \"lws-controller-manager-756d646c97-9mnrx\" (UID: \"12c75c48-a417-4da0-bd4a-da52b93b2813\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.670587 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.670500 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:48:52.822080 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:52.822040 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx"] Jul 09 14:48:52.824496 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:48:52.824457 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c75c48_a417_4da0_bd4a_da52b93b2813.slice/crio-e657b0d1ef2dadece30b71ddc5aca736f24086ce02af5a74b4145bf695bfefdd WatchSource:0}: Error finding container e657b0d1ef2dadece30b71ddc5aca736f24086ce02af5a74b4145bf695bfefdd: Status 404 returned error can't find the container with id e657b0d1ef2dadece30b71ddc5aca736f24086ce02af5a74b4145bf695bfefdd Jul 09 14:48:53.733838 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:53.733807 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" event={"ID":"12c75c48-a417-4da0-bd4a-da52b93b2813","Type":"ContainerStarted","Data":"e657b0d1ef2dadece30b71ddc5aca736f24086ce02af5a74b4145bf695bfefdd"} Jul 09 14:48:53.799083 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:48:53.799025 2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/d1/d1faa716a0c3715c76f138791f47e4608fbc0fe3d2d959c7a073ae5dd03242e1?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T144853Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=bafd9153659e2f0fcc786e7e86fabbd7c35505c19e6c0ac554ce6dd2e348e197®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-rhel9&akamai_signature=exp=1783609433~hmac=d6ea38006d90e8ab7aa9be6af5a284ac5091ce8c984707def4f003b23d858653\": EOF; artifact err: provided artifact is a container image" image="registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f" Jul 09 14:48:53.799246 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:48:53.799153 2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod lws-controller-manager-756d646c97-9mnrx_openshift-lws-operator(12c75c48-a417-4da0-bd4a-da52b93b2813): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/d1/d1faa716a0c3715c76f138791f47e4608fbc0fe3d2d959c7a073ae5dd03242e1?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T144853Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=bafd9153659e2f0fcc786e7e86fabbd7c35505c19e6c0ac554ce6dd2e348e197®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-rhel9&akamai_signature=exp=1783609433~hmac=d6ea38006d90e8ab7aa9be6af5a284ac5091ce8c984707def4f003b23d858653\": EOF; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 09 14:48:53.799246 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:48:53.799199 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/d1/d1faa716a0c3715c76f138791f47e4608fbc0fe3d2d959c7a073ae5dd03242e1?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T144853Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=bafd9153659e2f0fcc786e7e86fabbd7c35505c19e6c0ac554ce6dd2e348e197®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-rhel9&akamai_signature=exp=1783609433~hmac=d6ea38006d90e8ab7aa9be6af5a284ac5091ce8c984707def4f003b23d858653\\\": EOF; artifact err: provided artifact is a container image\"" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" podUID="12c75c48-a417-4da0-bd4a-da52b93b2813" Jul 09 14:48:54.740479 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:48:54.740434 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/d1/d1faa716a0c3715c76f138791f47e4608fbc0fe3d2d959c7a073ae5dd03242e1?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260709%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260709T144853Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=bafd9153659e2f0fcc786e7e86fabbd7c35505c19e6c0ac554ce6dd2e348e197®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-rhel9&akamai_signature=exp=1783609433~hmac=d6ea38006d90e8ab7aa9be6af5a284ac5091ce8c984707def4f003b23d858653\\\": EOF; artifact err: provided artifact is a container image\"" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" podUID="12c75c48-a417-4da0-bd4a-da52b93b2813" Jul 09 14:48:55.303794 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.303760 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq"] Jul 09 14:48:55.307111 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.307088 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.310045 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.310007 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x4xl6\"" Jul 09 14:48:55.310179 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.310143 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 14:48:55.310404 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.310383 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 14:48:55.323713 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.323620 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq"] Jul 09 14:48:55.427364 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.427315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tls-certs\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.427542 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.427408 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tmp\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.427542 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.427438 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xpw\" (UniqueName: \"kubernetes.io/projected/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-kube-api-access-94xpw\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.528409 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.528371 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tls-certs\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.528597 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.528431 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tmp\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.528597 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.528459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xpw\" (UniqueName: \"kubernetes.io/projected/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-kube-api-access-94xpw\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.531584 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.531551 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tls-certs\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.531773 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.531755 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-tmp\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.537172 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.537142 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xpw\" (UniqueName: \"kubernetes.io/projected/57e11bd6-b050-42e7-b16a-2e2813aaf1a1-kube-api-access-94xpw\") pod \"kube-auth-proxy-7c698c67c6-pvtbq\" (UID: \"57e11bd6-b050-42e7-b16a-2e2813aaf1a1\") " pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.618641 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.618539 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" Jul 09 14:48:55.760982 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:55.760945 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq"] Jul 09 14:48:55.764149 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:48:55.764118 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e11bd6_b050_42e7_b16a_2e2813aaf1a1.slice/crio-e80cddeaee255e6cec05d1644982414304769f0c7f9f2f1cf1f496da03b781ee WatchSource:0}: Error finding container e80cddeaee255e6cec05d1644982414304769f0c7f9f2f1cf1f496da03b781ee: Status 404 returned error can't find the container with id e80cddeaee255e6cec05d1644982414304769f0c7f9f2f1cf1f496da03b781ee Jul 09 14:48:56.751588 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:56.751542 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" event={"ID":"57e11bd6-b050-42e7-b16a-2e2813aaf1a1","Type":"ContainerStarted","Data":"e80cddeaee255e6cec05d1644982414304769f0c7f9f2f1cf1f496da03b781ee"} Jul 09 14:48:59.768086 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:59.768049 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" event={"ID":"57e11bd6-b050-42e7-b16a-2e2813aaf1a1","Type":"ContainerStarted","Data":"44ad654996dd5520935d20cf6618115f5e33ba3dfef7c7817536439a3e87c298"} Jul 09 14:48:59.785819 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:48:59.785770 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c698c67c6-pvtbq" podStartSLOduration=1.575490665 podStartE2EDuration="4.785753631s" totalImagesPullingTime="3.210262966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:59.784371275 +0000 UTC m=+540.485991723" watchObservedRunningTime="2026-07-09 14:48:59.785753631 +0000 UTC m=+540.487374129" Jul 09 14:49:12.833473 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:12.833435 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" event={"ID":"12c75c48-a417-4da0-bd4a-da52b93b2813","Type":"ContainerStarted","Data":"50ef4cb966d25f9f18f0795f217db43c20d767e904960492247282666955499d"} Jul 09 14:49:12.833955 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:12.833633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:49:12.850436 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:12.850393 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" podStartSLOduration=1.663786255 podStartE2EDuration="20.85037783s" totalImagesPullingTime="19.186591575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 14:49:12.848916125 +0000 UTC m=+553.550536598" watchObservedRunningTime="2026-07-09 14:49:12.85037783 +0000 UTC m=+553.551998277" Jul 09 14:49:23.840776 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:23.840747 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-756d646c97-9mnrx" Jul 09 14:49:59.752536 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:59.752506 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:49:59.753478 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:49:59.753452 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:50:35.277494 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.277460 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9"] Jul 09 14:50:35.280859 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.280838 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.286315 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.286289 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 14:50:35.286315 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.286303 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:50:35.286516 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.286291 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 14:50:35.287549 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.287525 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nds7q\"" Jul 09 14:50:35.287655 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.287525 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:50:35.301896 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.301876 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9"] Jul 09 14:50:35.425507 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.425468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff84225b-caa0-48eb-a847-b5968bfb61ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.425675 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.425525 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff84225b-caa0-48eb-a847-b5968bfb61ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.425675 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.425606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldvq\" (UniqueName: \"kubernetes.io/projected/ff84225b-caa0-48eb-a847-b5968bfb61ae-kube-api-access-5ldvq\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.527070 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.527028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff84225b-caa0-48eb-a847-b5968bfb61ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.527233 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.527089 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldvq\" (UniqueName: \"kubernetes.io/projected/ff84225b-caa0-48eb-a847-b5968bfb61ae-kube-api-access-5ldvq\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.527233 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.527143 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff84225b-caa0-48eb-a847-b5968bfb61ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.527760 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.527711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff84225b-caa0-48eb-a847-b5968bfb61ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.529447 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.529420 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff84225b-caa0-48eb-a847-b5968bfb61ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.536579 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.536553 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldvq\" (UniqueName: \"kubernetes.io/projected/ff84225b-caa0-48eb-a847-b5968bfb61ae-kube-api-access-5ldvq\") pod \"kuadrant-console-plugin-66b5774985-cfmb9\" (UID: \"ff84225b-caa0-48eb-a847-b5968bfb61ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.589980 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.589946 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" Jul 09 14:50:35.736718 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.736692 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9"] Jul 09 14:50:35.738252 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:50:35.738227 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff84225b_caa0_48eb_a847_b5968bfb61ae.slice/crio-93ea75ceefeec1c7a422635c08cae984b8a07458b5bfab6d5c2127dd50d1d985 WatchSource:0}: Error finding container 93ea75ceefeec1c7a422635c08cae984b8a07458b5bfab6d5c2127dd50d1d985: Status 404 returned error can't find the container with id 93ea75ceefeec1c7a422635c08cae984b8a07458b5bfab6d5c2127dd50d1d985 Jul 09 14:50:35.739593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:35.739574 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:50:36.223221 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:50:36.223185 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" event={"ID":"ff84225b-caa0-48eb-a847-b5968bfb61ae","Type":"ContainerStarted","Data":"93ea75ceefeec1c7a422635c08cae984b8a07458b5bfab6d5c2127dd50d1d985"} Jul 09 14:51:00.349128 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:00.349093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" event={"ID":"ff84225b-caa0-48eb-a847-b5968bfb61ae","Type":"ContainerStarted","Data":"b4db4546eacac484861c16ff59ff76fcedeb14b099399f22d8d318d0b0517e11"} Jul 09 14:51:00.366858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:00.366801 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cfmb9" podStartSLOduration=1.790841329 podStartE2EDuration="25.366762929s" totalImagesPullingTime="23.5759216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:51:00.366201498 +0000 UTC m=+661.067821964" watchObservedRunningTime="2026-07-09 14:51:00.366762929 +0000 UTC m=+661.068383377" Jul 09 14:51:20.492346 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.492293 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:51:20.500724 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.500703 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.503770 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.503743 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 14:51:20.511042 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.511022 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:51:20.571645 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.571614 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:51:20.641431 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.641398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgwfv\" (UniqueName: \"kubernetes.io/projected/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-kube-api-access-rgwfv\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.641588 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.641468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-config-file\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.742529 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.742449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-config-file\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.742529 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.742510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgwfv\" (UniqueName: \"kubernetes.io/projected/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-kube-api-access-rgwfv\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.743071 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.743042 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-config-file\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.752535 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.752503 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgwfv\" (UniqueName: \"kubernetes.io/projected/5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95-kube-api-access-rgwfv\") pod \"limitador-limitador-54d6d988d5-hzpgt\" (UID: \"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.811375 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.811317 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:20.948445 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:20.948411 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:51:20.951156 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:51:20.951128 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3d89c7_4da8_4b3a_9ca7_589ad81e2b95.slice/crio-d697537a68abb08c88ef9254f1a5872d2074294abd89826081049593d958c6d3 WatchSource:0}: Error finding container d697537a68abb08c88ef9254f1a5872d2074294abd89826081049593d958c6d3: Status 404 returned error can't find the container with id d697537a68abb08c88ef9254f1a5872d2074294abd89826081049593d958c6d3 Jul 09 14:51:21.281659 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.281630 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:21.284753 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.284734 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:21.287375 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.287358 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p6qjh\"" Jul 09 14:51:21.297131 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.297111 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:21.348634 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.348606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blcqs\" (UniqueName: \"kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs\") pod \"authorino-75d556bd77-8hds7\" (UID: \"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a\") " pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:21.442510 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.442479 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" event={"ID":"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95","Type":"ContainerStarted","Data":"d697537a68abb08c88ef9254f1a5872d2074294abd89826081049593d958c6d3"} Jul 09 14:51:21.450004 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.449982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blcqs\" (UniqueName: \"kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs\") pod \"authorino-75d556bd77-8hds7\" (UID: \"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a\") " pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:21.464583 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.464555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blcqs\" (UniqueName: \"kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs\") pod \"authorino-75d556bd77-8hds7\" (UID: \"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a\") " pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:21.594477 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.594387 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:21.790230 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:21.790155 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:21.793313 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:51:21.793284 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf54c6c3b_3db1_4c52_8af6_a0bc6b64566a.slice/crio-f49221febc1d1988db1508a25f48f36d04235251a8d356df53be91be4f1403d9 WatchSource:0}: Error finding container f49221febc1d1988db1508a25f48f36d04235251a8d356df53be91be4f1403d9: Status 404 returned error can't find the container with id f49221febc1d1988db1508a25f48f36d04235251a8d356df53be91be4f1403d9 Jul 09 14:51:22.449239 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:22.449193 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8hds7" event={"ID":"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a","Type":"ContainerStarted","Data":"f49221febc1d1988db1508a25f48f36d04235251a8d356df53be91be4f1403d9"} Jul 09 14:51:24.462107 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:24.462062 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" event={"ID":"5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95","Type":"ContainerStarted","Data":"a76b643a276c9455bbf8767616752b75e3b90950ce91606f6974fa4e412742f5"} Jul 09 14:51:24.462593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:24.462280 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:24.488216 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:24.488169 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" podStartSLOduration=1.8306454410000002 podStartE2EDuration="4.488149283s" totalImagesPullingTime="2.657503842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:51:24.486141546 +0000 UTC m=+685.187761995" watchObservedRunningTime="2026-07-09 14:51:24.488149283 +0000 UTC m=+685.189769729" Jul 09 14:51:26.473502 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:26.473466 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8hds7" event={"ID":"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a","Type":"ContainerStarted","Data":"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f"} Jul 09 14:51:26.490510 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:26.490461 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8hds7" podStartSLOduration=1.6074750469999999 podStartE2EDuration="5.490446378s" totalImagesPullingTime="3.882971331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:51:26.489187189 +0000 UTC m=+687.190807639" watchObservedRunningTime="2026-07-09 14:51:26.490446378 +0000 UTC m=+687.192066825" Jul 09 14:51:35.469161 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:35.469130 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hzpgt" Jul 09 14:51:56.123973 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.123894 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:56.124505 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.124086 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8hds7" podUID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" containerName="authorino" containerID="cri-o://aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f" gracePeriod=30 Jul 09 14:51:56.400013 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.399946 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:56.465424 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.465386 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blcqs\" (UniqueName: \"kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs\") pod \"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a\" (UID: \"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a\") " Jul 09 14:51:56.467487 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.467455 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs" (OuterVolumeSpecName: "kube-api-access-blcqs") pod "f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" (UID: "f54c6c3b-3db1-4c52-8af6-a0bc6b64566a"). InnerVolumeSpecName "kube-api-access-blcqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:51:56.566118 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.566081 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blcqs\" (UniqueName: \"kubernetes.io/projected/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a-kube-api-access-blcqs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 14:51:56.618674 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.618645 2569 generic.go:356] "Generic (PLEG): container finished" podID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" containerID="aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f" exitCode=0 Jul 09 14:51:56.618843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.618687 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8hds7" Jul 09 14:51:56.618843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.618728 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8hds7" event={"ID":"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a","Type":"ContainerDied","Data":"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f"} Jul 09 14:51:56.618843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.618759 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8hds7" event={"ID":"f54c6c3b-3db1-4c52-8af6-a0bc6b64566a","Type":"ContainerDied","Data":"f49221febc1d1988db1508a25f48f36d04235251a8d356df53be91be4f1403d9"} Jul 09 14:51:56.618843 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.618779 2569 scope.go:117] "RemoveContainer" containerID="aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f" Jul 09 14:51:56.627305 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.627290 2569 scope.go:117] "RemoveContainer" containerID="aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f" Jul 09 14:51:56.627621 ip-10-0-135-41 kubenswrapper[2569]: E0709 14:51:56.627604 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f\": container with ID starting with aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f not found: ID does not exist" containerID="aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f" Jul 09 14:51:56.627680 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.627631 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f"} err="failed to get container status \"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f\": rpc error: code = NotFound desc = could not find container \"aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f\": container with ID starting with aa18b1b05f8d8584376e183a8dc955e66f028905707280aadbf13acd4e53106f not found: ID does not exist" Jul 09 14:51:56.639008 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.638985 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:56.643106 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:56.643086 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8hds7"] Jul 09 14:51:57.862189 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:51:57.862158 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" path="/var/lib/kubelet/pods/f54c6c3b-3db1-4c52-8af6-a0bc6b64566a/volumes" Jul 09 14:52:35.407828 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:52:35.407797 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:53:38.578492 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.578462 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx"] Jul 09 14:53:38.578882 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.578810 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" containerName="authorino" Jul 09 14:53:38.578882 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.578821 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" containerName="authorino" Jul 09 14:53:38.578964 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.578888 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54c6c3b-3db1-4c52-8af6-a0bc6b64566a" containerName="authorino" Jul 09 14:53:38.580858 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.580837 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.583322 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.583302 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cj4mh\"" Jul 09 14:53:38.583322 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.583319 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 14:53:38.584304 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.584286 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:53:38.584407 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.584369 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:53:38.591869 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.591848 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx"] Jul 09 14:53:38.678385 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.678385 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678385 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl2lp\" (UniqueName: \"kubernetes.io/projected/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-kube-api-access-tl2lp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.678593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.678593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.678593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.678593 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.678572 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779527 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779492 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779527 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl2lp\" (UniqueName: \"kubernetes.io/projected/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-kube-api-access-tl2lp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779608 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779728 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779654 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779975 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779943 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.779975 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.779962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.780133 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.780021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.781892 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.781863 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.782114 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.782094 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.788308 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.788286 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl2lp\" (UniqueName: \"kubernetes.io/projected/6065fe8a-ca32-40ad-b0d2-bf541e0c12d8-kube-api-access-tl2lp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx\" (UID: \"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:38.892196 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:38.892113 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:39.025186 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:39.025161 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx"] Jul 09 14:53:39.026905 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:53:39.026874 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6065fe8a_ca32_40ad_b0d2_bf541e0c12d8.slice/crio-2541f21db937b3018de716780c8a8f26653e3472d4dd49248f2728e63e3e9674 WatchSource:0}: Error finding container 2541f21db937b3018de716780c8a8f26653e3472d4dd49248f2728e63e3e9674: Status 404 returned error can't find the container with id 2541f21db937b3018de716780c8a8f26653e3472d4dd49248f2728e63e3e9674 Jul 09 14:53:39.081592 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:39.081551 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" event={"ID":"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8","Type":"ContainerStarted","Data":"2541f21db937b3018de716780c8a8f26653e3472d4dd49248f2728e63e3e9674"} Jul 09 14:53:39.267478 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:39.267442 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:53:41.091953 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:41.091920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" event={"ID":"6065fe8a-ca32-40ad-b0d2-bf541e0c12d8","Type":"ContainerStarted","Data":"78a7d4e2dc4ac62d2b84f95b3b446cb04beb7e640af154686abef2c40b439fdb"} Jul 09 14:53:41.110208 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:41.110161 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" podStartSLOduration=2.063265074 podStartE2EDuration="3.110143795s" totalImagesPullingTime="1.046878721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:53:41.108948231 +0000 UTC m=+821.810568679" watchObservedRunningTime="2026-07-09 14:53:41.110143795 +0000 UTC m=+821.811764241" Jul 09 14:53:45.959495 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:45.959461 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:53:48.893096 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:48.893062 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:48.893525 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:48.893117 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:48.905650 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:48.905622 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:53:49.139713 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:53:49.139685 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx" Jul 09 14:54:02.977460 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:02.977425 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:54:15.761863 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:15.761830 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:54:33.058963 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:33.058923 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:54:46.767761 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.767716 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d"] Jul 09 14:54:46.771212 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.771190 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.773852 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.773823 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 14:54:46.779951 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.779931 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d"] Jul 09 14:54:46.898782 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898745 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6adc3083-5dab-41fc-9693-c38bb6e849c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.898946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898799 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.898946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.898946 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898879 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.899045 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898942 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9tgn\" (UniqueName: \"kubernetes.io/projected/6adc3083-5dab-41fc-9693-c38bb6e849c2-kube-api-access-t9tgn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.899045 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.898983 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999582 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999762 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6adc3083-5dab-41fc-9693-c38bb6e849c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999762 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999634 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999762 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999762 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:46.999762 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9tgn\" (UniqueName: \"kubernetes.io/projected/6adc3083-5dab-41fc-9693-c38bb6e849c2-kube-api-access-t9tgn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.000028 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:46.999932 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.000082 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.000031 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.000162 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.000097 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.001885 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.001862 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6adc3083-5dab-41fc-9693-c38bb6e849c2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.002178 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.002161 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6adc3083-5dab-41fc-9693-c38bb6e849c2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.008948 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.008925 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9tgn\" (UniqueName: \"kubernetes.io/projected/6adc3083-5dab-41fc-9693-c38bb6e849c2-kube-api-access-t9tgn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d\" (UID: \"6adc3083-5dab-41fc-9693-c38bb6e849c2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.103532 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.103445 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:47.239698 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.239674 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d"] Jul 09 14:54:47.242161 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:54:47.242132 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6adc3083_5dab_41fc_9693_c38bb6e849c2.slice/crio-71af455e5e2341c784f38fdc78443465333020311ee65e948c8854f3b679aa12 WatchSource:0}: Error finding container 71af455e5e2341c784f38fdc78443465333020311ee65e948c8854f3b679aa12: Status 404 returned error can't find the container with id 71af455e5e2341c784f38fdc78443465333020311ee65e948c8854f3b679aa12 Jul 09 14:54:47.396732 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:47.396645 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" event={"ID":"6adc3083-5dab-41fc-9693-c38bb6e849c2","Type":"ContainerStarted","Data":"71af455e5e2341c784f38fdc78443465333020311ee65e948c8854f3b679aa12"} Jul 09 14:54:48.405976 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:48.405941 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" event={"ID":"6adc3083-5dab-41fc-9693-c38bb6e849c2","Type":"ContainerStarted","Data":"e960b3dbdf520da8ce055e8f7e227ebda7bb3c918fe6b0d0067711b3d617f47c"} Jul 09 14:54:48.425578 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:48.425530 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" podStartSLOduration=2.1924991990000002 podStartE2EDuration="2.425515427s" totalImagesPullingTime="233.016228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:54:48.423787066 +0000 UTC m=+889.125407515" watchObservedRunningTime="2026-07-09 14:54:48.425515427 +0000 UTC m=+889.127135874" Jul 09 14:54:49.268036 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:49.267998 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:54:57.104320 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:57.104229 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:57.104320 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:57.104282 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:57.116691 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:57.116669 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:57.458429 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:57.458348 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d" Jul 09 14:54:59.783167 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:59.783137 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:54:59.784603 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:54:59.784581 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:55:59.955286 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:55:59.955254 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67b559c486-hsmfq"] Jul 09 14:55:59.958484 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:55:59.958468 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:55:59.962264 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:55:59.962243 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p6qjh\"" Jul 09 14:55:59.962431 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:55:59.962287 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 14:55:59.971068 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:55:59.971046 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b559c486-hsmfq"] Jul 09 14:56:00.070470 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.070430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7rb\" (UniqueName: \"kubernetes.io/projected/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-kube-api-access-dz7rb\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.070650 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.070558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-tls-cert\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.171883 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.171843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7rb\" (UniqueName: \"kubernetes.io/projected/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-kube-api-access-dz7rb\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.172079 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.171936 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-tls-cert\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.174486 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.174464 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-tls-cert\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.180306 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.180283 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7rb\" (UniqueName: \"kubernetes.io/projected/c9e77b22-8efa-42ef-b6d8-e63513a3a9a5-kube-api-access-dz7rb\") pod \"authorino-67b559c486-hsmfq\" (UID: \"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5\") " pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.267450 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.267419 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b559c486-hsmfq" Jul 09 14:56:00.416011 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.415987 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b559c486-hsmfq"] Jul 09 14:56:00.418613 ip-10-0-135-41 kubenswrapper[2569]: W0709 14:56:00.418587 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9e77b22_8efa_42ef_b6d8_e63513a3a9a5.slice/crio-452ff03b1bed59da61b9cb9e1477342246bb4876556c5be7a590aee1b20fcb77 WatchSource:0}: Error finding container 452ff03b1bed59da61b9cb9e1477342246bb4876556c5be7a590aee1b20fcb77: Status 404 returned error can't find the container with id 452ff03b1bed59da61b9cb9e1477342246bb4876556c5be7a590aee1b20fcb77 Jul 09 14:56:00.419880 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.419862 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:56:00.752950 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:00.752918 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b559c486-hsmfq" event={"ID":"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5","Type":"ContainerStarted","Data":"452ff03b1bed59da61b9cb9e1477342246bb4876556c5be7a590aee1b20fcb77"} Jul 09 14:56:01.766928 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:01.766886 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b559c486-hsmfq" event={"ID":"c9e77b22-8efa-42ef-b6d8-e63513a3a9a5","Type":"ContainerStarted","Data":"d5477db72fde52ecd856baa46850a8524feef627e807abc5e2561e8c0e3b4fd4"} Jul 09 14:56:01.783700 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:01.783641 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67b559c486-hsmfq" podStartSLOduration=2.381622956 podStartE2EDuration="2.783625689s" totalImagesPullingTime="402.002733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:01.783034081 +0000 UTC m=+962.484654545" watchObservedRunningTime="2026-07-09 14:56:01.783625689 +0000 UTC m=+962.485246168" Jul 09 14:56:43.566514 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:43.566479 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:56:54.977150 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:56:54.977105 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:57:03.972992 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:57:03.972955 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:57:14.564526 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:57:14.564490 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:57:24.259429 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:57:24.259391 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:57:53.563741 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:57:53.563657 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:58:04.763616 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:58:04.763579 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:58:41.865672 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:58:41.865640 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:58:51.871936 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:58:51.871902 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:01.903396 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:01.903359 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:09.867673 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:09.867643 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:19.479678 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:19.479642 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:29.371636 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:29.371602 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:41.669805 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:41.669774 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:51.472411 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:51.472366 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 14:59:59.816890 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:59.816858 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 14:59:59.820870 ip-10-0-135-41 kubenswrapper[2569]: I0709 14:59:59.820842 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:00:13.479584 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:00:13.479546 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:00:23.075713 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:00:23.075675 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:00:46.274997 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:00:46.274960 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:00:55.773867 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:00:55.773836 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:01:14.986572 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:01:14.986540 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:01:23.678307 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:01:23.678270 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:01:32.978234 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:01:32.978200 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:01:42.269000 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:01:42.268965 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:01:51.169866 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:01:51.164934 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:03:42.062029 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:03:42.061993 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:03:50.669041 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:03:50.668953 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:03.163981 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:03.163942 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:14.261759 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:14.261722 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:25.369156 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:25.369117 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:36.572725 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:36.572683 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:45.067227 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:45.067194 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:55.764188 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:55.764151 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:04:59.849844 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:59.849820 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:04:59.854169 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:04:59.854145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:05:07.472239 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:05:07.472206 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:05:16.960538 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:05:16.960501 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:05:27.162928 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:05:27.162891 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:05:49.067451 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:05:49.067417 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:05:57.562920 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:05:57.562884 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:06:09.365871 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:06:09.365759 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:06:18.955204 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:06:18.955165 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:06:35.664946 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:06:35.664911 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:06:44.974801 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:06:44.974770 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:06:53.868843 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:06:53.868765 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:04.163191 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:04.163160 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:13.060757 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:13.060715 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:23.963566 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:23.963528 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:36.864082 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:36.864035 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:45.765629 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:45.765590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:07:54.781833 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:07:54.781791 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:06.063669 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:06.063637 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:15.165621 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:15.165587 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:21.869598 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:21.869508 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:36.975191 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:36.975154 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:48.070703 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:48.070669 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:08:57.559372 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:08:57.559309 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:09:12.664920 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:12.664830 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:09:23.664996 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:23.664963 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:09:38.955268 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:38.955236 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:09:48.466599 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:48.466559 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:09:59.878985 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:59.878956 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:09:59.884995 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:09:59.884972 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:11:10.166470 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:11:10.166435 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:11:18.064407 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:11:18.064373 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:11:31.561865 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:11:31.561831 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:11:39.668577 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:11:39.668539 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:12:11.671808 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:12:11.671771 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:12:23.465307 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:12:23.465275 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:12:40.184769 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:12:40.184734 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:12:54.869423 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:12:54.869325 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:13:34.168552 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:13:34.168514 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:13:43.978234 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:13:43.978204 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:13:56.273270 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:13:56.273237 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:14:45.179177 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:14:45.179141 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:14:57.581167 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:14:57.581131 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:14:59.910805 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:14:59.910773 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:14:59.914320 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:14:59.914297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:15:31.284450 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.284414 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:15:31.287785 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.287765 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.292028 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.292000 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e3e936\"/\"test-model-e3e936-kserve-self-signed-certs\"" Jul 09 15:15:31.292028 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.292014 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e3e936\"/\"default-dockercfg-c682s\"" Jul 09 15:15:31.292187 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.292076 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e3e936\"/\"kube-root-ca.crt\"" Jul 09 15:15:31.292227 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.292182 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e3e936\"/\"openshift-service-ca.crt\"" Jul 09 15:15:31.298605 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.298581 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:15:31.387958 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.387923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhtm\" (UniqueName: \"kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.388132 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.387987 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.388132 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.388009 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.388132 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.388107 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.388237 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.388146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.388237 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.388170 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489215 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489215 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489508 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489508 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489508 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489508 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhtm\" (UniqueName: \"kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489721 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489601 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489721 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489699 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.489816 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.489797 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.491663 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.491642 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.491786 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.491769 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.498629 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.498604 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhtm\" (UniqueName: \"kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm\") pod \"test-model-e3e936-kserve-5474bcb9f5-4rdnw\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.597650 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.597548 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:31.739762 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:31.739731 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:15:31.741816 ip-10-0-135-41 kubenswrapper[2569]: W0709 15:15:31.741786 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2024c8c_4ff1_4e49_84ac_18d7e2fd1bcf.slice/crio-f40bc342ea2d11bfc673fbe1d963fab8ab34036a1e3f07614bd1827f291f321c WatchSource:0}: Error finding container f40bc342ea2d11bfc673fbe1d963fab8ab34036a1e3f07614bd1827f291f321c: Status 404 returned error can't find the container with id f40bc342ea2d11bfc673fbe1d963fab8ab34036a1e3f07614bd1827f291f321c Jul 09 15:15:32.349178 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:32.349137 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" event={"ID":"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf","Type":"ContainerStarted","Data":"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076"} Jul 09 15:15:32.349589 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:32.349184 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" event={"ID":"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf","Type":"ContainerStarted","Data":"f40bc342ea2d11bfc673fbe1d963fab8ab34036a1e3f07614bd1827f291f321c"} Jul 09 15:15:32.373449 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:32.373398 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" podStartSLOduration=1.37338004 podStartE2EDuration="1.37338004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:15:32.371760716 +0000 UTC m=+2133.073381163" watchObservedRunningTime="2026-07-09 15:15:32.37338004 +0000 UTC m=+2133.075000486" Jul 09 15:15:35.593612 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:35.593573 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:15:41.598501 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:41.598461 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:41.599073 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:41.598518 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:41.611392 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:41.611363 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:42.412649 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:42.412605 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:15:49.670042 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:15:49.670005 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:16:14.537893 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:14.537861 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:16:17.300375 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:17.300343 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:16:29.558150 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.558087 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" podUID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" containerName="main" containerID="cri-o://fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076" gracePeriod=45 Jul 09 15:16:29.764645 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.764614 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:16:29.806376 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.806348 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:16:29.825637 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825552 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.825637 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825597 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.825637 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825628 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkhtm\" (UniqueName: \"kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.825881 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825667 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.825881 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825698 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.825881 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.825795 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home\") pod \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\" (UID: \"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf\") " Jul 09 15:16:29.826353 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.826290 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:16:29.826353 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.826298 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home" (OuterVolumeSpecName: "home") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:16:29.826585 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.826381 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:16:29.828125 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.828100 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm" (OuterVolumeSpecName: "dshm") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:16:29.828445 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.828420 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:16:29.828585 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.828565 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm" (OuterVolumeSpecName: "kube-api-access-dkhtm") pod "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" (UID: "b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf"). InnerVolumeSpecName "kube-api-access-dkhtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:16:29.927645 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927607 2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-dshm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:29.927645 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927634 2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tls-certs\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:29.927645 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927645 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkhtm\" (UniqueName: \"kubernetes.io/projected/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-kube-api-access-dkhtm\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:29.927645 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927655 2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-tmp-dir\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:29.927964 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927662 2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-model-cache\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:29.927964 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:29.927670 2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf-home\") on node \"ip-10-0-135-41.ec2.internal\" DevicePath \"\"" Jul 09 15:16:30.637520 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.637483 2569 generic.go:356] "Generic (PLEG): container finished" podID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" containerID="fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076" exitCode=0 Jul 09 15:16:30.637960 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.637537 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" Jul 09 15:16:30.637960 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.637554 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" event={"ID":"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf","Type":"ContainerDied","Data":"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076"} Jul 09 15:16:30.637960 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.637602 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw" event={"ID":"b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf","Type":"ContainerDied","Data":"f40bc342ea2d11bfc673fbe1d963fab8ab34036a1e3f07614bd1827f291f321c"} Jul 09 15:16:30.637960 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.637620 2569 scope.go:117] "RemoveContainer" containerID="fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076" Jul 09 15:16:30.646307 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.646290 2569 scope.go:117] "RemoveContainer" containerID="fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076" Jul 09 15:16:30.646561 ip-10-0-135-41 kubenswrapper[2569]: E0709 15:16:30.646544 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076\": container with ID starting with fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076 not found: ID does not exist" containerID="fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076" Jul 09 15:16:30.646621 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.646569 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076"} err="failed to get container status \"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076\": rpc error: code = NotFound desc = could not find container \"fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076\": container with ID starting with fe15f327d3448089215c3eb6f0a8d0eb6ec34081ff1ecb0de6bf08baa0917076 not found: ID does not exist" Jul 09 15:16:30.654479 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.654456 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:16:30.657867 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:30.657847 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e3e936/test-model-e3e936-kserve-5474bcb9f5-4rdnw"] Jul 09 15:16:31.862837 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:16:31.862804 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" path="/var/lib/kubelet/pods/b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf/volumes" Jul 09 15:17:01.276155 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:17:01.276123 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:17:16.272779 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:17:16.272741 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:17:33.774496 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:17:33.774464 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:17:43.776897 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:17:43.772447 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:17:55.587378 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:17:55.587343 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:18:11.074923 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:18:11.074884 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:19:59.948032 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:19:59.947998 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:19:59.952498 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:19:59.952479 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x72nh_79a64e1b-df4a-4f7c-aed5-e750b5adf05e/ovn-acl-logging/0.log" Jul 09 15:21:11.663754 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:11.663717 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:21:22.348609 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:22.348579 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67b559c486-hsmfq_c9e77b22-8efa-42ef-b6d8-e63513a3a9a5/authorino/0.log" Jul 09 15:21:24.378724 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:24.378691 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hzpgt"] Jul 09 15:21:27.989507 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:27.989481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-zhqqx_7b801295-22e3-4f42-89da-741320bbde9a/copy-manifests/0.log" Jul 09 15:21:28.002734 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:28.002708 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-zhqqx_7b801295-22e3-4f42-89da-741320bbde9a/manager/0.log" Jul 09 15:21:29.356341 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:29.356301 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67b559c486-hsmfq_c9e77b22-8efa-42ef-b6d8-e63513a3a9a5/authorino/0.log" Jul 09 15:21:29.725705 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:29.725681 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cfmb9_ff84225b-caa0-48eb-a847-b5968bfb61ae/kuadrant-console-plugin/0.log" Jul 09 15:21:30.099515 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:30.099432 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hzpgt_5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95/limitador/0.log" Jul 09 15:21:30.956755 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:30.956724 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c698c67c6-pvtbq_57e11bd6-b050-42e7-b16a-2e2813aaf1a1/kube-auth-proxy/0.log" Jul 09 15:21:31.461373 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:31.461320 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68fd675d64-pjh4c_8a6a0729-ee12-44fa-b303-b4b0c1ef0c80/router/0.log" Jul 09 15:21:31.817419 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:31.817390 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-x2vzx_6065fe8a-ca32-40ad-b0d2-bf541e0c12d8/main/0.log" Jul 09 15:21:32.410822 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:32.410798 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qqf4d_6adc3083-5dab-41fc-9693-c38bb6e849c2/main/0.log" Jul 09 15:21:39.358259 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:39.358225 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l4n4r_5d1a3533-eb8d-41e4-8f2d-54654e1ff97f/global-pull-secret-syncer/0.log" Jul 09 15:21:39.549787 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:39.549760 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s55sb_6c366322-4058-4fd0-bda1-5edf4ce439dd/konnectivity-agent/0.log" Jul 09 15:21:39.570763 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:39.570740 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-41.ec2.internal_daf4e3bb9336c51a7b1e768dcaf8ad41/haproxy/0.log" Jul 09 15:21:44.360411 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:44.360370 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67b559c486-hsmfq_c9e77b22-8efa-42ef-b6d8-e63513a3a9a5/authorino/0.log" Jul 09 15:21:44.503867 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:44.503840 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cfmb9_ff84225b-caa0-48eb-a847-b5968bfb61ae/kuadrant-console-plugin/0.log" Jul 09 15:21:44.797088 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:44.797062 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hzpgt_5a3d89c7-4da8-4b3a-9ca7-589ad81e2b95/limitador/0.log" Jul 09 15:21:46.846674 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:46.846646 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-69hrq_61064ba9-7859-407e-a7d3-66023effcadf/kube-state-metrics/0.log" Jul 09 15:21:46.870107 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:46.870077 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-69hrq_61064ba9-7859-407e-a7d3-66023effcadf/kube-rbac-proxy-main/0.log" Jul 09 15:21:46.906955 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:46.906884 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-69hrq_61064ba9-7859-407e-a7d3-66023effcadf/kube-rbac-proxy-self/0.log" Jul 09 15:21:46.945403 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:46.945378 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7689cdf8cf-ncd87_13265cc8-74dd-4533-9fbf-d6b1f4cb2185/metrics-server/0.log" Jul 09 15:21:46.981015 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:46.980989 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-hx54l_8994032b-30ae-402c-93a1-083d5e5b8095/monitoring-plugin/0.log" Jul 09 15:21:47.139442 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.139412 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dzr2_f748e4ae-8cfd-4f46-b208-6e7616a38e4a/node-exporter/0.log" Jul 09 15:21:47.177021 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.176917 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dzr2_f748e4ae-8cfd-4f46-b208-6e7616a38e4a/kube-rbac-proxy/0.log" Jul 09 15:21:47.200635 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.200607 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dzr2_f748e4ae-8cfd-4f46-b208-6e7616a38e4a/init-textfile/0.log" Jul 09 15:21:47.309137 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.309109 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8bsq8_8d09a0e9-277e-45a3-8487-12148ccb09a4/kube-rbac-proxy-main/0.log" Jul 09 15:21:47.330225 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.330202 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8bsq8_8d09a0e9-277e-45a3-8487-12148ccb09a4/kube-rbac-proxy-self/0.log" Jul 09 15:21:47.352455 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.352422 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8bsq8_8d09a0e9-277e-45a3-8487-12148ccb09a4/openshift-state-metrics/0.log" Jul 09 15:21:47.395999 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.395973 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/prometheus/0.log" Jul 09 15:21:47.419506 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.419464 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/config-reloader/0.log" Jul 09 15:21:47.443235 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.443139 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/thanos-sidecar/0.log" Jul 09 15:21:47.465883 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.465849 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/kube-rbac-proxy-web/0.log" Jul 09 15:21:47.487056 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.487032 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/kube-rbac-proxy/0.log" Jul 09 15:21:47.509068 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.509023 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/kube-rbac-proxy-thanos/0.log" Jul 09 15:21:47.533614 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.533561 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6337cba1-d2cb-45e8-95b0-58c7eac3e718/init-config-reloader/0.log" Jul 09 15:21:47.571378 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.571324 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-lzglt_2ec18b87-b73d-4950-9802-66a00482e080/prometheus-operator/0.log" Jul 09 15:21:47.590531 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.590498 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-lzglt_2ec18b87-b73d-4950-9802-66a00482e080/kube-rbac-proxy/0.log" Jul 09 15:21:47.619232 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.619207 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-mntrb_b53c829b-cea9-4875-b753-76be045008b8/prometheus-operator-admission-webhook/0.log" Jul 09 15:21:47.660493 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.660458 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85876f7b4d-tpdnw_d0078578-34b0-47c6-8b7d-9d228eaab428/telemeter-client/0.log" Jul 09 15:21:47.681079 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.681045 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85876f7b4d-tpdnw_d0078578-34b0-47c6-8b7d-9d228eaab428/reload/0.log" Jul 09 15:21:47.702922 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.702841 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85876f7b4d-tpdnw_d0078578-34b0-47c6-8b7d-9d228eaab428/kube-rbac-proxy/0.log" Jul 09 15:21:47.731604 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.731578 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/thanos-query/0.log" Jul 09 15:21:47.756680 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.756652 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/kube-rbac-proxy-web/0.log" Jul 09 15:21:47.779619 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.779582 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/kube-rbac-proxy/0.log" Jul 09 15:21:47.802956 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.802929 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/prom-label-proxy/0.log" Jul 09 15:21:47.827178 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.827139 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/kube-rbac-proxy-rules/0.log" Jul 09 15:21:47.850475 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:47.850442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d7679cb87-x7k97_a49f7692-c4ed-47fe-b550-abb10cb28f51/kube-rbac-proxy-metrics/0.log" Jul 09 15:21:49.527251 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.527217 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw"] Jul 09 15:21:49.527920 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.527686 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" containerName="main" Jul 09 15:21:49.527920 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.527704 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" containerName="main" Jul 09 15:21:49.527920 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.527800 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2024c8c-4ff1-4e49-84ac-18d7e2fd1bcf" containerName="main" Jul 09 15:21:49.531109 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.531088 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.533804 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.533787 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s264d\"/\"openshift-service-ca.crt\"" Jul 09 15:21:49.534842 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.534826 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s264d\"/\"default-dockercfg-pspkd\"" Jul 09 15:21:49.534898 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.534843 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s264d\"/\"kube-root-ca.crt\"" Jul 09 15:21:49.538709 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.538684 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw"] Jul 09 15:21:49.719398 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.719353 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwp2b\" (UniqueName: \"kubernetes.io/projected/369ac8fb-1f20-4949-820e-a1d5356e9e83-kube-api-access-kwp2b\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.719398 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.719402 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-lib-modules\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.719615 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.719463 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-proc\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.719615 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.719495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-podres\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.719615 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.719575 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-sys\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820461 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwp2b\" (UniqueName: \"kubernetes.io/projected/369ac8fb-1f20-4949-820e-a1d5356e9e83-kube-api-access-kwp2b\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820461 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-lib-modules\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-proc\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820599 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-podres\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820629 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-sys\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-lib-modules\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-proc\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.820720 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-podres\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.821001 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.820748 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369ac8fb-1f20-4949-820e-a1d5356e9e83-sys\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.828497 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.828470 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwp2b\" (UniqueName: \"kubernetes.io/projected/369ac8fb-1f20-4949-820e-a1d5356e9e83-kube-api-access-kwp2b\") pod \"perf-node-gather-daemonset-vd2xw\" (UID: \"369ac8fb-1f20-4949-820e-a1d5356e9e83\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.842473 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.842449 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:49.974525 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:49.974501 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw"] Jul 09 15:21:49.976438 ip-10-0-135-41 kubenswrapper[2569]: W0709 15:21:49.976408 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod369ac8fb_1f20_4949_820e_a1d5356e9e83.slice/crio-3b60272c3e3fd0ee5612f537b6a800919791e658086ca03415ea13eb504ed0f7 WatchSource:0}: Error finding container 3b60272c3e3fd0ee5612f537b6a800919791e658086ca03415ea13eb504ed0f7: Status 404 returned error can't find the container with id 3b60272c3e3fd0ee5612f537b6a800919791e658086ca03415ea13eb504ed0f7 Jul 09 15:21:50.157655 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:50.157567 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" event={"ID":"369ac8fb-1f20-4949-820e-a1d5356e9e83","Type":"ContainerStarted","Data":"2cf1a9fec72c925b9d224ba5b22ac33f36edf9642a704c0ca2a3b64ce9e635fb"} Jul 09 15:21:50.157655 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:50.157636 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:50.157850 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:50.157658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" event={"ID":"369ac8fb-1f20-4949-820e-a1d5356e9e83","Type":"ContainerStarted","Data":"3b60272c3e3fd0ee5612f537b6a800919791e658086ca03415ea13eb504ed0f7"} Jul 09 15:21:50.174563 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:50.174511 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" podStartSLOduration=1.17449775 podStartE2EDuration="1.17449775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:21:50.173853682 +0000 UTC m=+2510.875474130" watchObservedRunningTime="2026-07-09 15:21:50.17449775 +0000 UTC m=+2510.876118196" Jul 09 15:21:51.593714 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:51.593660 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8cjcn_97be1e53-860f-4ece-81af-b06c64fdbb42/dns/0.log" Jul 09 15:21:51.614946 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:51.614924 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8cjcn_97be1e53-860f-4ece-81af-b06c64fdbb42/kube-rbac-proxy/0.log" Jul 09 15:21:51.765667 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:51.765631 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7xxx_454445ef-0672-4b55-b7b4-ccc1e90eba18/dns-node-resolver/0.log" Jul 09 15:21:52.336713 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:52.336684 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lgg82_b80bf0cc-0978-41b7-bf1b-7a620ea31f44/node-ca/0.log" Jul 09 15:21:53.413294 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:53.413263 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c698c67c6-pvtbq_57e11bd6-b050-42e7-b16a-2e2813aaf1a1/kube-auth-proxy/0.log" Jul 09 15:21:53.595398 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:53.595366 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68fd675d64-pjh4c_8a6a0729-ee12-44fa-b303-b4b0c1ef0c80/router/0.log" Jul 09 15:21:54.346914 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:54.346877 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lk5mg_9a5e95c4-facf-4527-a862-c640b448ce6b/serve-healthcheck-canary/0.log" Jul 09 15:21:55.026758 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:55.026711 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-gsklc_c82abea7-baca-4366-93e1-d1e8e47344f9/insights-operator/0.log" Jul 09 15:21:55.028427 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:55.028409 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-gsklc_c82abea7-baca-4366-93e1-d1e8e47344f9/insights-operator/1.log" Jul 09 15:21:55.190448 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:55.190422 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xsc4k_119a6b27-bb75-46b5-851c-914066b83d51/kube-rbac-proxy/0.log" Jul 09 15:21:55.216424 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:55.216395 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xsc4k_119a6b27-bb75-46b5-851c-914066b83d51/exporter/0.log" Jul 09 15:21:55.237768 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:55.237742 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xsc4k_119a6b27-bb75-46b5-851c-914066b83d51/extractor/0.log" Jul 09 15:21:56.172397 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:56.172371 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-vd2xw" Jul 09 15:21:57.897726 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:57.897687 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-zhqqx_7b801295-22e3-4f42-89da-741320bbde9a/manager/0.log" Jul 09 15:21:57.916339 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:57.916312 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-zhqqx_7b801295-22e3-4f42-89da-741320bbde9a/copy-manifests/0.log" Jul 09 15:21:59.260198 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:59.260172 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c698c67c6-pvtbq_57e11bd6-b050-42e7-b16a-2e2813aaf1a1/kube-auth-proxy/0.log" Jul 09 15:21:59.286757 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:59.286719 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-756d646c97-9mnrx_12c75c48-a417-4da0-bd4a-da52b93b2813/manager/0.log" Jul 09 15:21:59.415378 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:21:59.415354 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68fd675d64-pjh4c_8a6a0729-ee12-44fa-b303-b4b0c1ef0c80/router/0.log" Jul 09 15:22:00.731673 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:00.731640 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c698c67c6-pvtbq_57e11bd6-b050-42e7-b16a-2e2813aaf1a1/kube-auth-proxy/0.log" Jul 09 15:22:00.885303 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:00.885270 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68fd675d64-pjh4c_8a6a0729-ee12-44fa-b303-b4b0c1ef0c80/router/0.log" Jul 09 15:22:04.551430 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:04.551387 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-n6dfc_2222f119-3213-4aeb-a13b-b0acbae9a1d1/kube-storage-version-migrator-operator/1.log" Jul 09 15:22:04.552207 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:04.552187 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-n6dfc_2222f119-3213-4aeb-a13b-b0acbae9a1d1/kube-storage-version-migrator-operator/0.log" Jul 09 15:22:05.454350 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.454297 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/kube-multus-additional-cni-plugins/0.log" Jul 09 15:22:05.475426 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.475402 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/egress-router-binary-copy/0.log" Jul 09 15:22:05.497782 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.497757 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/cni-plugins/0.log" Jul 09 15:22:05.519305 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.519277 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/bond-cni-plugin/0.log" Jul 09 15:22:05.540775 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.540750 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/routeoverride-cni/0.log" Jul 09 15:22:05.562115 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.562089 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/whereabouts-cni-bincopy/0.log" Jul 09 15:22:05.583183 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.583162 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59v8j_adf8b128-91ac-4ba2-9a4c-ada8c492c327/whereabouts-cni/0.log" Jul 09 15:22:05.921114 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:05.921070 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gfclj_50960eb3-25d0-42ee-b719-a4463f7bc070/kube-multus/0.log" Jul 09 15:22:06.091750 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:06.091722 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xqjx7_38445a72-385b-405f-a40f-6f6ba0884485/network-metrics-daemon/0.log" Jul 09 15:22:06.111840 ip-10-0-135-41 kubenswrapper[2569]: I0709 15:22:06.111812 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xqjx7_38445a72-385b-405f-a40f-6f6ba0884485/kube-rbac-proxy/0.log"