Sep 13 20:12:58.043113 ip-10-0-140-25 systemd[1]: Starting Kubernetes Kubelet... Sep 13 20:12:58.405821 ip-10-0-140-25 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:58.405821 ip-10-0-140-25 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 13 20:12:58.405821 ip-10-0-140-25 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:58.405821 ip-10-0-140-25 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 13 20:12:58.405821 ip-10-0-140-25 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:58.408602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.408512 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 13 20:12:58.411976 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411950 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.411976 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411977 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.411976 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411981 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.411976 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411984 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411988 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411991 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411993 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.411996 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412000 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412002 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412005 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412008 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412012 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412016 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412019 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412022 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412025 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412029 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412032 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412043 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412046 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412049 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.412098 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412052 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412055 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412058 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412061 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412063 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412066 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412069 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412071 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412074 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412076 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412079 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412082 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412085 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412087 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412090 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412092 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412095 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412098 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412101 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412104 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.412590 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412106 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412109 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412112 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412115 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412117 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412120 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412123 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412126 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412128 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412131 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412133 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412136 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412138 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412141 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412144 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412147 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412150 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412153 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412156 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412158 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.413092 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412161 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412163 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412166 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412170 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412173 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412175 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412178 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412182 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412184 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412189 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412191 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412195 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412198 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412202 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412205 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412208 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412211 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412214 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412216 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.413577 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412219 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412222 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412225 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412228 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412231 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412233 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412236 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412240 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412242 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412245 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412247 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412250 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412252 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412255 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412258 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412261 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412263 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412266 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412954 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412961 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.414157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412965 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412968 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412971 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412974 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412977 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412979 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412983 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412985 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412988 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412990 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412993 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412996 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.412998 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413001 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413003 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413006 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413008 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413011 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413014 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413016 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.414641 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413019 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413022 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413024 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413029 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413032 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413035 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413038 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413041 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413044 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413046 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413049 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413053 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413055 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413059 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413063 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413066 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413070 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413073 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413076 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.415211 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413078 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413081 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413083 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413086 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413088 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413091 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413093 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413096 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413100 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413103 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413105 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413108 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413110 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413113 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413116 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413118 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413121 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413124 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413126 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413129 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.415677 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413133 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413135 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413138 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413140 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413143 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413146 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413149 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413151 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413154 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413156 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413159 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413162 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413164 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413167 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413169 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413171 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413174 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413176 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413179 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413181 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.416186 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413184 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413186 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413189 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413191 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413194 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413197 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413201 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413205 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413207 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413210 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413213 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413216 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413219 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413222 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413225 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413228 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413231 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413233 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413600 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.416679 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413605 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413608 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413611 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413614 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413617 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413620 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413623 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413626 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413628 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413633 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413636 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413640 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413642 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413645 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413648 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413651 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413653 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413656 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413658 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413661 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.417157 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413663 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413666 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413669 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413671 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413674 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413677 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413680 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413683 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413686 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413689 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413691 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413694 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413696 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413699 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413704 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413706 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413709 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413714 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413718 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.417652 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413721 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413724 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413727 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413729 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413732 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413735 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413737 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413740 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413742 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413745 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413747 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413750 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413752 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413755 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413757 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413760 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413763 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413766 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413768 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413771 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.418161 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413774 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413776 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413779 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413781 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413797 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413800 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413803 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413807 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413809 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413812 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413815 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413818 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413820 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413823 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413826 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413828 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413831 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413833 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413836 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413839 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.418655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413841 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413844 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413846 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413849 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413852 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413855 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413857 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413860 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413863 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413867 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413869 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413872 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413875 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413878 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413880 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413883 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413886 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413889 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.413893 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.413978 2552 flags.go:64] FLAG: --address="0.0.0.0" Sep 13 20:12:58.419164 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414021 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414029 2552 flags.go:64] FLAG: --anonymous-auth="true" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414034 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414040 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414043 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414052 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414057 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414061 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414064 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414067 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414071 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414074 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414077 2552 flags.go:64] FLAG: --cgroup-root="" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414080 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414083 2552 flags.go:64] FLAG: --client-ca-file="" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414086 2552 flags.go:64] FLAG: --cloud-provider="external" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414089 2552 flags.go:64] FLAG: --cluster-dns="[]" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414094 2552 flags.go:64] FLAG: --cluster-domain="" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414097 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414100 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414103 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414108 2552 flags.go:64] FLAG: --container-log-max-files="5" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414112 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 13 20:12:58.419655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414115 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414118 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414122 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414125 2552 flags.go:64] FLAG: --contention-profiling="false" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414128 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414131 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414134 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414137 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414143 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414146 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414148 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414151 2552 flags.go:64] FLAG: --enable-load-reader="false" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414154 2552 flags.go:64] FLAG: --enable-server="true" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414158 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414163 2552 flags.go:64] FLAG: --event-burst="100" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414167 2552 flags.go:64] FLAG: --event-qps="50" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414170 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414173 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414176 2552 flags.go:64] FLAG: --eviction-hard="" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414180 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414183 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414186 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414189 2552 flags.go:64] FLAG: --eviction-soft="" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414192 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414195 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 13 20:12:58.420274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414198 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414201 2552 flags.go:64] FLAG: --experimental-mounter-path="" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414204 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414206 2552 flags.go:64] FLAG: --fail-swap-on="true" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414209 2552 flags.go:64] FLAG: --feature-gates="" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414215 2552 flags.go:64] FLAG: --file-check-frequency="20s" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414219 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414222 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414225 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414228 2552 flags.go:64] FLAG: --healthz-port="10248" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414231 2552 flags.go:64] FLAG: --help="false" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414234 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414237 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414240 2552 flags.go:64] FLAG: --http-check-frequency="20s" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414243 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414248 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414251 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414254 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414257 2552 flags.go:64] FLAG: --image-service-endpoint="" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414260 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414263 2552 flags.go:64] FLAG: --kube-api-burst="100" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414273 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414276 2552 flags.go:64] FLAG: --kube-api-qps="50" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414279 2552 flags.go:64] FLAG: --kube-reserved="" Sep 13 20:12:58.420941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414282 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414285 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414288 2552 flags.go:64] FLAG: --kubelet-cgroups="" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414291 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414294 2552 flags.go:64] FLAG: --lock-file="" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414297 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414300 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414303 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414312 2552 flags.go:64] FLAG: --log-json-split-stream="false" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414316 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414318 2552 flags.go:64] FLAG: --log-text-split-stream="false" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414321 2552 flags.go:64] FLAG: --logging-format="text" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414324 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414329 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414332 2552 flags.go:64] FLAG: --manifest-url="" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414335 2552 flags.go:64] FLAG: --manifest-url-header="" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414340 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414343 2552 flags.go:64] FLAG: --max-open-files="1000000" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414347 2552 flags.go:64] FLAG: --max-pods="110" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414350 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414353 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414356 2552 flags.go:64] FLAG: --memory-manager-policy="None" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414359 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414364 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414367 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 13 20:12:58.421543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414370 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414376 2552 flags.go:64] FLAG: --node-status-max-images="50" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414379 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414382 2552 flags.go:64] FLAG: --oom-score-adj="-999" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414385 2552 flags.go:64] FLAG: --pod-cidr="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414389 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414395 2552 flags.go:64] FLAG: --pod-manifest-path="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414397 2552 flags.go:64] FLAG: --pod-max-pids="-1" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414401 2552 flags.go:64] FLAG: --pods-per-core="0" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414404 2552 flags.go:64] FLAG: --port="10250" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414407 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414410 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ec3f9e8e1aee45b" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414413 2552 flags.go:64] FLAG: --qos-reserved="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414416 2552 flags.go:64] FLAG: --read-only-port="10255" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414419 2552 flags.go:64] FLAG: --register-node="true" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414422 2552 flags.go:64] FLAG: --register-with-taints="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414425 2552 flags.go:64] FLAG: --registry-burst="10" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414428 2552 flags.go:64] FLAG: --registry-qps="5" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414431 2552 flags.go:64] FLAG: --reserved-cpus="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414434 2552 flags.go:64] FLAG: --reserved-memory="" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414437 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414442 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414445 2552 flags.go:64] FLAG: --rotate-certificates="false" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414448 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414452 2552 flags.go:64] FLAG: --runonce="false" Sep 13 20:12:58.422188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414455 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414458 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414461 2552 flags.go:64] FLAG: --seccomp-default="false" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414464 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414467 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414471 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414475 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414478 2552 flags.go:64] FLAG: --storage-driver-password="root" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414481 2552 flags.go:64] FLAG: --storage-driver-secure="false" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414484 2552 flags.go:64] FLAG: --storage-driver-table="stats" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414487 2552 flags.go:64] FLAG: --storage-driver-user="root" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414490 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414493 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414497 2552 flags.go:64] FLAG: --system-cgroups="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414499 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414505 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414508 2552 flags.go:64] FLAG: --tls-cert-file="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414511 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414515 2552 flags.go:64] FLAG: --tls-min-version="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414518 2552 flags.go:64] FLAG: --tls-private-key-file="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414521 2552 flags.go:64] FLAG: --topology-manager-policy="none" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414524 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414527 2552 flags.go:64] FLAG: --topology-manager-scope="container" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414530 2552 flags.go:64] FLAG: --v="2" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414534 2552 flags.go:64] FLAG: --version="false" Sep 13 20:12:58.422816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414538 2552 flags.go:64] FLAG: --vmodule="" Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414541 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.414545 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414710 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414715 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414719 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414722 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414726 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414730 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414733 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414736 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414739 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414743 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414745 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414748 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414750 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414753 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414755 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414758 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414761 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.423446 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414763 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414766 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414769 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414772 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414774 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414777 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414779 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414783 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414800 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414803 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414807 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414810 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414813 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414816 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414819 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414823 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414826 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414829 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414832 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.423955 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414835 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414840 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414842 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414845 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414848 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414850 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414853 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414856 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414858 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414861 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414863 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414866 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414869 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414871 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414874 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414877 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414880 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414883 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414892 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414896 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.424464 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414898 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414901 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414904 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414906 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414909 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414911 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414914 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414917 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414921 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414923 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414926 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414928 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414931 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414934 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414936 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414939 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414942 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414944 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414947 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.424986 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414949 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414952 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414954 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414957 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414959 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414962 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414964 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414967 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414969 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414973 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414975 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414978 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414981 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414983 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414985 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414988 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414991 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414993 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414996 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.414998 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.425452 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.415001 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.415005 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.415008 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.415011 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.415016 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.421605 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.421621 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.421640 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.421646 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421701 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421706 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421709 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421712 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421715 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421718 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.425975 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421721 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421725 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421728 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421731 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421734 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421738 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421743 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421746 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421749 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421752 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421755 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421758 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421761 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421764 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421766 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421769 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421772 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421775 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421777 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.426362 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421780 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421783 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421800 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421803 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421808 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421811 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421814 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421816 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421819 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421822 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421824 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421827 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421830 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421832 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421835 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421838 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421841 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421845 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421849 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421851 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.426841 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421854 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421857 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421860 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421862 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421865 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421867 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421870 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421872 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421875 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421877 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421880 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421882 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421885 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421888 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421891 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421895 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421898 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421901 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421905 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421908 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.427350 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421911 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421914 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421916 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421919 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421922 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421924 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421927 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421930 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421932 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421935 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421937 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421940 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421942 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421945 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421948 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421951 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421953 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421956 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421958 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.427941 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421961 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421963 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421966 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421969 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421971 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421974 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421977 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421979 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421982 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421985 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421987 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421990 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421993 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421996 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.428615 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.421998 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.422003 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422122 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422132 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422135 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422138 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422141 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422144 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422147 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422149 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422152 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422154 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422157 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422159 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:58.429165 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422162 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422165 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422167 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422169 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422172 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422174 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422177 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422179 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422182 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422184 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422187 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422190 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422193 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422196 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422198 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422201 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422204 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422207 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422210 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422213 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:58.429517 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422215 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422218 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422221 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422223 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422225 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422229 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422233 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422236 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422239 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422242 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422246 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422250 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422252 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422255 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422258 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422260 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422262 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422266 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:58.430040 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422269 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422272 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422275 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422278 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422281 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422284 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422287 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422290 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422292 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422295 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422297 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422300 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422303 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422305 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422308 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422310 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422313 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422315 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422318 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422320 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:58.430485 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422323 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422325 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422328 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422333 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422336 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422338 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422341 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422343 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422346 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422349 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422352 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422354 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422356 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422359 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422361 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422364 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422367 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422369 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422372 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422375 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:58.431007 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422377 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422380 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422382 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422384 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422387 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422390 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422393 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422395 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:12:58.422398 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.422403 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.422502 2552 server.go:962] "Client rotation is on, will bootstrap in background" Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.424362 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.425180 2552 server.go:1019] "Starting client certificate rotation" Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.425279 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 20:12:58.431529 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.425345 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 20:12:58.431939 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.428985 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 20:12:58.431939 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.431207 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 20:12:58.442476 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.442439 2552 log.go:25] "Validated CRI v1 runtime API" Sep 13 20:12:58.446884 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.446869 2552 log.go:25] "Validated CRI v1 image API" Sep 13 20:12:58.447674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.447657 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 13 20:12:58.450383 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.450355 2552 fs.go:135] Filesystem UUIDs: map[289a27ad-efca-48b7-a235-389d2e963f54:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d1480eeb-b14d-40a1-86b3-29efa8588b25:/dev/nvme0n1p3] Sep 13 20:12:58.450456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.450381 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 13 20:12:58.455890 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.455874 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 20:12:58.456381 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.456273 2552 manager.go:216] Machine: {Timestamp:2026-09-13 20:12:58.454927029 +0000 UTC m=+0.301460901 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100344 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26961818db6aa38a940068efa9e42b SystemUUID:ec269618-18db-6aa3-8a94-0068efa9e42b BootID:5fb65c75-308f-4b8c-b88b-6ae73ba3f533 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cf:0f:fa:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cf:0f:fa:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:61:3c:7e:41:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 13 20:12:58.456381 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.456377 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 13 20:12:58.456472 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.456461 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 13 20:12:58.459496 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.459473 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 13 20:12:58.459644 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.459499 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 13 20:12:58.460133 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.460124 2552 topology_manager.go:138] "Creating topology manager with none policy" Sep 13 20:12:58.460177 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.460136 2552 container_manager_linux.go:309] "Creating device plugin manager" Sep 13 20:12:58.460177 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.460143 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 20:12:58.460683 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.460674 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 20:12:58.461344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.461335 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 13 20:12:58.464782 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464771 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 13 20:12:58.464909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464899 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 13 20:12:58.464951 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464929 2552 kubelet.go:486] "Attempting to sync node with API server" Sep 13 20:12:58.464951 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464942 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 13 20:12:58.465013 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464958 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 13 20:12:58.465013 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464967 2552 kubelet.go:398] "Adding apiserver pod source" Sep 13 20:12:58.465013 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.464977 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 13 20:12:58.465417 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.465402 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 20:12:58.465417 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.465421 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 20:12:58.467319 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.467303 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 13 20:12:58.468836 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.468820 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 13 20:12:58.468894 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.468852 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 13 20:12:58.470067 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470053 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 13 20:12:58.470110 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470076 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 13 20:12:58.470110 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470082 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 13 20:12:58.470110 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470087 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 13 20:12:58.470110 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470096 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 13 20:12:58.470110 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470102 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470115 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470120 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470127 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470132 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470146 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 13 20:12:58.470264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.470151 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 13 20:12:58.471438 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.471427 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 13 20:12:58.471438 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.471438 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 13 20:12:58.475885 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.475766 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 13 20:12:58.475983 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.475931 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 13 20:12:58.476043 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.475990 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 13 20:12:58.476450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.476427 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 13 20:12:58.476744 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.476719 2552 server.go:1268] "Started kubelet" Sep 13 20:12:58.476836 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.476769 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ntxks" Sep 13 20:12:58.476899 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.476862 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 13 20:12:58.477430 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.477398 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 13 20:12:58.477530 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.477514 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 13 20:12:58.477912 ip-10-0-140-25 systemd[1]: Started Kubernetes Kubelet. Sep 13 20:12:58.480140 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.480121 2552 server.go:310] "Adding debug handlers to kubelet server" Sep 13 20:12:58.481565 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.481531 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 13 20:12:58.483837 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.483819 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 13 20:12:58.484344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484330 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 13 20:12:58.484525 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.484467 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.484901 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484884 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 13 20:12:58.484901 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484883 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 13 20:12:58.485031 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484909 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 13 20:12:58.485031 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484971 2552 reconstruct.go:97] "Volume reconstruction finished" Sep 13 20:12:58.485031 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.484979 2552 reconciler.go:29] "Reconciler: start to sync state" Sep 13 20:12:58.485408 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485395 2552 factory.go:153] Registering CRI-O factory Sep 13 20:12:58.485450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485414 2552 factory.go:223] Registration of the crio container factory successfully Sep 13 20:12:58.485479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485457 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 13 20:12:58.485479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485464 2552 factory.go:55] Registering systemd factory Sep 13 20:12:58.485479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485471 2552 factory.go:223] Registration of the systemd container factory successfully Sep 13 20:12:58.485630 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485493 2552 factory.go:103] Registering Raw factory Sep 13 20:12:58.485630 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485508 2552 manager.go:1196] Started watching for new ooms in manager Sep 13 20:12:58.485916 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.485902 2552 manager.go:349] Starting recovery of all containers Sep 13 20:12:58.486467 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.486450 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ntxks" Sep 13 20:12:58.486660 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.485746 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-25.ec2.internal.18d4fa7fbadb3efe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-25.ec2.internal,UID:ip-10-0-140-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-25.ec2.internal,},FirstTimestamp:2026-09-13 20:12:58.475650814 +0000 UTC m=+0.322184690,LastTimestamp:2026-09-13 20:12:58.475650814 +0000 UTC m=+0.322184690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-25.ec2.internal,}" Sep 13 20:12:58.490155 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.490128 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 13 20:12:58.490347 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.490314 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 13 20:12:58.498612 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.498450 2552 manager.go:354] Recovery completed Sep 13 20:12:58.504495 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.504478 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.506826 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.506806 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.506909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.506838 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.506909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.506849 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.507463 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.507451 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 13 20:12:58.507517 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.507463 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 13 20:12:58.507517 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.507482 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 13 20:12:58.507517 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.507501 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.508240 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.508227 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.508310 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.508250 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.508310 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.508260 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.509463 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.509450 2552 policy_none.go:49] "None policy: Start" Sep 13 20:12:58.509497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.509467 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 13 20:12:58.509497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.509477 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 13 20:12:58.511501 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.511489 2552 policy_none.go:47] "Start" Sep 13 20:12:58.546339 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546322 2552 manager.go:337] "Starting Device Plugin manager" Sep 13 20:12:58.546435 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.546364 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 13 20:12:58.546435 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546377 2552 server.go:87] "Starting device plugin registration server" Sep 13 20:12:58.546725 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546714 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 13 20:12:58.546762 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546728 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 13 20:12:58.546880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546865 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 13 20:12:58.546980 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546964 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 13 20:12:58.546980 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.546978 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 13 20:12:58.547531 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.547512 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 13 20:12:58.547590 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.547556 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.566698 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.566673 2552 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2583 into the system container \"/system.slice\": " Sep 13 20:12:58.647782 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.647738 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.650748 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.650732 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.650857 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.650761 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.650857 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.650776 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.650857 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.650824 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.656488 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.656416 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.656488 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.656443 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-25.ec2.internal\": node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.670056 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.670036 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.736328 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.736297 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 13 20:12:58.737575 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.737553 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 13 20:12:58.737705 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.737601 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 13 20:12:58.737705 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.737621 2552 kubelet.go:2448] "Starting kubelet main sync loop" Sep 13 20:12:58.737705 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.737655 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 13 20:12:58.740042 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.740024 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:58.771064 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.771043 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.838469 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.838440 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal"] Sep 13 20:12:58.838562 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.838522 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.840166 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.840151 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.840266 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.840178 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.840266 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.840194 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.842400 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.842388 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.842520 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.842505 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.842569 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.842537 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.843138 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843123 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.843237 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843146 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.843237 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843155 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.843237 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843125 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.843237 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843223 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.843237 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.843235 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.845415 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.845400 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.845498 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.845429 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:58.846060 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.846043 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:58.846152 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.846072 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:58.846152 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.846089 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:58.868445 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.868429 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-25.ec2.internal\" not found" node="ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.871110 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.871093 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.872933 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.872917 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-25.ec2.internal\" not found" node="ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.886499 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.886481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.886598 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.886505 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.886598 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.886522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc52f9b4ca129427164928f70b41a169-config\") pod \"kube-apiserver-proxy-ip-10-0-140-25.ec2.internal\" (UID: \"fc52f9b4ca129427164928f70b41a169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.971364 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:58.971285 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:12:58.987659 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc52f9b4ca129427164928f70b41a169-config\") pod \"kube-apiserver-proxy-ip-10-0-140-25.ec2.internal\" (UID: \"fc52f9b4ca129427164928f70b41a169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.987770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.987770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987697 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.987770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987752 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.987770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987759 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd2e6b34f461fb3d2a4e4760c512a949-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal\" (UID: \"cd2e6b34f461fb3d2a4e4760c512a949\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:12:58.987770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:12:58.987766 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc52f9b4ca129427164928f70b41a169-config\") pod \"kube-apiserver-proxy-ip-10-0-140-25.ec2.internal\" (UID: \"fc52f9b4ca129427164928f70b41a169\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:12:59.071850 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:12:59.071805 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:13:00.959758 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:00.959714 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:13:00.961871 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:00.961853 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:13:00.965358 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:00.965342 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:13:01.062451 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.062359 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:13:01.162902 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.162860 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-25.ec2.internal\" not found" Sep 13 20:13:01.214373 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.214341 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 13 20:13:01.214797 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.214497 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 20:13:01.229453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.229430 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:13:01.255007 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.254983 2552 apiserver.go:52] "Watching apiserver" Sep 13 20:13:01.263600 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.263526 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 13 20:13:01.264846 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.264816 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8h2zm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6","openshift-cluster-node-tuning-operator/tuned-xdbfj","openshift-multus/network-metrics-daemon-cl629","openshift-network-diagnostics/network-check-target-65vst","openshift-network-operator/iptables-alerter-hgmlr","kube-system/global-pull-secret-syncer-b5l5x","openshift-dns/node-resolver-txg5f","openshift-image-registry/node-ca-55hxr","openshift-multus/multus-8dgpt","openshift-multus/multus-additional-cni-plugins-rdzf4","openshift-ovn-kubernetes/ovnkube-node-jgmk9"] Sep 13 20:13:01.267392 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.267375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.269261 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.269239 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 13 20:13:01.269375 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.269282 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-twtks\"" Sep 13 20:13:01.269375 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.269303 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 13 20:13:01.269574 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.269556 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.271150 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.271132 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 13 20:13:01.271433 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.271418 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.271512 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.271493 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.271575 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.271520 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvcxw\"" Sep 13 20:13:01.271631 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.271587 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.273355 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273340 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 13 20:13:01.273494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273482 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rlbhp\"" Sep 13 20:13:01.273710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273693 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.273778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273693 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.273778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273771 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.273881 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.273831 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:01.273977 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.273955 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" Sep 13 20:13:01.275879 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.275863 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:01.275965 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.275921 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:01.277985 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.277969 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.279964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.279947 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.279964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.279962 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.280095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280021 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5mkw8\"" Sep 13 20:13:01.280095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.279947 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 13 20:13:01.280095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280047 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-12 20:08:00 +0000 UTC" deadline="2028-04-30 04:41:56.094618148 +0000 UTC" Sep 13 20:13:01.280095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280092 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14264h28m54.814529851s" Sep 13 20:13:01.280300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280099 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.280300 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.280155 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:01.280300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-host\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280287 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-tuned\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280364 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hvg\" (UniqueName: \"kubernetes.io/projected/8d579d23-826f-42e1-bdce-8bcc78ce62dd-kube-api-access-59hvg\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222bcd42-3864-4319-a437-f2981088b13d-agent-certs\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysconfig\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280423 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:01.280453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280441 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-sys-fs\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-sys\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-var-lib-kubelet\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-kubernetes\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-conf\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280546 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-systemd\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280561 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-tmp\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280580 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6jx\" (UniqueName: \"kubernetes.io/projected/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kube-api-access-6v6jx\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280598 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-lib-modules\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kpr\" (UniqueName: \"kubernetes.io/projected/efd1795b-18ac-451e-bf5d-2b10ed811c9e-kube-api-access-b8kpr\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-device-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280648 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-modprobe-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-run\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280675 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-socket-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.280937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.280937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222bcd42-3864-4319-a437-f2981088b13d-konnectivity-ca\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.280937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.280737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-registration-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.282284 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.282267 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.284009 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.283996 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.284119 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.284107 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgr8f\"" Sep 13 20:13:01.284170 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.284154 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.284446 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.284433 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.286228 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.286205 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 20:13:01.286320 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.286277 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" Sep 13 20:13:01.286369 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.286353 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 13 20:13:01.286641 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.286610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.286855 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.286797 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.287244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.287030 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4q8xq\"" Sep 13 20:13:01.287459 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.287446 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.288864 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.288927 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.289370 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.289371 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.289434 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.289461 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p7tpt\"" Sep 13 20:13:01.290611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.289473 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.291676 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.291654 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 13 20:13:01.291792 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.291756 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 13 20:13:01.291881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.291865 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9hhzd\"" Sep 13 20:13:01.292629 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.292609 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal"] Sep 13 20:13:01.292714 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.292700 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.292928 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.292912 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal"] Sep 13 20:13:01.293008 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.292989 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 20:13:01.296082 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296068 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 13 20:13:01.296406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296394 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 13 20:13:01.296453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296422 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 13 20:13:01.296492 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296426 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 13 20:13:01.296720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296707 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 13 20:13:01.296779 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296727 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 13 20:13:01.296869 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.296859 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6zk24\"" Sep 13 20:13:01.307127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.307110 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hnc9" Sep 13 20:13:01.314368 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.314323 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hnc9" Sep 13 20:13:01.375918 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.375899 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 13 20:13:01.381361 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-kubelet\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.381460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381377 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hvg\" (UniqueName: \"kubernetes.io/projected/8d579d23-826f-42e1-bdce-8bcc78ce62dd-kube-api-access-59hvg\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.381460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spfbp\" (UniqueName: \"kubernetes.io/projected/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-kube-api-access-spfbp\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.381561 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysconfig\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.381561 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381539 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-sys-fs\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.381664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381563 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-kubelet-config\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.381664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-systemd-units\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.381664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381620 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysconfig\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.381664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381644 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.381664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381652 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-sys-fs\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-sys\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-var-lib-kubelet\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ebeedaf-987e-4115-bd68-a91831c60851-hosts-file\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381734 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-sys\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381740 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-cnibin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.381909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.381795 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-var-lib-kubelet\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382275 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382260 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-env-overrides\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.382341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-conf\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382437 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382342 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-systemd\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382437 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382365 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-systemd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382437 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382437 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382400 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-systemd\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382437 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382417 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-log-socket\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382459 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-conf\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382491 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cnibin\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-lib-modules\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382539 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-device-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-socket-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382595 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-device-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-var-lib-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382623 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-ovn\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382625 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-lib-modules\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.382666 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382664 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382717 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-registration-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382735 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382781 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382780 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-k8s-cni-cncf-io\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382810 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-hostroot\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382824 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-conf-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382839 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-etc-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382784 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-registration-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-host\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382887 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-host\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-tuned\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-dbus\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-node-log\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.383039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382979 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqn2\" (UniqueName: \"kubernetes.io/projected/9a19bd69-fd59-4e29-b790-c0c1d55091cc-kube-api-access-pjqn2\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.382996 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383013 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222bcd42-3864-4319-a437-f2981088b13d-agent-certs\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.383085 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383103 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-cni-binary-copy\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-netd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.383172 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:01.883151391 +0000 UTC m=+1.940259151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-script-lib\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-multus\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64t9\" (UniqueName: \"kubernetes.io/projected/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-kube-api-access-p64t9\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-host\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebeedaf-987e-4115-bd68-a91831c60851-tmp-dir\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-serviceca\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.383789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-system-cni-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383454 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-kubernetes\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-tmp\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383482 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6jx\" (UniqueName: \"kubernetes.io/projected/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kube-api-access-6v6jx\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383507 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgvl4\" (UniqueName: \"kubernetes.io/projected/2ebeedaf-987e-4115-bd68-a91831c60851-kube-api-access-fgvl4\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-bin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383548 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-etc-kubernetes\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-netns\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383592 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-bin\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383594 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-kubernetes\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kpr\" (UniqueName: \"kubernetes.io/projected/efd1795b-18ac-451e-bf5d-2b10ed811c9e-kube-api-access-b8kpr\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-kubelet\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-config\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-iptables-alerter-script\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-modprobe-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383735 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-run\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383750 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-socket-dir\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.384406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383749 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383786 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-netns\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383801 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-modprobe-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383807 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-run\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383807 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-multus-daemon-config\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383843 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-multus-certs\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383874 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpw5t\" (UniqueName: \"kubernetes.io/projected/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-kube-api-access-jpw5t\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383908 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383929 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222bcd42-3864-4319-a437-f2981088b13d-konnectivity-ca\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhq5p\" (UniqueName: \"kubernetes.io/projected/62de7027-443f-4614-bf0a-b253fbef2177-kube-api-access-nhq5p\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.383987 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-host-slash\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.384006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-slash\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.384024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-system-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.384047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-socket-dir-parent\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.384079 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-sysctl-d\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.384881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.384397 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/222bcd42-3864-4319-a437-f2981088b13d-konnectivity-ca\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.386882 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.386841 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-tmp\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.387021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.386994 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/efd1795b-18ac-451e-bf5d-2b10ed811c9e-etc-tuned\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.387509 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.387490 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/222bcd42-3864-4319-a437-f2981088b13d-agent-certs\") pod \"konnectivity-agent-8h2zm\" (UID: \"222bcd42-3864-4319-a437-f2981088b13d\") " pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.387950 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.387927 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hvg\" (UniqueName: \"kubernetes.io/projected/8d579d23-826f-42e1-bdce-8bcc78ce62dd-kube-api-access-59hvg\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.393414 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.393397 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:01.393414 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.393416 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:01.393559 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.393425 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:01.393559 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.393467 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:01.893454581 +0000 UTC m=+1.950562333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:01.396678 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.396657 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kpr\" (UniqueName: \"kubernetes.io/projected/efd1795b-18ac-451e-bf5d-2b10ed811c9e-kube-api-access-b8kpr\") pod \"tuned-xdbfj\" (UID: \"efd1795b-18ac-451e-bf5d-2b10ed811c9e\") " pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.397607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.397584 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6jx\" (UniqueName: \"kubernetes.io/projected/eaa362f2-bbdf-4854-ac9d-37ecfd72a383-kube-api-access-6v6jx\") pod \"aws-ebs-csi-driver-node-2qdb6\" (UID: \"eaa362f2-bbdf-4854-ac9d-37ecfd72a383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.484643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-kubelet-config\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.484643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-systemd-units\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ebeedaf-987e-4115-bd68-a91831c60851-hosts-file\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-cnibin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484707 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-env-overrides\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-systemd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484739 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-systemd-units\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484756 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484739 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-kubelet-config\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484775 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ebeedaf-987e-4115-bd68-a91831c60851-hosts-file\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484784 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-cnibin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484804 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484807 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484843 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-systemd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-log-socket\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484896 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.484937 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cnibin\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484956 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-var-lib-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484961 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cnibin\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484981 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-ovn\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485004 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-var-lib-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484930 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485006 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485024 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-run-ovn\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.484899 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-log-socket\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485052 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-k8s-cni-cncf-io\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-hostroot\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485128 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-conf-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485154 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-etc-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485163 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-k8s-cni-cncf-io\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485168 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-hostroot\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-dbus\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485196 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-conf-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.485757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-node-log\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485245 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-etc-openvswitch\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485253 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqn2\" (UniqueName: \"kubernetes.io/projected/9a19bd69-fd59-4e29-b790-c0c1d55091cc-kube-api-access-pjqn2\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485272 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-dbus\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-cni-binary-copy\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485287 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-node-log\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485302 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-netd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485327 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-script-lib\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485322 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-env-overrides\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485339 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485367 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-netd\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485405 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-multus\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485478 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64t9\" (UniqueName: \"kubernetes.io/projected/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-kube-api-access-p64t9\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-host\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485529 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485534 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-multus\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.486587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485552 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebeedaf-987e-4115-bd68-a91831c60851-tmp-dir\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485584 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.485631 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.485698 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:01.985681418 +0000 UTC m=+2.042789183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485699 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-serviceca\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-system-cni-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485819 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgvl4\" (UniqueName: \"kubernetes.io/projected/2ebeedaf-987e-4115-bd68-a91831c60851-kube-api-access-fgvl4\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485826 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-cni-binary-copy\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485841 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-bin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485847 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-script-lib\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485873 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-cni-bin\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-etc-kubernetes\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485889 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a19bd69-fd59-4e29-b790-c0c1d55091cc-system-cni-dir\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485910 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-etc-kubernetes\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485909 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-netns\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485942 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-run-netns\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-bin\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485955 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-host\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485972 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-cni-bin\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.485974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-kubelet\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-config\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486008 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-kubelet\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-iptables-alerter-script\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486122 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486137 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-serviceca\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486154 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-netns\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-multus-daemon-config\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486201 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486206 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-multus-certs\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpw5t\" (UniqueName: \"kubernetes.io/projected/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-kube-api-access-jpw5t\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486251 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-netns\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486308 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-run-multus-certs\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhq5p\" (UniqueName: \"kubernetes.io/projected/62de7027-443f-4614-bf0a-b253fbef2177-kube-api-access-nhq5p\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.487964 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486393 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-host-slash\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486415 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-slash\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-system-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-socket-dir-parent\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-kubelet\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486491 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovnkube-config\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486503 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-iptables-alerter-script\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spfbp\" (UniqueName: \"kubernetes.io/projected/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-kube-api-access-spfbp\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486548 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-host-slash\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486557 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-system-cni-dir\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486588 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-host-slash\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486592 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-multus-socket-dir-parent\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486616 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62de7027-443f-4614-bf0a-b253fbef2177-multus-daemon-config\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486632 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62de7027-443f-4614-bf0a-b253fbef2177-host-var-lib-kubelet\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486882 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebeedaf-987e-4115-bd68-a91831c60851-tmp-dir\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.486974 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a19bd69-fd59-4e29-b790-c0c1d55091cc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.488523 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.487592 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-ovn-node-metrics-cert\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.493776 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.493750 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64t9\" (UniqueName: \"kubernetes.io/projected/b41d19a7-2573-4cc5-a9ba-6d65a8229dbf-kube-api-access-p64t9\") pod \"iptables-alerter-hgmlr\" (UID: \"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf\") " pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.494282 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.494088 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqn2\" (UniqueName: \"kubernetes.io/projected/9a19bd69-fd59-4e29-b790-c0c1d55091cc-kube-api-access-pjqn2\") pod \"multus-additional-cni-plugins-rdzf4\" (UID: \"9a19bd69-fd59-4e29-b790-c0c1d55091cc\") " pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.494410 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.494384 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spfbp\" (UniqueName: \"kubernetes.io/projected/8fba836b-de7b-4c89-a6d3-15a67df7bfc1-kube-api-access-spfbp\") pod \"node-ca-55hxr\" (UID: \"8fba836b-de7b-4c89-a6d3-15a67df7bfc1\") " pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.494519 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.494443 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpw5t\" (UniqueName: \"kubernetes.io/projected/dd41443e-a134-4b67-a1ab-5ea2b9526f7e-kube-api-access-jpw5t\") pod \"ovnkube-node-jgmk9\" (UID: \"dd41443e-a134-4b67-a1ab-5ea2b9526f7e\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.494519 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.494479 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhq5p\" (UniqueName: \"kubernetes.io/projected/62de7027-443f-4614-bf0a-b253fbef2177-kube-api-access-nhq5p\") pod \"multus-8dgpt\" (UID: \"62de7027-443f-4614-bf0a-b253fbef2177\") " pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.494519 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.494504 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgvl4\" (UniqueName: \"kubernetes.io/projected/2ebeedaf-987e-4115-bd68-a91831c60851-kube-api-access-fgvl4\") pod \"node-resolver-txg5f\" (UID: \"2ebeedaf-987e-4115-bd68-a91831c60851\") " pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.593265 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.593180 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:01.608430 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.608390 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc52f9b4ca129427164928f70b41a169.slice/crio-9998576b30a2eff8bab354c29b3701cec083a6f76f4c757f259265b290e5e1b7 WatchSource:0}: Error finding container 9998576b30a2eff8bab354c29b3701cec083a6f76f4c757f259265b290e5e1b7: Status 404 returned error can't find the container with id 9998576b30a2eff8bab354c29b3701cec083a6f76f4c757f259265b290e5e1b7 Sep 13 20:13:01.609867 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.609845 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2e6b34f461fb3d2a4e4760c512a949.slice/crio-a596b8a76d9cd6d50b019786102b17a48b9fb93fed790ede23b559b35feba4b5 WatchSource:0}: Error finding container a596b8a76d9cd6d50b019786102b17a48b9fb93fed790ede23b559b35feba4b5: Status 404 returned error can't find the container with id a596b8a76d9cd6d50b019786102b17a48b9fb93fed790ede23b559b35feba4b5 Sep 13 20:13:01.610867 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.610847 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222bcd42_3864_4319_a437_f2981088b13d.slice/crio-7327c4826e6132971bf590f32adb6368e108fd1aca5cee8eebca8633efa11b9a WatchSource:0}: Error finding container 7327c4826e6132971bf590f32adb6368e108fd1aca5cee8eebca8633efa11b9a: Status 404 returned error can't find the container with id 7327c4826e6132971bf590f32adb6368e108fd1aca5cee8eebca8633efa11b9a Sep 13 20:13:01.615206 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.615187 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" Sep 13 20:13:01.616472 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.616448 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:13:01.624534 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.624514 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa362f2_bbdf_4854_ac9d_37ecfd72a383.slice/crio-0933ccc3105f67414eb5accf52b407f6209d5d55ced131dbf621e2794543caf0 WatchSource:0}: Error finding container 0933ccc3105f67414eb5accf52b407f6209d5d55ced131dbf621e2794543caf0: Status 404 returned error can't find the container with id 0933ccc3105f67414eb5accf52b407f6209d5d55ced131dbf621e2794543caf0 Sep 13 20:13:01.630505 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.630488 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" Sep 13 20:13:01.637805 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.637782 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd1795b_18ac_451e_bf5d_2b10ed811c9e.slice/crio-3304d509a3237dc60854c7d4495446cbe44adc9d5650e4664c0c31ab3086b1ad WatchSource:0}: Error finding container 3304d509a3237dc60854c7d4495446cbe44adc9d5650e4664c0c31ab3086b1ad: Status 404 returned error can't find the container with id 3304d509a3237dc60854c7d4495446cbe44adc9d5650e4664c0c31ab3086b1ad Sep 13 20:13:01.652285 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.652263 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgmlr" Sep 13 20:13:01.661249 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.661226 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41d19a7_2573_4cc5_a9ba_6d65a8229dbf.slice/crio-b8857586d5c02cfc53dd20068fd7929566a6624edd3a768ab6b2e42e9f3cb8d2 WatchSource:0}: Error finding container b8857586d5c02cfc53dd20068fd7929566a6624edd3a768ab6b2e42e9f3cb8d2: Status 404 returned error can't find the container with id b8857586d5c02cfc53dd20068fd7929566a6624edd3a768ab6b2e42e9f3cb8d2 Sep 13 20:13:01.673528 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.673508 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-txg5f" Sep 13 20:13:01.681279 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.681258 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebeedaf_987e_4115_bd68_a91831c60851.slice/crio-d46b428aaca5f718d1cbb6560e09babaef2ff2b207098b59dfa399f25e056046 WatchSource:0}: Error finding container d46b428aaca5f718d1cbb6560e09babaef2ff2b207098b59dfa399f25e056046: Status 404 returned error can't find the container with id d46b428aaca5f718d1cbb6560e09babaef2ff2b207098b59dfa399f25e056046 Sep 13 20:13:01.688249 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.688233 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-55hxr" Sep 13 20:13:01.696529 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.696382 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fba836b_de7b_4c89_a6d3_15a67df7bfc1.slice/crio-bd04de7bc4e95e9fd663b1ccb8cdf12e3e1c2a29cc8ad19b6481fb1a51bd212c WatchSource:0}: Error finding container bd04de7bc4e95e9fd663b1ccb8cdf12e3e1c2a29cc8ad19b6481fb1a51bd212c: Status 404 returned error can't find the container with id bd04de7bc4e95e9fd663b1ccb8cdf12e3e1c2a29cc8ad19b6481fb1a51bd212c Sep 13 20:13:01.704891 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.704872 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dgpt" Sep 13 20:13:01.712476 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.712455 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62de7027_443f_4614_bf0a_b253fbef2177.slice/crio-3fc5aa00248fb285e8e81dcbb2fc0785c495c53fbbf60c154fe3cdd061456529 WatchSource:0}: Error finding container 3fc5aa00248fb285e8e81dcbb2fc0785c495c53fbbf60c154fe3cdd061456529: Status 404 returned error can't find the container with id 3fc5aa00248fb285e8e81dcbb2fc0785c495c53fbbf60c154fe3cdd061456529 Sep 13 20:13:01.739870 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.739841 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" Sep 13 20:13:01.748695 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.748673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:01.749019 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.748998 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a19bd69_fd59_4e29_b790_c0c1d55091cc.slice/crio-8d6a1617db357f2dc6a085c1c9445af535813695f730c0ac4cf13e768af0bb8f WatchSource:0}: Error finding container 8d6a1617db357f2dc6a085c1c9445af535813695f730c0ac4cf13e768af0bb8f: Status 404 returned error can't find the container with id 8d6a1617db357f2dc6a085c1c9445af535813695f730c0ac4cf13e768af0bb8f Sep 13 20:13:01.756640 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:01.756622 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd41443e_a134_4b67_a1ab_5ea2b9526f7e.slice/crio-741dc7b2f72ec34918935fc8671eef2e865d58eeec575b43e72dcb1521a35911 WatchSource:0}: Error finding container 741dc7b2f72ec34918935fc8671eef2e865d58eeec575b43e72dcb1521a35911: Status 404 returned error can't find the container with id 741dc7b2f72ec34918935fc8671eef2e865d58eeec575b43e72dcb1521a35911 Sep 13 20:13:01.758197 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.758179 2552 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-jgmk9_openshift-ovn-kubernetes(dd41443e-a134-4b67-a1ab-5ea2b9526f7e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 13 20:13:01.759463 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.759446 2552 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-jgmk9_openshift-ovn-kubernetes(dd41443e-a134-4b67-a1ab-5ea2b9526f7e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 13 20:13:01.762290 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.762202 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" podUID="dd41443e-a134-4b67-a1ab-5ea2b9526f7e" Sep 13 20:13:01.800922 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.800903 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:13:01.821480 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.821454 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:13:01.889785 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.889715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:01.889906 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.889839 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:01.889906 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.889886 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:02.889873447 +0000 UTC m=+2.946981205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:01.990587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.990543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:01.990587 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:01.990595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:01.990802 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990755 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:01.990802 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990770 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:01.990802 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990791 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:01.990802 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990803 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:01.990987 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990813 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:02.990796542 +0000 UTC m=+3.047904317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:01.990987 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:01.990838 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:02.990827682 +0000 UTC m=+3.047935442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:02.317497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.317378 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 20:08:01 +0000 UTC" deadline="2028-04-08 13:07:31.332293777 +0000 UTC" Sep 13 20:13:02.317497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.317446 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13744h54m29.014851356s" Sep 13 20:13:02.386264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.386235 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:13:02.529004 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.528328 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:02.529004 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.528451 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:02.529004 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.528853 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:02.529004 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.528954 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:02.529702 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.529426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:02.529702 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.529523 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:02.560734 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.560606 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" event={"ID":"efd1795b-18ac-451e-bf5d-2b10ed811c9e","Type":"ContainerStarted","Data":"3304d509a3237dc60854c7d4495446cbe44adc9d5650e4664c0c31ab3086b1ad"} Sep 13 20:13:02.583898 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.583813 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" event={"ID":"eaa362f2-bbdf-4854-ac9d-37ecfd72a383","Type":"ContainerStarted","Data":"0933ccc3105f67414eb5accf52b407f6209d5d55ced131dbf621e2794543caf0"} Sep 13 20:13:02.601973 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.601939 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h2zm" event={"ID":"222bcd42-3864-4319-a437-f2981088b13d","Type":"ContainerStarted","Data":"7327c4826e6132971bf590f32adb6368e108fd1aca5cee8eebca8633efa11b9a"} Sep 13 20:13:02.611972 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.611940 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dgpt" event={"ID":"62de7027-443f-4614-bf0a-b253fbef2177","Type":"ContainerStarted","Data":"3fc5aa00248fb285e8e81dcbb2fc0785c495c53fbbf60c154fe3cdd061456529"} Sep 13 20:13:02.620501 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.620470 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgmlr" event={"ID":"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf","Type":"ContainerStarted","Data":"b8857586d5c02cfc53dd20068fd7929566a6624edd3a768ab6b2e42e9f3cb8d2"} Sep 13 20:13:02.625624 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.625594 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" event={"ID":"fc52f9b4ca129427164928f70b41a169","Type":"ContainerStarted","Data":"9998576b30a2eff8bab354c29b3701cec083a6f76f4c757f259265b290e5e1b7"} Sep 13 20:13:02.633717 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.633688 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" event={"ID":"cd2e6b34f461fb3d2a4e4760c512a949","Type":"ContainerStarted","Data":"a596b8a76d9cd6d50b019786102b17a48b9fb93fed790ede23b559b35feba4b5"} Sep 13 20:13:02.636636 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.636611 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"741dc7b2f72ec34918935fc8671eef2e865d58eeec575b43e72dcb1521a35911"} Sep 13 20:13:02.643808 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.643783 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerStarted","Data":"8d6a1617db357f2dc6a085c1c9445af535813695f730c0ac4cf13e768af0bb8f"} Sep 13 20:13:02.653793 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.653771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55hxr" event={"ID":"8fba836b-de7b-4c89-a6d3-15a67df7bfc1","Type":"ContainerStarted","Data":"bd04de7bc4e95e9fd663b1ccb8cdf12e3e1c2a29cc8ad19b6481fb1a51bd212c"} Sep 13 20:13:02.655075 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.655007 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f416b510fcb7bc202c9983b4402fda0000c1565e3a1c5cab4d877aad9ec460\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1de7a8eeb36fff2326d9f3af3f515b1b617c93675b1149831949cab0cf40a2c6\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" podUID="dd41443e-a134-4b67-a1ab-5ea2b9526f7e" Sep 13 20:13:02.655840 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.655764 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-txg5f" event={"ID":"2ebeedaf-987e-4115-bd68-a91831c60851","Type":"ContainerStarted","Data":"d46b428aaca5f718d1cbb6560e09babaef2ff2b207098b59dfa399f25e056046"} Sep 13 20:13:02.897654 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.897570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:02.897822 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.897741 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:02.897822 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.897814 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:04.897794801 +0000 UTC m=+4.954902557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:02.998602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.998562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:02.998785 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:02.998616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:02.998785 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.998757 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:02.998892 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.998820 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:04.998801385 +0000 UTC m=+5.055909139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:02.999296 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.999276 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:02.999378 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.999305 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:02.999378 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.999318 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:02.999378 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:02.999363 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:04.999348825 +0000 UTC m=+5.056456584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:03.318297 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:03.318173 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 20:08:01 +0000 UTC" deadline="2028-06-11 09:11:31.38656016 +0000 UTC" Sep 13 20:13:03.318297 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:03.318246 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15276h58m28.06831871s" Sep 13 20:13:04.529543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:04.529510 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:04.530051 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:04.529639 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:04.530051 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:04.529706 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:04.530051 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:04.529829 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:04.530051 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:04.529862 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:04.530051 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:04.529938 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:04.918356 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:04.918271 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:04.918517 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:04.918470 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:04.918574 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:04.918541 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:08.918520208 +0000 UTC m=+8.975627964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:05.019472 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:05.019419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:05.019472 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:05.019473 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:05.019699 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019611 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:05.019699 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019643 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:05.019699 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019657 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:05.019841 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019717 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:09.01969805 +0000 UTC m=+9.076805803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:05.019841 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019616 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:05.019841 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:05.019795 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:09.019778699 +0000 UTC m=+9.076886456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:06.528248 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:06.528199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:06.528248 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:06.528243 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:06.528821 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:06.528223 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:06.528821 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:06.528372 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:06.528821 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:06.528461 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:06.528821 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:06.528536 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:08.527598 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:08.527550 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:08.528121 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:08.527779 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:08.528121 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:08.527850 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:08.528121 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:08.527904 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:08.528363 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:08.528241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:08.528363 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:08.528330 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:08.951129 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:08.951044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:08.951314 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:08.951236 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:08.951385 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:08.951319 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:16.95129662 +0000 UTC m=+17.008404382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:09.052100 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:09.052061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:09.052100 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:09.052101 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:09.052294 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052251 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:09.052294 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052277 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:09.052294 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052292 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:09.052455 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052251 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:09.052455 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052350 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:17.052329962 +0000 UTC m=+17.109437715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:09.052455 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:09.052400 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:17.052366053 +0000 UTC m=+17.109473820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:10.530153 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:10.530123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:10.530744 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:10.530123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:10.530744 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:10.530247 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:10.530744 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:10.530123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:10.530744 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:10.530295 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:10.530744 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:10.530426 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:12.530709 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:12.530678 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:12.531174 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:12.530784 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:12.531174 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:12.530796 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:12.531174 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:12.530801 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:12.531174 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:12.530884 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:12.531174 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:12.530982 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:14.530451 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:14.530426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:14.530451 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:14.530439 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:14.530809 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:14.530439 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:14.530809 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:14.530634 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:14.530809 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:14.530694 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:14.530809 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:14.530756 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:14.690108 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:14.690076 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" event={"ID":"fc52f9b4ca129427164928f70b41a169","Type":"ContainerStarted","Data":"415e417a2b21a253ff9492c4c4435ae8ff2dd5e01666b2c3c2ea5f0c6fea4b08"} Sep 13 20:13:14.703210 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:14.702789 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-25.ec2.internal" podStartSLOduration=13.702768491 podStartE2EDuration="13.702768491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:14.702472227 +0000 UTC m=+14.759580000" watchObservedRunningTime="2026-09-13 20:13:14.702768491 +0000 UTC m=+14.759876268" Sep 13 20:13:15.695495 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:15.695043 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" event={"ID":"efd1795b-18ac-451e-bf5d-2b10ed811c9e","Type":"ContainerStarted","Data":"63131aa8f670723cf4c92bf3860c6f5019beca82937ba2662553442a237cf100"} Sep 13 20:13:15.702654 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:15.700031 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dgpt" event={"ID":"62de7027-443f-4614-bf0a-b253fbef2177","Type":"ContainerStarted","Data":"513a08e2fe2cc4f5fa9474604f7ed76aa08fe60261759911b0c2b7c5180603d8"} Sep 13 20:13:15.711835 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:15.711787 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xdbfj" podStartSLOduration=2.660336813 podStartE2EDuration="15.711764818s" totalImagesPullingTime="13.051428005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:15.71097354 +0000 UTC m=+15.768081318" watchObservedRunningTime="2026-09-13 20:13:15.711764818 +0000 UTC m=+15.768872597" Sep 13 20:13:16.528413 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.528383 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:16.528413 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.528402 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:16.528696 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.528380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:16.528696 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:16.528503 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:16.528696 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:16.528561 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:16.528696 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:16.528623 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:16.704956 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.704591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgmlr" event={"ID":"b41d19a7-2573-4cc5-a9ba-6d65a8229dbf","Type":"ContainerStarted","Data":"8b643a5ae9bfe3abe2dd5ff9119b109118a4bf0117f4474baab3cca967684398"} Sep 13 20:13:16.706547 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.706510 2552 generic.go:356] "Generic (PLEG): container finished" podID="cd2e6b34f461fb3d2a4e4760c512a949" containerID="5c5918b5692219f82c0134cfe4ec3d0544d0d198896dad8f2d24eec8d55ac68b" exitCode=0 Sep 13 20:13:16.706831 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.706747 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" event={"ID":"cd2e6b34f461fb3d2a4e4760c512a949","Type":"ContainerDied","Data":"5c5918b5692219f82c0134cfe4ec3d0544d0d198896dad8f2d24eec8d55ac68b"} Sep 13 20:13:16.708456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.708429 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerStarted","Data":"7368e1f2e5d5a418ed6e780d9fca1fb36e3a7242146192da6e6b46ab59192e75"} Sep 13 20:13:16.710850 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.710826 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-55hxr" event={"ID":"8fba836b-de7b-4c89-a6d3-15a67df7bfc1","Type":"ContainerStarted","Data":"15ee47fd9b92b50bff960e15a0a720fe8866132d6541264eb9b4c087f72d0794"} Sep 13 20:13:16.714021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.713645 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-txg5f" event={"ID":"2ebeedaf-987e-4115-bd68-a91831c60851","Type":"ContainerStarted","Data":"55f6c9bc36d20d4011c062feff61363219cdfde504ff8513885e5b70a8bc3417"} Sep 13 20:13:16.716502 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.716467 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgmlr" podStartSLOduration=3.90143239 podStartE2EDuration="16.716455439s" totalImagesPullingTime="12.815023049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:16.716400408 +0000 UTC m=+16.773508186" watchObservedRunningTime="2026-09-13 20:13:16.716455439 +0000 UTC m=+16.773563212" Sep 13 20:13:16.716622 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.716538 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" event={"ID":"eaa362f2-bbdf-4854-ac9d-37ecfd72a383","Type":"ContainerStarted","Data":"4bd4dfea74aafe81a89c8f2c4c73fc716b9f7a822bc95c6f1bd2542c16e45f31"} Sep 13 20:13:16.716747 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.716712 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8dgpt" podStartSLOduration=3.402212444 podStartE2EDuration="16.716705598s" totalImagesPullingTime="13.314493154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:15.724792762 +0000 UTC m=+15.781900548" watchObservedRunningTime="2026-09-13 20:13:16.716705598 +0000 UTC m=+16.773813371" Sep 13 20:13:16.718671 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.718645 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h2zm" event={"ID":"222bcd42-3864-4319-a437-f2981088b13d","Type":"ContainerStarted","Data":"5d707f32a4814bad149199f91c238fd231b87fd6092f3bd0913b6873b317abde"} Sep 13 20:13:16.742068 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.742018 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-txg5f" podStartSLOduration=3.9480074800000002 podStartE2EDuration="16.741998996s" totalImagesPullingTime="12.793991516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:16.728098818 +0000 UTC m=+16.785206593" watchObservedRunningTime="2026-09-13 20:13:16.741998996 +0000 UTC m=+16.799106807" Sep 13 20:13:16.742198 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.742103 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-55hxr" podStartSLOduration=3.9635542040000002 podStartE2EDuration="16.742096671s" totalImagesPullingTime="12.778542467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:16.741344106 +0000 UTC m=+16.798451883" watchObservedRunningTime="2026-09-13 20:13:16.742096671 +0000 UTC m=+16.799204445" Sep 13 20:13:16.794375 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:16.794320 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8h2zm" podStartSLOduration=3.934612457 podStartE2EDuration="16.794301395s" totalImagesPullingTime="12.859688938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:16.793834975 +0000 UTC m=+16.850942750" watchObservedRunningTime="2026-09-13 20:13:16.794301395 +0000 UTC m=+16.851409169" Sep 13 20:13:17.010140 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.010112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:17.010307 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.010293 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:17.010371 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.010353 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:13:33.010340452 +0000 UTC m=+33.067448223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:17.110997 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.110956 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:17.111250 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.111011 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:17.111250 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111140 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:17.111250 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111234 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:13:33.111184736 +0000 UTC m=+33.168292496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:17.111665 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111644 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:17.111665 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111667 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:17.111840 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111681 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:17.111840 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:17.111731 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:33.111716103 +0000 UTC m=+33.168823860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:17.448593 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.448570 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 13 20:13:17.592770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.592582 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:17.593361 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.593182 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:17.722635 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.722552 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" event={"ID":"cd2e6b34f461fb3d2a4e4760c512a949","Type":"ContainerStarted","Data":"97c97cb08f89f608a97d8523ecf99f29b20390aefee7dfedfee003150fb5a575"} Sep 13 20:13:17.724075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.724053 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="7368e1f2e5d5a418ed6e780d9fca1fb36e3a7242146192da6e6b46ab59192e75" exitCode=0 Sep 13 20:13:17.724200 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.724122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"7368e1f2e5d5a418ed6e780d9fca1fb36e3a7242146192da6e6b46ab59192e75"} Sep 13 20:13:17.725947 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.725927 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" event={"ID":"eaa362f2-bbdf-4854-ac9d-37ecfd72a383","Type":"ContainerStarted","Data":"95eadeb8ae4fd5c0ea962662899d0a4d3986b5af55d07808f18835d716e1c8d1"} Sep 13 20:13:17.735412 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:17.735358 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-25.ec2.internal" podStartSLOduration=16.735340716 podStartE2EDuration="16.735340716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:17.73493906 +0000 UTC m=+17.792046830" watchObservedRunningTime="2026-09-13 20:13:17.735340716 +0000 UTC m=+17.792448492" Sep 13 20:13:18.345444 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.345344 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-13T20:13:17.44858764Z","UUID":"e86f7616-379f-4c81-b66f-e95cc1450329","Handler":null,"Name":"","Endpoint":""} Sep 13 20:13:18.347094 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.347069 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 13 20:13:18.347242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.347108 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 13 20:13:18.527736 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.527471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:18.527736 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:18.527603 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:18.527997 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.527808 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:18.527997 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.527826 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:18.527997 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:18.527917 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:18.528153 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:18.528018 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:18.731140 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.731054 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" event={"ID":"eaa362f2-bbdf-4854-ac9d-37ecfd72a383","Type":"ContainerStarted","Data":"7f505a33217d818e817069176689252f7f066522c33867335eaa09956e8d13d9"} Sep 13 20:13:18.731584 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.731245 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 13 20:13:18.746095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:18.746045 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qdb6" podStartSLOduration=3.5419720249999997 podStartE2EDuration="18.746026496s" totalImagesPullingTime="15.204054471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:18.74544361 +0000 UTC m=+18.802551386" watchObservedRunningTime="2026-09-13 20:13:18.746026496 +0000 UTC m=+18.803134273" Sep 13 20:13:20.531982 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:20.531758 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:20.532484 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:20.531820 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:20.532484 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:20.532078 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:20.532484 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:20.531855 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:20.532484 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:20.532154 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:20.532484 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:20.532261 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:22.530636 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:22.530608 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:22.531209 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:22.530612 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:22.531209 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:22.530720 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:22.531209 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:22.530834 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:22.531209 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:22.530612 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:22.531209 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:22.530946 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:24.528036 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:24.527933 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:24.528640 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:24.528077 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:24.528640 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:24.528194 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:24.528640 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:24.528078 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:24.528640 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:24.528262 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:24.528640 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:24.528383 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:25.786795 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:25.786760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:25.866685 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:25.866505 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:25.967383 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:25.967358 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:26.067097 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.067064 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:26.122464 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.122443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:26.527641 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.527609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:26.527956 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.527620 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:26.527956 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:26.527736 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:26.527956 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.527752 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:26.527956 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:26.527812 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:26.527956 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:26.527877 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:26.764313 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764278 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"7178ff0f286a1ef14a4412df25644578099cb88eaf11d669b43a0299c85d7a8c"} Sep 13 20:13:26.764479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764357 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"800384d12a1f37787ec318db27286f48a82609d6f069b67d9efa1647addb5579"} Sep 13 20:13:26.764479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764412 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"f987d6efd38f3c49b0668354a3d7f31dc11ec5e57ce7e85172b4f225c20aa767"} Sep 13 20:13:26.764479 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764455 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"76eb291d6c7d7e57ea7d53918470aadfbfa333671716f787a9a4b37fab9b82fd"} Sep 13 20:13:26.764635 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764495 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"e4202373a94d957748472f5cd417658f322d898dbddf135f777d512134bc0b3f"} Sep 13 20:13:26.764635 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.764545 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"4c5a1c51a8837a3a5f26978c3c6ac71e94fdbad7f9fa0930dbe40d54dbbf10f3"} Sep 13 20:13:26.766032 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.766010 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="314aefcf59a66121a809362b3ed59d1c65f55de653979324622cb236feec90cc" exitCode=0 Sep 13 20:13:26.766136 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:26.766033 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"314aefcf59a66121a809362b3ed59d1c65f55de653979324622cb236feec90cc"} Sep 13 20:13:27.390617 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:27.390589 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:27.769988 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:27.769951 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="d95b5c2b5b5c32d3de54532610d9d4c66d11916c3d6a70870fdb526223622a4d" exitCode=0 Sep 13 20:13:27.770117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:27.770017 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"d95b5c2b5b5c32d3de54532610d9d4c66d11916c3d6a70870fdb526223622a4d"} Sep 13 20:13:28.527702 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.527669 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:28.528116 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.527679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:28.528116 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:28.527799 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:28.528116 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.527828 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:28.528116 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:28.527927 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:28.528116 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:28.528017 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:28.775780 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.775685 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"256d7f0ff04fc01abbd41dea463fbe40076569f359164757c88de3e67e4ca791"} Sep 13 20:13:28.778013 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.777988 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="3f0762bf81488715ab61d6a2f5af7e14a59d4df42fe1d967f3cea7754b9c319d" exitCode=0 Sep 13 20:13:28.778130 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:28.778039 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"3f0762bf81488715ab61d6a2f5af7e14a59d4df42fe1d967f3cea7754b9c319d"} Sep 13 20:13:29.591423 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:29.591167 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:29.691421 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:29.691380 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:29.984699 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:29.984610 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:29.984884 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:29.984745 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 13 20:13:29.985252 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:29.985229 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8h2zm" Sep 13 20:13:30.038074 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.038045 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:30.531233 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.531187 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:30.531387 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.531241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:30.531387 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.531234 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:30.531387 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:30.531317 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:30.531543 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:30.531423 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:30.531543 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:30.531507 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:30.786054 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.785966 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" event={"ID":"dd41443e-a134-4b67-a1ab-5ea2b9526f7e","Type":"ContainerStarted","Data":"02d931e2a000e1509de54c475ce1084239590744e1bdea87fa189bcd69f7ee28"} Sep 13 20:13:30.808800 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:30.808755 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" podStartSLOduration=6.899809513 podStartE2EDuration="30.808737149s" totalImagesPullingTime="23.908927636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-09-13 20:13:30.807563328 +0000 UTC m=+30.864671102" watchObservedRunningTime="2026-09-13 20:13:30.808737149 +0000 UTC m=+30.865844925" Sep 13 20:13:31.789651 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:31.789453 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:31.789651 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:31.789542 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:31.789651 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:31.789592 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:31.806117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:31.806089 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:31.807232 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:31.807195 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:13:32.531750 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.531505 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:32.531905 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.531567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:32.531905 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.531850 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:32.531905 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.531567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:32.532047 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.531934 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:32.532047 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.532012 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:32.533654 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.533627 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cl629"] Sep 13 20:13:32.538095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.538066 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65vst"] Sep 13 20:13:32.538344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.538242 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b5l5x"] Sep 13 20:13:32.790738 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.790643 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:32.790738 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.790659 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:32.790738 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:32.790651 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:32.790738 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.790734 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:32.791177 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.790819 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:32.791236 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:32.791175 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:33.026462 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:33.026425 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:33.026616 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.026566 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:33.026653 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.026619 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:14:05.026606451 +0000 UTC m=+65.083714207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:33.127553 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:33.127475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:33.127553 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:33.127545 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:33.127727 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127636 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:33.127727 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127701 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret podName:c235cfe3-95ee-4cdb-a7b7-64a0a770be3b nodeName:}" failed. No retries permitted until 2026-09-13 20:14:05.127686619 +0000 UTC m=+65.184794371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret") pod "global-pull-secret-syncer-b5l5x" (UID: "c235cfe3-95ee-4cdb-a7b7-64a0a770be3b") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:33.127727 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127643 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:33.127824 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127735 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:33.127824 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127747 2552 projected.go:196] Error preparing data for projected volume kube-api-access-wrlvg for pod openshift-network-diagnostics/network-check-target-65vst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:33.127824 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:33.127788 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg podName:f243126a-07d5-416d-88e6-31ff7eb97028 nodeName:}" failed. No retries permitted until 2026-09-13 20:14:05.127776801 +0000 UTC m=+65.184884554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wrlvg" (UniqueName: "kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg") pod "network-check-target-65vst" (UID: "f243126a-07d5-416d-88e6-31ff7eb97028") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:33.795908 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:33.795873 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="62b88864b68e517f76048b7debb23ec50194fe58b64b8804beb827fffa4ca0af" exitCode=0 Sep 13 20:13:33.796388 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:33.795955 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"62b88864b68e517f76048b7debb23ec50194fe58b64b8804beb827fffa4ca0af"} Sep 13 20:13:34.527358 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:34.527328 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:34.527358 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:34.527354 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:34.527563 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:34.527448 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:34.527563 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:34.527489 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:34.527563 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:34.527511 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:34.527677 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:34.527593 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:34.801799 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:34.801726 2552 generic.go:356] "Generic (PLEG): container finished" podID="9a19bd69-fd59-4e29-b790-c0c1d55091cc" containerID="720d09c645d874555a9fb68f6112f8503e902cff75e743288408e007813a9ccd" exitCode=0 Sep 13 20:13:34.801799 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:34.801792 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerDied","Data":"720d09c645d874555a9fb68f6112f8503e902cff75e743288408e007813a9ccd"} Sep 13 20:13:35.807672 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:35.807638 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" event={"ID":"9a19bd69-fd59-4e29-b790-c0c1d55091cc","Type":"ContainerStarted","Data":"68b34e37f993a06054723387b12c53270a9ca3bf2aa7182465af6f5963aee243"} Sep 13 20:13:35.826468 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:35.826428 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rdzf4" podStartSLOduration=9.343615988 podStartE2EDuration="35.826412699s" totalImagesPullingTime="26.482796711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:35.8260278 +0000 UTC m=+35.883135573" watchObservedRunningTime="2026-09-13 20:13:35.826412699 +0000 UTC m=+35.883520473" Sep 13 20:13:35.951999 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:35.951972 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:36.011731 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:36.011702 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:36.530553 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:36.530524 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:36.530553 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:36.530547 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:36.530747 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:36.530533 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:36.530747 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:36.530629 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:36.530747 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:36.530694 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:36.530842 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:36.530790 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:38.528385 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:38.528191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:38.528757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:38.528200 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:38.528757 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:38.528465 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65vst" podUID="f243126a-07d5-416d-88e6-31ff7eb97028" Sep 13 20:13:38.528757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:38.528234 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:38.528757 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:38.528555 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:13:38.528757 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:38.528637 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5l5x" podUID="c235cfe3-95ee-4cdb-a7b7-64a0a770be3b" Sep 13 20:13:39.185042 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.185014 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-25.ec2.internal" event="NodeReady" Sep 13 20:13:39.185200 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.185123 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 13 20:13:39.224228 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.224186 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qqw6x"] Sep 13 20:13:39.240242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.240200 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gkjsq"] Sep 13 20:13:39.240374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.240322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.242497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.242476 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 13 20:13:39.242627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.242521 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fnqc\"" Sep 13 20:13:39.242627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.242568 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 13 20:13:39.266325 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.266297 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqw6x"] Sep 13 20:13:39.266449 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.266340 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkjsq"] Sep 13 20:13:39.266449 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.266409 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.268331 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.268313 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 13 20:13:39.268447 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.268338 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 13 20:13:39.268658 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.268643 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dgck6\"" Sep 13 20:13:39.268697 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.268646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 13 20:13:39.367253 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367205 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf37eaa-5232-4fd6-9bcd-f30e038121e7-config-volume\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.367253 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367254 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjhd\" (UniqueName: \"kubernetes.io/projected/dcad819b-8440-46b2-979e-e091d1f1e09b-kube-api-access-5vjhd\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.367460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245nb\" (UniqueName: \"kubernetes.io/projected/adf37eaa-5232-4fd6-9bcd-f30e038121e7-kube-api-access-245nb\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.367460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367310 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf37eaa-5232-4fd6-9bcd-f30e038121e7-tmp-dir\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.367460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367422 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.367460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.367451 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcad819b-8440-46b2-979e-e091d1f1e09b-cert\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.468551 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468473 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.468551 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468506 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcad819b-8440-46b2-979e-e091d1f1e09b-cert\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.468551 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf37eaa-5232-4fd6-9bcd-f30e038121e7-config-volume\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.468551 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468554 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjhd\" (UniqueName: \"kubernetes.io/projected/dcad819b-8440-46b2-979e-e091d1f1e09b-kube-api-access-5vjhd\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.468848 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245nb\" (UniqueName: \"kubernetes.io/projected/adf37eaa-5232-4fd6-9bcd-f30e038121e7-kube-api-access-245nb\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.468848 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468588 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf37eaa-5232-4fd6-9bcd-f30e038121e7-tmp-dir\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.468848 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:39.468795 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:39.468975 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:39.468885 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:39.9688621 +0000 UTC m=+40.025969860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:13:39.468975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.468937 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf37eaa-5232-4fd6-9bcd-f30e038121e7-tmp-dir\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.469150 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.469130 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/adf37eaa-5232-4fd6-9bcd-f30e038121e7-config-volume\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.472760 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.472732 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcad819b-8440-46b2-979e-e091d1f1e09b-cert\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.477195 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.477171 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-245nb\" (UniqueName: \"kubernetes.io/projected/adf37eaa-5232-4fd6-9bcd-f30e038121e7-kube-api-access-245nb\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.477307 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.477296 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjhd\" (UniqueName: \"kubernetes.io/projected/dcad819b-8440-46b2-979e-e091d1f1e09b-kube-api-access-5vjhd\") pod \"ingress-canary-gkjsq\" (UID: \"dcad819b-8440-46b2-979e-e091d1f1e09b\") " pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.574532 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.574500 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gkjsq" Sep 13 20:13:39.890448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.890398 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gkjsq"] Sep 13 20:13:39.893564 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:13:39.893540 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcad819b_8440_46b2_979e_e091d1f1e09b.slice/crio-dfa93c39088ba45f67205b4bbd7ac8f1fb4739291a90f93031d822040e4c2467 WatchSource:0}: Error finding container dfa93c39088ba45f67205b4bbd7ac8f1fb4739291a90f93031d822040e4c2467: Status 404 returned error can't find the container with id dfa93c39088ba45f67205b4bbd7ac8f1fb4739291a90f93031d822040e4c2467 Sep 13 20:13:39.972720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:39.972678 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:39.972862 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:39.972797 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:39.972862 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:39.972847 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:40.972833178 +0000 UTC m=+41.029940929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:13:40.529154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.529118 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:13:40.529360 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.529311 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:13:40.529419 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.529317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:13:40.532607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532581 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 20:13:40.532723 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532643 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5c5lx\"" Sep 13 20:13:40.532723 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532689 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ln5vr\"" Sep 13 20:13:40.532817 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532582 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 20:13:40.532817 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532589 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 20:13:40.532984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.532969 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 20:13:40.821762 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.821680 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkjsq" event={"ID":"dcad819b-8440-46b2-979e-e091d1f1e09b","Type":"ContainerStarted","Data":"dfa93c39088ba45f67205b4bbd7ac8f1fb4739291a90f93031d822040e4c2467"} Sep 13 20:13:40.979320 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:40.979286 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:40.979511 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:40.979416 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:40.979511 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:40.979479 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:42.979461224 +0000 UTC m=+43.036568978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:13:42.829267 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:42.829080 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gkjsq" event={"ID":"dcad819b-8440-46b2-979e-e091d1f1e09b","Type":"ContainerStarted","Data":"339fb53c6fbfa96e12cf43d4cea4f65fcd1f9bb59ab67d927bdf457fd0f14e38"} Sep 13 20:13:42.842544 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:42.842495 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gkjsq" podStartSLOduration=1.053075801 podStartE2EDuration="3.842479396s" totalImagesPullingTime="2.789403595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:42.841497235 +0000 UTC m=+42.898605009" watchObservedRunningTime="2026-09-13 20:13:42.842479396 +0000 UTC m=+42.899587171" Sep 13 20:13:42.994341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:42.994203 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:42.994469 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:42.994362 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:42.994469 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:42.994422 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:46.99440716 +0000 UTC m=+47.051514912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:13:47.020182 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:47.020142 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:47.020629 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:47.020324 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:47.020629 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:47.020393 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:55.020377136 +0000 UTC m=+55.077484888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:13:48.161420 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:48.161385 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:48.214672 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:48.214642 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:48.737856 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:48.737823 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:48.789343 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:48.789314 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:49.997660 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:49.997626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:50.047758 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:50.047733 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:13:55.075408 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:13:55.075366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:13:55.075917 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:55.075493 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:55.075917 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:13:55.075546 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:14:11.075532116 +0000 UTC m=+71.132639868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:14:03.290746 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:03.290710 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:14:03.806577 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:03.806552 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgmk9" Sep 13 20:14:03.914303 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:03.914271 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:14:04.013566 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:04.013536 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:14:05.042790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.042756 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:14:05.044843 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.044822 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 20:14:05.053561 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:05.053545 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:14:05.053645 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:05.053635 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:15:09.053620909 +0000 UTC m=+129.110728661 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : secret "metrics-daemon-secret" not found Sep 13 20:14:05.143331 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.143282 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:14:05.143331 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.143320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:14:05.145352 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.145326 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 20:14:05.145446 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.145399 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 20:14:05.155616 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.155599 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 20:14:05.157049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.157032 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c235cfe3-95ee-4cdb-a7b7-64a0a770be3b-original-pull-secret\") pod \"global-pull-secret-syncer-b5l5x\" (UID: \"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b\") " pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:14:05.166207 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.166185 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlvg\" (UniqueName: \"kubernetes.io/projected/f243126a-07d5-416d-88e6-31ff7eb97028-kube-api-access-wrlvg\") pod \"network-check-target-65vst\" (UID: \"f243126a-07d5-416d-88e6-31ff7eb97028\") " pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:14:05.442080 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.442046 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5l5x" Sep 13 20:14:05.450724 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.450703 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ln5vr\"" Sep 13 20:14:05.458519 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.458498 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:14:05.715039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.714952 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b5l5x"] Sep 13 20:14:05.719071 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:14:05.719044 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc235cfe3_95ee_4cdb_a7b7_64a0a770be3b.slice/crio-588c4a30590962f6526c4de9c7a2af4bccc01d579f2ff11b6437229993161bd6 WatchSource:0}: Error finding container 588c4a30590962f6526c4de9c7a2af4bccc01d579f2ff11b6437229993161bd6: Status 404 returned error can't find the container with id 588c4a30590962f6526c4de9c7a2af4bccc01d579f2ff11b6437229993161bd6 Sep 13 20:14:05.734571 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.734522 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65vst"] Sep 13 20:14:05.738556 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:14:05.738522 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf243126a_07d5_416d_88e6_31ff7eb97028.slice/crio-8f0ffe91e223cb93cc857c83387ab41054477901faf4f1a13070f6f8553971ef WatchSource:0}: Error finding container 8f0ffe91e223cb93cc857c83387ab41054477901faf4f1a13070f6f8553971ef: Status 404 returned error can't find the container with id 8f0ffe91e223cb93cc857c83387ab41054477901faf4f1a13070f6f8553971ef Sep 13 20:14:05.884121 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.884071 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65vst" event={"ID":"f243126a-07d5-416d-88e6-31ff7eb97028","Type":"ContainerStarted","Data":"8f0ffe91e223cb93cc857c83387ab41054477901faf4f1a13070f6f8553971ef"} Sep 13 20:14:05.885298 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:05.885273 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b5l5x" event={"ID":"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b","Type":"ContainerStarted","Data":"588c4a30590962f6526c4de9c7a2af4bccc01d579f2ff11b6437229993161bd6"} Sep 13 20:14:10.902420 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:10.902382 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65vst" event={"ID":"f243126a-07d5-416d-88e6-31ff7eb97028","Type":"ContainerStarted","Data":"49e4ecbe5d413a5b2f6419c469ef2fae77227c7248a02e75b20df02f8b6b03bf"} Sep 13 20:14:10.902856 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:10.902473 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:14:10.903829 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:10.903803 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b5l5x" event={"ID":"c235cfe3-95ee-4cdb-a7b7-64a0a770be3b","Type":"ContainerStarted","Data":"7e140cc2554b47f5da8555096eb1908327d1b577fa63a0076edbe71049aa7a37"} Sep 13 20:14:10.915695 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:10.915655 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-65vst" podStartSLOduration=66.252387818 podStartE2EDuration="1m10.915641302s" totalImagesPullingTime="4.663253484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:10.914734789 +0000 UTC m=+70.971842563" watchObservedRunningTime="2026-09-13 20:14:10.915641302 +0000 UTC m=+70.972749124" Sep 13 20:14:10.927378 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:10.927336 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b5l5x" podStartSLOduration=66.244459009 podStartE2EDuration="1m10.927322962s" totalImagesPullingTime="4.682863953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:10.927060418 +0000 UTC m=+70.984168192" watchObservedRunningTime="2026-09-13 20:14:10.927322962 +0000 UTC m=+70.984430772" Sep 13 20:14:11.088361 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:11.088322 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:14:11.088520 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:11.088475 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:14:11.088566 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:11.088541 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:14:43.088525984 +0000 UTC m=+103.145633736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:14:36.934927 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.934896 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh"] Sep 13 20:14:36.937981 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.937959 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:36.943293 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.940616 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 13 20:14:36.943883 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.943848 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 13 20:14:36.943986 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.943877 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 13 20:14:36.943986 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.943943 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nnlfp\"" Sep 13 20:14:36.944086 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.944012 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 13 20:14:36.948839 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.948813 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh"] Sep 13 20:14:36.953823 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.953803 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq"] Sep 13 20:14:36.956486 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.956471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:36.958297 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.958280 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 13 20:14:36.965585 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:36.965564 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq"] Sep 13 20:14:37.069034 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.068995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjpb\" (UniqueName: \"kubernetes.io/projected/530e025e-84fd-4838-8332-3501b879b39d-kube-api-access-5xjpb\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.069034 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.069039 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8hjx\" (UniqueName: \"kubernetes.io/projected/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-kube-api-access-z8hjx\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.069291 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.069066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-klusterlet-config\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.069291 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.069167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-tmp\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.069291 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.069199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/530e025e-84fd-4838-8332-3501b879b39d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.170134 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjpb\" (UniqueName: \"kubernetes.io/projected/530e025e-84fd-4838-8332-3501b879b39d-kube-api-access-5xjpb\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.170134 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170141 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8hjx\" (UniqueName: \"kubernetes.io/projected/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-kube-api-access-z8hjx\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.170419 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170164 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-klusterlet-config\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.170419 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-tmp\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.170419 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170230 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/530e025e-84fd-4838-8332-3501b879b39d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.170574 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.170538 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-tmp\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.172724 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.172692 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/530e025e-84fd-4838-8332-3501b879b39d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.172887 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.172866 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-klusterlet-config\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.177729 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.177705 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8hjx\" (UniqueName: \"kubernetes.io/projected/b29dac5f-df2a-4ec5-84be-f2cfbc02c62c-kube-api-access-z8hjx\") pod \"klusterlet-addon-workmgr-8685c7944d-t5gnq\" (UID: \"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.177938 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.177915 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjpb\" (UniqueName: \"kubernetes.io/projected/530e025e-84fd-4838-8332-3501b879b39d-kube-api-access-5xjpb\") pod \"managed-serviceaccount-addon-agent-6b85b4589b-46fqh\" (UID: \"530e025e-84fd-4838-8332-3501b879b39d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.258029 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.257956 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" Sep 13 20:14:37.264106 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.264071 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:37.528705 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.528602 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh"] Sep 13 20:14:37.531629 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.531601 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq"] Sep 13 20:14:37.532504 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:14:37.532483 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod530e025e_84fd_4838_8332_3501b879b39d.slice/crio-32d45c3a15f5f2e75cf6cc45612933b81c69cdd00bbf383a7b25886cc8b163df WatchSource:0}: Error finding container 32d45c3a15f5f2e75cf6cc45612933b81c69cdd00bbf383a7b25886cc8b163df: Status 404 returned error can't find the container with id 32d45c3a15f5f2e75cf6cc45612933b81c69cdd00bbf383a7b25886cc8b163df Sep 13 20:14:37.536078 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:14:37.536054 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29dac5f_df2a_4ec5_84be_f2cfbc02c62c.slice/crio-a7494897928eb40abbbea11cf2ebdb1c2cc2b1b7e31d0513db6bd6810caea525 WatchSource:0}: Error finding container a7494897928eb40abbbea11cf2ebdb1c2cc2b1b7e31d0513db6bd6810caea525: Status 404 returned error can't find the container with id a7494897928eb40abbbea11cf2ebdb1c2cc2b1b7e31d0513db6bd6810caea525 Sep 13 20:14:37.972550 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.972512 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" event={"ID":"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c","Type":"ContainerStarted","Data":"a7494897928eb40abbbea11cf2ebdb1c2cc2b1b7e31d0513db6bd6810caea525"} Sep 13 20:14:37.973618 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:37.973596 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" event={"ID":"530e025e-84fd-4838-8332-3501b879b39d","Type":"ContainerStarted","Data":"32d45c3a15f5f2e75cf6cc45612933b81c69cdd00bbf383a7b25886cc8b163df"} Sep 13 20:14:41.909167 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:41.909136 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-65vst" Sep 13 20:14:42.990166 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:42.990124 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" event={"ID":"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c","Type":"ContainerStarted","Data":"500c5d4339e10f801577abedef9a4a1dcd83206739ea56ec7f35128974ba972f"} Sep 13 20:14:42.990673 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:42.990281 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:42.991766 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:42.991737 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" event={"ID":"530e025e-84fd-4838-8332-3501b879b39d","Type":"ContainerStarted","Data":"8dbe8b7809012d7b2800702d2385c8ab36d29ff2ba4cbd5f81482f4cb8111fc3"} Sep 13 20:14:42.991924 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:42.991910 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:14:43.014677 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:43.014585 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" podStartSLOduration=1.7840538179999998 podStartE2EDuration="7.014569265s" totalImagesPullingTime="5.230515447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:43.013835015 +0000 UTC m=+103.070942789" watchObservedRunningTime="2026-09-13 20:14:43.014569265 +0000 UTC m=+103.071677038" Sep 13 20:14:43.014812 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:43.014658 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" podStartSLOduration=1.7684381230000001 podStartE2EDuration="7.014652131s" totalImagesPullingTime="5.246214008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:43.00268708 +0000 UTC m=+103.059794853" watchObservedRunningTime="2026-09-13 20:14:43.014652131 +0000 UTC m=+103.071759905" Sep 13 20:14:43.114817 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:14:43.114773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:14:43.114987 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:43.114886 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:14:43.114987 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:14:43.114947 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:15:47.114931799 +0000 UTC m=+167.172039551 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:15:09.102543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:15:09.102512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:15:09.102937 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:09.102644 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:15:09.102937 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:09.102703 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:11.102689638 +0000 UTC m=+251.159797390 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : secret "metrics-daemon-secret" not found Sep 13 20:15:42.250438 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:42.250342 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qqw6x" podUID="adf37eaa-5232-4fd6-9bcd-f30e038121e7" Sep 13 20:15:43.135905 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:15:43.135874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:15:43.554981 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:43.554882 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:15:47.169056 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:15:47.169022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:15:47.169459 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:47.169169 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:15:47.169459 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:15:47.169257 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls podName:adf37eaa-5232-4fd6-9bcd-f30e038121e7 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:49.169241382 +0000 UTC m=+289.226349135 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls") pod "dns-default-qqw6x" (UID: "adf37eaa-5232-4fd6-9bcd-f30e038121e7") : secret "dns-default-metrics-tls" not found Sep 13 20:15:56.528343 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:15:56.528264 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:16:34.929760 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:34.929683 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:16:42.991629 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:42.991577 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" podUID="b29dac5f-df2a-4ec5-84be-f2cfbc02c62c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Sep 13 20:16:43.283943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.283861 2552 generic.go:356] "Generic (PLEG): container finished" podID="b29dac5f-df2a-4ec5-84be-f2cfbc02c62c" containerID="500c5d4339e10f801577abedef9a4a1dcd83206739ea56ec7f35128974ba972f" exitCode=1 Sep 13 20:16:43.284086 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.283937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" event={"ID":"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c","Type":"ContainerDied","Data":"500c5d4339e10f801577abedef9a4a1dcd83206739ea56ec7f35128974ba972f"} Sep 13 20:16:43.284328 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.284311 2552 scope.go:117] "RemoveContainer" containerID="500c5d4339e10f801577abedef9a4a1dcd83206739ea56ec7f35128974ba972f" Sep 13 20:16:43.285486 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.285462 2552 generic.go:356] "Generic (PLEG): container finished" podID="530e025e-84fd-4838-8332-3501b879b39d" containerID="8dbe8b7809012d7b2800702d2385c8ab36d29ff2ba4cbd5f81482f4cb8111fc3" exitCode=255 Sep 13 20:16:43.285573 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.285514 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" event={"ID":"530e025e-84fd-4838-8332-3501b879b39d","Type":"ContainerDied","Data":"8dbe8b7809012d7b2800702d2385c8ab36d29ff2ba4cbd5f81482f4cb8111fc3"} Sep 13 20:16:43.291284 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:43.291267 2552 scope.go:117] "RemoveContainer" containerID="8dbe8b7809012d7b2800702d2385c8ab36d29ff2ba4cbd5f81482f4cb8111fc3" Sep 13 20:16:44.290230 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:44.290185 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" event={"ID":"b29dac5f-df2a-4ec5-84be-f2cfbc02c62c","Type":"ContainerStarted","Data":"881bdcdcff2a6ff668857baa95e7599b2180d906778930801d167e022b544d1a"} Sep 13 20:16:44.290703 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:44.290498 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:16:44.291174 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:44.291156 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8685c7944d-t5gnq" Sep 13 20:16:44.292079 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:16:44.292059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b85b4589b-46fqh" event={"ID":"530e025e-84fd-4838-8332-3501b879b39d","Type":"ContainerStarted","Data":"87a65e792bb42f32fdccc1666775c629920c85db6605efd111c96597d55cdce7"} Sep 13 20:17:08.387169 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.387135 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh"] Sep 13 20:17:08.390071 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.390055 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.392010 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.391981 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 13 20:17:08.392121 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.391986 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:17:08.392121 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.392061 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 13 20:17:08.392909 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.392883 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 13 20:17:08.393686 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.392943 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qwglh\"" Sep 13 20:17:08.394538 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.394516 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6wsm2"] Sep 13 20:17:08.398343 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.398323 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-cnhsh"] Sep 13 20:17:08.398466 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.398449 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.400305 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.400284 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 13 20:17:08.400398 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.400306 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:17:08.400707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.400663 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 13 20:17:08.400707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.400699 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 13 20:17:08.400851 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.400778 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-22xmk\"" Sep 13 20:17:08.401974 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.401954 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk"] Sep 13 20:17:08.402118 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.402099 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.404452 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.404435 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-r6f7d\"" Sep 13 20:17:08.404794 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.404718 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 13 20:17:08.404881 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.404870 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 13 20:17:08.404978 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.404959 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh"] Sep 13 20:17:08.405040 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.404989 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 13 20:17:08.405102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.405042 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.405490 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.405466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 13 20:17:08.407448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.407429 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 13 20:17:08.413626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.412052 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 13 20:17:08.413626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.412344 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 13 20:17:08.413626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.412623 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fp8d8\"" Sep 13 20:17:08.413626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.412926 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:17:08.417941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.417921 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-cnhsh"] Sep 13 20:17:08.418984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.418961 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk"] Sep 13 20:17:08.419195 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.419179 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 13 20:17:08.420225 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.420193 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6wsm2"] Sep 13 20:17:08.517802 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-config\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.517802 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517801 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-tmp\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c155be-6b92-4d6a-99e7-f7e3fd77923a-serving-cert\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-snapshots\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517922 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rnc8\" (UniqueName: \"kubernetes.io/projected/847a4ad7-2e78-4aaf-ac34-53527005f060-kube-api-access-8rnc8\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcw2\" (UniqueName: \"kubernetes.io/projected/02c155be-6b92-4d6a-99e7-f7e3fd77923a-kube-api-access-dzcw2\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.517998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9918ac4-0390-4193-925e-4f62703078c7-serving-cert\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-trusted-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518066 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-trusted-ca\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.518414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518079 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxq8k\" (UniqueName: \"kubernetes.io/projected/51aa038d-6cf8-43e0-af08-d0cc2a87c384-kube-api-access-pxq8k\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.518414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926sp\" (UniqueName: \"kubernetes.io/projected/b9918ac4-0390-4193-925e-4f62703078c7-kube-api-access-926sp\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.518414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-service-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/847a4ad7-2e78-4aaf-ac34-53527005f060-serving-cert\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.518414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.518181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9918ac4-0390-4193-925e-4f62703078c7-config\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.547348 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.547313 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:08.619384 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619350 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c155be-6b92-4d6a-99e7-f7e3fd77923a-serving-cert\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.619384 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-snapshots\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.619602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619410 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rnc8\" (UniqueName: \"kubernetes.io/projected/847a4ad7-2e78-4aaf-ac34-53527005f060-kube-api-access-8rnc8\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.619602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619451 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcw2\" (UniqueName: \"kubernetes.io/projected/02c155be-6b92-4d6a-99e7-f7e3fd77923a-kube-api-access-dzcw2\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.619602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9918ac4-0390-4193-925e-4f62703078c7-serving-cert\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.619751 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-trusted-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.619751 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-trusted-ca\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.619858 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619749 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxq8k\" (UniqueName: \"kubernetes.io/projected/51aa038d-6cf8-43e0-af08-d0cc2a87c384-kube-api-access-pxq8k\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.619858 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926sp\" (UniqueName: \"kubernetes.io/projected/b9918ac4-0390-4193-925e-4f62703078c7-kube-api-access-926sp\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.619858 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-service-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.619858 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.619824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/847a4ad7-2e78-4aaf-ac34-53527005f060-serving-cert\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620205 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620176 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-snapshots\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620320 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620297 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9918ac4-0390-4193-925e-4f62703078c7-config\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.620384 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-config\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.620442 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620384 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.620442 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-tmp\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620547 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620439 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-service-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620806 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620702 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a4ad7-2e78-4aaf-ac34-53527005f060-tmp\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620806 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620722 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/847a4ad7-2e78-4aaf-ac34-53527005f060-trusted-ca-bundle\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.620806 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:08.620791 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:17:08.620999 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:08.620868 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls podName:51aa038d-6cf8-43e0-af08-d0cc2a87c384 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:09.120846454 +0000 UTC m=+249.177954206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s4ttk" (UID: "51aa038d-6cf8-43e0-af08-d0cc2a87c384") : secret "samples-operator-tls" not found Sep 13 20:17:08.620999 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620887 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9918ac4-0390-4193-925e-4f62703078c7-config\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.620999 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.620913 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-trusted-ca\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.621281 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.621255 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02c155be-6b92-4d6a-99e7-f7e3fd77923a-config\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.622071 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.622048 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02c155be-6b92-4d6a-99e7-f7e3fd77923a-serving-cert\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.622458 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.622436 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/847a4ad7-2e78-4aaf-ac34-53527005f060-serving-cert\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.622648 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.622631 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9918ac4-0390-4193-925e-4f62703078c7-serving-cert\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.626654 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.626628 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rnc8\" (UniqueName: \"kubernetes.io/projected/847a4ad7-2e78-4aaf-ac34-53527005f060-kube-api-access-8rnc8\") pod \"insights-operator-5844b856db-cnhsh\" (UID: \"847a4ad7-2e78-4aaf-ac34-53527005f060\") " pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.626931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.626906 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxq8k\" (UniqueName: \"kubernetes.io/projected/51aa038d-6cf8-43e0-af08-d0cc2a87c384-kube-api-access-pxq8k\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:08.627042 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.627024 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926sp\" (UniqueName: \"kubernetes.io/projected/b9918ac4-0390-4193-925e-4f62703078c7-kube-api-access-926sp\") pod \"service-ca-operator-cf7c776b7-92mlh\" (UID: \"b9918ac4-0390-4193-925e-4f62703078c7\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.627096 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.627062 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcw2\" (UniqueName: \"kubernetes.io/projected/02c155be-6b92-4d6a-99e7-f7e3fd77923a-kube-api-access-dzcw2\") pod \"console-operator-696884fb9c-6wsm2\" (UID: \"02c155be-6b92-4d6a-99e7-f7e3fd77923a\") " pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.647927 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.647867 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:08.699901 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.699874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" Sep 13 20:17:08.711100 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.711075 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:08.718818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.718795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-cnhsh" Sep 13 20:17:08.970517 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.970439 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh"] Sep 13 20:17:08.973525 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:08.973500 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9918ac4_0390_4193_925e_4f62703078c7.slice/crio-8000e4c71cf973c2985c91b58088b6632746c529dc2c9058b35306570facaf11 WatchSource:0}: Error finding container 8000e4c71cf973c2985c91b58088b6632746c529dc2c9058b35306570facaf11: Status 404 returned error can't find the container with id 8000e4c71cf973c2985c91b58088b6632746c529dc2c9058b35306570facaf11 Sep 13 20:17:08.998637 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:08.998596 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6wsm2"] Sep 13 20:17:09.001670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:09.001646 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-cnhsh"] Sep 13 20:17:09.002991 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:09.002969 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c155be_6b92_4d6a_99e7_f7e3fd77923a.slice/crio-40d4e5bc8e664a3321708c8bc363ec80556ed4f322a9c88687de1903bed07acd WatchSource:0}: Error finding container 40d4e5bc8e664a3321708c8bc363ec80556ed4f322a9c88687de1903bed07acd: Status 404 returned error can't find the container with id 40d4e5bc8e664a3321708c8bc363ec80556ed4f322a9c88687de1903bed07acd Sep 13 20:17:09.004468 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:09.004450 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847a4ad7_2e78_4aaf_ac34_53527005f060.slice/crio-4ae42f1491a912f5aef24093a748ef6d3972e03c7ad2a61910b06f944fd45a31 WatchSource:0}: Error finding container 4ae42f1491a912f5aef24093a748ef6d3972e03c7ad2a61910b06f944fd45a31: Status 404 returned error can't find the container with id 4ae42f1491a912f5aef24093a748ef6d3972e03c7ad2a61910b06f944fd45a31 Sep 13 20:17:09.123944 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:09.123910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:09.124106 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:09.124014 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:17:09.124106 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:09.124064 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls podName:51aa038d-6cf8-43e0-af08-d0cc2a87c384 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:10.124049599 +0000 UTC m=+250.181157351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s4ttk" (UID: "51aa038d-6cf8-43e0-af08-d0cc2a87c384") : secret "samples-operator-tls" not found Sep 13 20:17:09.366166 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:09.366132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-cnhsh" event={"ID":"847a4ad7-2e78-4aaf-ac34-53527005f060","Type":"ContainerStarted","Data":"4ae42f1491a912f5aef24093a748ef6d3972e03c7ad2a61910b06f944fd45a31"} Sep 13 20:17:09.367195 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:09.367168 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" event={"ID":"02c155be-6b92-4d6a-99e7-f7e3fd77923a","Type":"ContainerStarted","Data":"40d4e5bc8e664a3321708c8bc363ec80556ed4f322a9c88687de1903bed07acd"} Sep 13 20:17:09.368245 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:09.368207 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" event={"ID":"b9918ac4-0390-4193-925e-4f62703078c7","Type":"ContainerStarted","Data":"8000e4c71cf973c2985c91b58088b6632746c529dc2c9058b35306570facaf11"} Sep 13 20:17:10.132626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:10.131978 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:10.132626 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:10.132185 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:17:10.132626 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:10.132273 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls podName:51aa038d-6cf8-43e0-af08-d0cc2a87c384 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:12.132253001 +0000 UTC m=+252.189360758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s4ttk" (UID: "51aa038d-6cf8-43e0-af08-d0cc2a87c384") : secret "samples-operator-tls" not found Sep 13 20:17:11.142977 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.142940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:17:11.143396 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:11.143094 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:17:11.143396 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:11.143164 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs podName:8d579d23-826f-42e1-bdce-8bcc78ce62dd nodeName:}" failed. No retries permitted until 2026-09-13 20:19:13.143148296 +0000 UTC m=+373.200256054 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs") pod "network-metrics-daemon-cl629" (UID: "8d579d23-826f-42e1-bdce-8bcc78ce62dd") : secret "metrics-daemon-secret" not found Sep 13 20:17:11.276351 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.276310 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:11.326938 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.326898 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:11.737809 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.737755 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:11.838468 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.838420 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:11.891975 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:11.891946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:12.149923 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.149898 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:12.150291 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:12.150049 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:17:12.150291 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:12.150128 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls podName:51aa038d-6cf8-43e0-af08-d0cc2a87c384 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:16.15010777 +0000 UTC m=+256.207215526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s4ttk" (UID: "51aa038d-6cf8-43e0-af08-d0cc2a87c384") : secret "samples-operator-tls" not found Sep 13 20:17:12.380374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.380340 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-cnhsh" event={"ID":"847a4ad7-2e78-4aaf-ac34-53527005f060","Type":"ContainerStarted","Data":"de72626a1fe1032f733a230c905fb7bfaeaa5ff8e37fdb79e0560544d482ce40"} Sep 13 20:17:12.382127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.382107 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/0.log" Sep 13 20:17:12.382276 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.382143 2552 generic.go:356] "Generic (PLEG): container finished" podID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" containerID="b256622368bc39e74c5bce63f2b7473a60b0d3a751b82349c2c7a73bf60e014e" exitCode=255 Sep 13 20:17:12.382276 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.382232 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" event={"ID":"02c155be-6b92-4d6a-99e7-f7e3fd77923a","Type":"ContainerDied","Data":"b256622368bc39e74c5bce63f2b7473a60b0d3a751b82349c2c7a73bf60e014e"} Sep 13 20:17:12.382430 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.382411 2552 scope.go:117] "RemoveContainer" containerID="b256622368bc39e74c5bce63f2b7473a60b0d3a751b82349c2c7a73bf60e014e" Sep 13 20:17:12.383925 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.383905 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" event={"ID":"b9918ac4-0390-4193-925e-4f62703078c7","Type":"ContainerStarted","Data":"552e21b2d7cb29382183198b9387f3bdc8a0db9afbb4fd22ae74ba315906b545"} Sep 13 20:17:12.394535 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.394489 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-cnhsh" podStartSLOduration=1.315528549 podStartE2EDuration="4.394471934s" totalImagesPullingTime="3.078943385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:12.39374031 +0000 UTC m=+252.450848085" watchObservedRunningTime="2026-09-13 20:17:12.394471934 +0000 UTC m=+252.451579704" Sep 13 20:17:12.422048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:12.421994 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" podStartSLOduration=1.30716164 podStartE2EDuration="4.421972443s" totalImagesPullingTime="3.114810803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:12.406479161 +0000 UTC m=+252.463586937" watchObservedRunningTime="2026-09-13 20:17:12.421972443 +0000 UTC m=+252.479080216" Sep 13 20:17:13.388745 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.388672 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/1.log" Sep 13 20:17:13.389124 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.389108 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/0.log" Sep 13 20:17:13.389171 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.389144 2552 generic.go:356] "Generic (PLEG): container finished" podID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" exitCode=255 Sep 13 20:17:13.389286 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.389259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" event={"ID":"02c155be-6b92-4d6a-99e7-f7e3fd77923a","Type":"ContainerDied","Data":"66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168"} Sep 13 20:17:13.390172 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.390153 2552 scope.go:117] "RemoveContainer" containerID="b256622368bc39e74c5bce63f2b7473a60b0d3a751b82349c2c7a73bf60e014e" Sep 13 20:17:13.390272 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.390240 2552 scope.go:117] "RemoveContainer" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" Sep 13 20:17:13.390365 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:13.390350 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:13.474544 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.474495 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:13.576254 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.576189 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:13.592471 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.592444 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vkjjb"] Sep 13 20:17:13.596718 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.596696 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.598728 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.598705 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 13 20:17:13.598866 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.598770 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wx957\"" Sep 13 20:17:13.599021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.599003 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 13 20:17:13.606552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.606533 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vkjjb"] Sep 13 20:17:13.637728 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.637696 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:13.664787 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.664722 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.664787 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.664766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31340230-69dd-40ed-a553-c81cde570ddd-crio-socket\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.664946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.664798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh55p\" (UniqueName: \"kubernetes.io/projected/31340230-69dd-40ed-a553-c81cde570ddd-kube-api-access-sh55p\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.664946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.664847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31340230-69dd-40ed-a553-c81cde570ddd-data-volume\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.664946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.664868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765452 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765605 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765518 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765605 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765558 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31340230-69dd-40ed-a553-c81cde570ddd-crio-socket\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765605 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:13.765575 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:13.765605 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765586 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh55p\" (UniqueName: \"kubernetes.io/projected/31340230-69dd-40ed-a553-c81cde570ddd-kube-api-access-sh55p\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31340230-69dd-40ed-a553-c81cde570ddd-data-volume\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765778 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:13.765642 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:14.265620786 +0000 UTC m=+254.322728558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:13.765778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765664 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31340230-69dd-40ed-a553-c81cde570ddd-crio-socket\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.765778 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:13.765731 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:13.765946 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:13.765783 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:14.265770954 +0000 UTC m=+254.322878705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : configmap "kube-rbac-proxy" not found Sep 13 20:17:13.765999 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.765947 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31340230-69dd-40ed-a553-c81cde570ddd-data-volume\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.775111 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.775086 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh55p\" (UniqueName: \"kubernetes.io/projected/31340230-69dd-40ed-a553-c81cde570ddd-kube-api-access-sh55p\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:13.906173 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:13.906137 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:14.006874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.006784 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:14.266131 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.266051 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:14.269946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.269924 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:14.270065 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.270023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:14.270127 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:14.270067 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:14.270127 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:14.270126 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:15.270111673 +0000 UTC m=+255.327219430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:14.270244 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:14.270124 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:14.270244 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:14.270189 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:15.270171852 +0000 UTC m=+255.327279610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : configmap "kube-rbac-proxy" not found Sep 13 20:17:14.366114 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.366061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:14.393920 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.393895 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/1.log" Sep 13 20:17:14.394282 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:14.394239 2552 scope.go:117] "RemoveContainer" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" Sep 13 20:17:14.394404 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:14.394387 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:15.275247 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:15.275192 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:15.275471 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:15.275354 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:15.275471 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:15.275377 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:15.275471 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:15.275436 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:17.275416105 +0000 UTC m=+257.332523858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : configmap "kube-rbac-proxy" not found Sep 13 20:17:15.275614 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:15.275482 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:15.275614 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:15.275522 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:17.275511236 +0000 UTC m=+257.332618988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:15.812457 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:15.812418 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:15.862497 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:15.862459 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:16.181539 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:16.181503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:16.181702 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:16.181630 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 13 20:17:16.181702 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:16.181687 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls podName:51aa038d-6cf8-43e0-af08-d0cc2a87c384 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:24.181673609 +0000 UTC m=+264.238781360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-s4ttk" (UID: "51aa038d-6cf8-43e0-af08-d0cc2a87c384") : secret "samples-operator-tls" not found Sep 13 20:17:16.558611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:16.558537 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-txg5f_2ebeedaf-987e-4115-bd68-a91831c60851/dns-node-resolver/0.log" Sep 13 20:17:16.627402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:16.627365 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:17.159584 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:17.159557 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55hxr_8fba836b-de7b-4c89-a6d3-15a67df7bfc1/node-ca/0.log" Sep 13 20:17:17.289148 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:17.289110 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:17.289374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:17.289180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:17.289374 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:17.289246 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:17.289374 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:17.289308 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:21.289291279 +0000 UTC m=+261.346399035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : configmap "kube-rbac-proxy" not found Sep 13 20:17:17.289374 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:17.289310 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:17.289374 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:17.289360 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:21.289345896 +0000 UTC m=+261.346453648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:17.958668 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:17.958632 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkjsq_dcad819b-8440-46b2-979e-e091d1f1e09b/serve-healthcheck-canary/0.log" Sep 13 20:17:18.712182 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:18.712141 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:18.712576 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:18.712207 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:18.712576 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:18.712518 2552 scope.go:117] "RemoveContainer" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" Sep 13 20:17:18.712671 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:18.712654 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:19.151989 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.151956 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.273631 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.273594 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.373637 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.373594 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.479412 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.479332 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.576572 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.576544 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.677644 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.677613 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:19.849528 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:19.849494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:20.845441 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:20.845402 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:21.045534 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:21.045502 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:21.246115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:21.246085 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:21.322444 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:21.322402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:21.322631 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:21.322475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:21.322631 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:21.322525 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:21.322631 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:21.322597 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:29.322581244 +0000 UTC m=+269.379688995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : configmap "kube-rbac-proxy" not found Sep 13 20:17:21.322631 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:21.322616 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:21.322772 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:21.322672 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls podName:31340230-69dd-40ed-a553-c81cde570ddd nodeName:}" failed. No retries permitted until 2026-09-13 20:17:29.322658714 +0000 UTC m=+269.379766465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vkjjb" (UID: "31340230-69dd-40ed-a553-c81cde570ddd") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:21.647578 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:21.647548 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:22.050965 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:22.050868 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:22.645475 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:22.645443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:22.816844 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:22.816764 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.029896 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.029803 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.079697 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.079663 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.445984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.445955 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.684488 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.684447 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.858774 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.858736 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:23.908042 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:23.908014 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:24.048309 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.048257 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:24.244826 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.244743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:24.247025 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.246994 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51aa038d-6cf8-43e0-af08-d0cc2a87c384-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-s4ttk\" (UID: \"51aa038d-6cf8-43e0-af08-d0cc2a87c384\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:24.325505 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.325475 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" Sep 13 20:17:24.593420 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.593342 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk"] Sep 13 20:17:24.849620 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.849578 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:24.952136 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:24.952097 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.266038 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.265936 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.428599 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.428559 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" event={"ID":"51aa038d-6cf8-43e0-af08-d0cc2a87c384","Type":"ContainerStarted","Data":"8d54cf0aa6c754d28ef0c6961fec551be93885a63c6243262d461de1b99af6bf"} Sep 13 20:17:25.449412 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.449373 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.651532 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.651480 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.702891 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.702856 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.846824 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.846789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.948191 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.948079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:25.995563 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:25.995528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:26.432609 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:26.432584 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" event={"ID":"51aa038d-6cf8-43e0-af08-d0cc2a87c384","Type":"ContainerStarted","Data":"62194b3406aa97f7e446bcde40b7342f3edd3948465ea9b9ee0b12c00301704b"} Sep 13 20:17:26.843742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:26.843646 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:27.046042 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:27.046012 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:27.437069 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:27.437027 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" event={"ID":"51aa038d-6cf8-43e0-af08-d0cc2a87c384","Type":"ContainerStarted","Data":"deb61bcc90a02b4859e705ca47fe097af30ee7359d086fcf9fe3ad72eb5635ef"} Sep 13 20:17:27.443546 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:27.443521 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:27.452736 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:27.452698 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-s4ttk" podStartSLOduration=17.716070914 podStartE2EDuration="19.452685808s" totalImagesPullingTime="1.736614894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:27.452558351 +0000 UTC m=+267.509666124" watchObservedRunningTime="2026-09-13 20:17:27.452685808 +0000 UTC m=+267.509793573" Sep 13 20:17:27.644740 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:27.644702 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:28.043623 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:28.043594 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:28.643978 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:28.643947 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:29.047372 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.047289 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:29.387460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.387426 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:29.387617 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.387483 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:29.387993 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.387965 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31340230-69dd-40ed-a553-c81cde570ddd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:29.389732 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.389708 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31340230-69dd-40ed-a553-c81cde570ddd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vkjjb\" (UID: \"31340230-69dd-40ed-a553-c81cde570ddd\") " pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:29.443402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.443364 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:29.505455 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.505430 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vkjjb" Sep 13 20:17:29.646068 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.645969 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:29.770484 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.770447 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vkjjb"] Sep 13 20:17:29.774115 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:29.774094 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31340230_69dd_40ed_a553_c81cde570ddd.slice/crio-90b11e687e56d1628d91be2dc32c2b1f7e0a9afa5ffc90519751bd3f704d26b4 WatchSource:0}: Error finding container 90b11e687e56d1628d91be2dc32c2b1f7e0a9afa5ffc90519751bd3f704d26b4: Status 404 returned error can't find the container with id 90b11e687e56d1628d91be2dc32c2b1f7e0a9afa5ffc90519751bd3f704d26b4 Sep 13 20:17:29.852199 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:29.852151 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:30.447927 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:30.447895 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkjjb" event={"ID":"31340230-69dd-40ed-a553-c81cde570ddd","Type":"ContainerStarted","Data":"19bf5e8da3b5798a54a6569dba9df8c2ee333693078911fd5f2709d0df59575f"} Sep 13 20:17:30.448091 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:30.447953 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkjjb" event={"ID":"31340230-69dd-40ed-a553-c81cde570ddd","Type":"ContainerStarted","Data":"90b11e687e56d1628d91be2dc32c2b1f7e0a9afa5ffc90519751bd3f704d26b4"} Sep 13 20:17:31.455103 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:31.455070 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkjjb" event={"ID":"31340230-69dd-40ed-a553-c81cde570ddd","Type":"ContainerStarted","Data":"bd41940d0833e9806bc90eeabafde0213a7de19cae86da2ee2bd58776b591bf7"} Sep 13 20:17:32.459544 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:32.459506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vkjjb" event={"ID":"31340230-69dd-40ed-a553-c81cde570ddd","Type":"ContainerStarted","Data":"ca5019a50e20a711b77613d3ba9296c7c859516c25c9de40f5eb5669e8d83ae3"} Sep 13 20:17:32.477299 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:32.477244 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vkjjb" podStartSLOduration=17.338597863 podStartE2EDuration="19.477227472s" totalImagesPullingTime="2.138629609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:17:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:32.476825985 +0000 UTC m=+272.533933760" watchObservedRunningTime="2026-09-13 20:17:32.477227472 +0000 UTC m=+272.534335236" Sep 13 20:17:33.527488 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:33.527457 2552 scope.go:117] "RemoveContainer" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" Sep 13 20:17:34.466985 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.466955 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:17:34.467370 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.467352 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/1.log" Sep 13 20:17:34.467471 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.467389 2552 generic.go:356] "Generic (PLEG): container finished" podID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" containerID="a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109" exitCode=255 Sep 13 20:17:34.467471 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.467455 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" event={"ID":"02c155be-6b92-4d6a-99e7-f7e3fd77923a","Type":"ContainerDied","Data":"a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109"} Sep 13 20:17:34.467585 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.467514 2552 scope.go:117] "RemoveContainer" containerID="66ce9099003871552b730aad5f97b33de04b140cb4acef72d618997ce1c00168" Sep 13 20:17:34.467851 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:34.467834 2552 scope.go:117] "RemoveContainer" containerID="a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109" Sep 13 20:17:34.468025 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:34.468008 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:35.471831 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:35.471803 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:17:38.712034 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.711996 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:38.712456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.712081 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:17:38.712456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.712411 2552 scope.go:117] "RemoveContainer" containerID="a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109" Sep 13 20:17:38.712591 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:38.712571 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:38.798582 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.798546 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c6b49954-286m4"] Sep 13 20:17:38.803821 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.803795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.805729 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.805698 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 13 20:17:38.805850 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.805790 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 13 20:17:38.805912 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.805858 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 13 20:17:38.806076 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.806056 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zlk89\"" Sep 13 20:17:38.810464 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.810335 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 13 20:17:38.815086 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.815049 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c6b49954-286m4"] Sep 13 20:17:38.848785 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.848750 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:38.947550 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.947510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:38.963132 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963060 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-certificates\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963132 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963093 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-tls\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963142 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-image-registry-private-configuration\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b7a8d4-bed4-4926-ad4f-0805dc800292-ca-trust-extracted\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963200 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-trusted-ca\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963258 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-installation-pull-secrets\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963344 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxds\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-kube-api-access-8zxds\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:38.963561 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:38.963360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-bound-sa-token\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064677 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-certificates\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064677 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-tls\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064721 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-image-registry-private-configuration\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064752 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b7a8d4-bed4-4926-ad4f-0805dc800292-ca-trust-extracted\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-trusted-ca\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-installation-pull-secrets\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.064880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064867 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxds\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-kube-api-access-8zxds\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.065103 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.064923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-bound-sa-token\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.065292 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.065262 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b7a8d4-bed4-4926-ad4f-0805dc800292-ca-trust-extracted\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.065595 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.065574 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-certificates\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.065693 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.065671 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b7a8d4-bed4-4926-ad4f-0805dc800292-trusted-ca\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.067305 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.067283 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-registry-tls\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.067391 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.067337 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-installation-pull-secrets\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.067456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.067406 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b7a8d4-bed4-4926-ad4f-0805dc800292-image-registry-private-configuration\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.071533 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.071512 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-bound-sa-token\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.071720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.071697 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxds\" (UniqueName: \"kubernetes.io/projected/77b7a8d4-bed4-4926-ad4f-0805dc800292-kube-api-access-8zxds\") pod \"image-registry-59c6b49954-286m4\" (UID: \"77b7a8d4-bed4-4926-ad4f-0805dc800292\") " pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.113084 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.113052 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.382255 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.382102 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c6b49954-286m4"] Sep 13 20:17:39.384511 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:39.384483 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b7a8d4_bed4_4926_ad4f_0805dc800292.slice/crio-e4aef2fbdf1667fd170c366d7767e79a82eda70023cf6f1d8143e2465be87051 WatchSource:0}: Error finding container e4aef2fbdf1667fd170c366d7767e79a82eda70023cf6f1d8143e2465be87051: Status 404 returned error can't find the container with id e4aef2fbdf1667fd170c366d7767e79a82eda70023cf6f1d8143e2465be87051 Sep 13 20:17:39.486295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.486266 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6b49954-286m4" event={"ID":"77b7a8d4-bed4-4926-ad4f-0805dc800292","Type":"ContainerStarted","Data":"7db2fe1d424dd571b4322059245d9a81163ae9632f670f999d0564a427e608a5"} Sep 13 20:17:39.486496 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.486319 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c6b49954-286m4" event={"ID":"77b7a8d4-bed4-4926-ad4f-0805dc800292","Type":"ContainerStarted","Data":"e4aef2fbdf1667fd170c366d7767e79a82eda70023cf6f1d8143e2465be87051"} Sep 13 20:17:39.486496 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.486415 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:17:39.503330 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:39.503285 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c6b49954-286m4" podStartSLOduration=1.503269429 podStartE2EDuration="1.503269429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:39.502031882 +0000 UTC m=+279.559139658" watchObservedRunningTime="2026-09-13 20:17:39.503269429 +0000 UTC m=+279.560377229" Sep 13 20:17:42.946493 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:42.946459 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:43.047459 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:43.047419 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:43.107091 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:43.107062 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:43.603163 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:43.603131 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:46.123080 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:46.123041 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:46.137047 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:46.137021 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qqw6x" podUID="adf37eaa-5232-4fd6-9bcd-f30e038121e7" Sep 13 20:17:46.186963 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:46.186927 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:46.302050 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:46.302021 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:46.506987 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:46.506893 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:17:48.257782 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:48.257748 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:49.243147 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.243100 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:17:49.245445 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.245411 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/adf37eaa-5232-4fd6-9bcd-f30e038121e7-metrics-tls\") pod \"dns-default-qqw6x\" (UID: \"adf37eaa-5232-4fd6-9bcd-f30e038121e7\") " pod="openshift-dns/dns-default-qqw6x" Sep 13 20:17:49.509943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.509863 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fnqc\"" Sep 13 20:17:49.518626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.518583 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:17:49.720925 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.720885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:49.786171 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:49.786146 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qqw6x"] Sep 13 20:17:49.788753 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:49.788723 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf37eaa_5232_4fd6_9bcd_f30e038121e7.slice/crio-11e8230045fc8b7597e85b87018839b4ce2efb199a4805da2c294718da60851d WatchSource:0}: Error finding container 11e8230045fc8b7597e85b87018839b4ce2efb199a4805da2c294718da60851d: Status 404 returned error can't find the container with id 11e8230045fc8b7597e85b87018839b4ce2efb199a4805da2c294718da60851d Sep 13 20:17:50.519887 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.519853 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gpnz4"] Sep 13 20:17:50.522318 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.522289 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.524242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.524194 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 13 20:17:50.524560 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.524497 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 13 20:17:50.524689 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.524563 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 13 20:17:50.525450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.525191 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 13 20:17:50.525450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.525249 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hkdjk\"" Sep 13 20:17:50.525450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.525269 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 13 20:17:50.525450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.525295 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 13 20:17:50.525879 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.525843 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqw6x" event={"ID":"adf37eaa-5232-4fd6-9bcd-f30e038121e7","Type":"ContainerStarted","Data":"11e8230045fc8b7597e85b87018839b4ce2efb199a4805da2c294718da60851d"} Sep 13 20:17:50.654375 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654338 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6mm\" (UniqueName: \"kubernetes.io/projected/50243467-0613-4730-a475-e5e24034289e-kube-api-access-xd6mm\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654375 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-sys\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654475 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654534 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50243467-0613-4730-a475-e5e24034289e-node-exporter-textfile\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654559 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-metrics-client-ca\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654607 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-root\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654806 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-tls\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.654806 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.654646 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-node-exporter-wtmp\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.755808 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-root\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.755808 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755811 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-tls\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-node-exporter-wtmp\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6mm\" (UniqueName: \"kubernetes.io/projected/50243467-0613-4730-a475-e5e24034289e-kube-api-access-xd6mm\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755897 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-sys\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755903 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-root\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.755970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50243467-0613-4730-a475-e5e24034289e-node-exporter-textfile\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756045 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756102 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-metrics-client-ca\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756531 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756381 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-node-exporter-wtmp\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756531 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756449 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50243467-0613-4730-a475-e5e24034289e-sys\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756767 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756720 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-metrics-client-ca\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756893 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756801 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50243467-0613-4730-a475-e5e24034289e-node-exporter-textfile\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.756956 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.756906 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50243467-0613-4730-a475-e5e24034289e-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.759135 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.759109 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.759286 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.759260 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50243467-0613-4730-a475-e5e24034289e-node-exporter-tls\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.764532 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.764506 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6mm\" (UniqueName: \"kubernetes.io/projected/50243467-0613-4730-a475-e5e24034289e-kube-api-access-xd6mm\") pod \"node-exporter-gpnz4\" (UID: \"50243467-0613-4730-a475-e5e24034289e\") " pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.834545 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:50.834459 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpnz4" Sep 13 20:17:50.844470 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:50.844439 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50243467_0613_4730_a475_e5e24034289e.slice/crio-b12b3e0183736d223fe1438ae2881e64d3ab8b19085e3aeb3a7f4d829ec5ad38 WatchSource:0}: Error finding container b12b3e0183736d223fe1438ae2881e64d3ab8b19085e3aeb3a7f4d829ec5ad38: Status 404 returned error can't find the container with id b12b3e0183736d223fe1438ae2881e64d3ab8b19085e3aeb3a7f4d829ec5ad38 Sep 13 20:17:51.093476 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.093381 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:51.485790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.485697 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:51.531604 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.531573 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqw6x" event={"ID":"adf37eaa-5232-4fd6-9bcd-f30e038121e7","Type":"ContainerStarted","Data":"4a3f00027c86a7b6c5f8f03673ee8d2f0cdc5239d6b7172b55637ee4d2219bf6"} Sep 13 20:17:51.533011 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.532988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpnz4" event={"ID":"50243467-0613-4730-a475-e5e24034289e","Type":"ContainerStarted","Data":"b12b3e0183736d223fe1438ae2881e64d3ab8b19085e3aeb3a7f4d829ec5ad38"} Sep 13 20:17:51.579601 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.579564 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:51.635352 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:51.635317 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:52.536998 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:52.536967 2552 generic.go:356] "Generic (PLEG): container finished" podID="50243467-0613-4730-a475-e5e24034289e" containerID="10cbbd50f0a580ff1f9eaa46b4e79b3ab74c6858aa401c05da547d3c3cbe780e" exitCode=0 Sep 13 20:17:52.537470 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:52.537048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpnz4" event={"ID":"50243467-0613-4730-a475-e5e24034289e","Type":"ContainerDied","Data":"10cbbd50f0a580ff1f9eaa46b4e79b3ab74c6858aa401c05da547d3c3cbe780e"} Sep 13 20:17:52.538878 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:52.538857 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qqw6x" event={"ID":"adf37eaa-5232-4fd6-9bcd-f30e038121e7","Type":"ContainerStarted","Data":"c9f8063a2654859e9ff970ba5ae7ecf9eaa3900085d2a8b0874fdc7b1e36e6c8"} Sep 13 20:17:52.539008 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:52.538996 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:17:52.572079 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:52.572018 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qqw6x" podStartSLOduration=252.020932019 podStartE2EDuration="4m13.571996468s" totalImagesPullingTime="1.551064449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:52.570090074 +0000 UTC m=+292.627197848" watchObservedRunningTime="2026-09-13 20:17:52.571996468 +0000 UTC m=+292.629104244" Sep 13 20:17:53.423141 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.423105 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:53.483288 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.483252 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:53.486804 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.486781 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-657cb8474-s86dc"] Sep 13 20:17:53.490281 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.490264 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492477 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492495 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492525 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492483 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zhb2f\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492496 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7qbmknmvn0iod\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492575 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 13 20:17:53.492742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.492482 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 13 20:17:53.500540 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.500519 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-657cb8474-s86dc"] Sep 13 20:17:53.528360 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.528332 2552 scope.go:117] "RemoveContainer" containerID="a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109" Sep 13 20:17:53.528593 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:53.528568 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6wsm2_openshift-console-operator(02c155be-6b92-4d6a-99e7-f7e3fd77923a)\"" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" Sep 13 20:17:53.545374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.545336 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpnz4" event={"ID":"50243467-0613-4730-a475-e5e24034289e","Type":"ContainerStarted","Data":"269f5a7a9d9d116091661cd024eebf37d95f66da28d023449e223ece25863103"} Sep 13 20:17:53.545811 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.545406 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpnz4" event={"ID":"50243467-0613-4730-a475-e5e24034289e","Type":"ContainerStarted","Data":"48d38a10381a7aa49daf37c114fc4856039d247f489d826892e466930edca00d"} Sep 13 20:17:53.576136 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.576085 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gpnz4" podStartSLOduration=2.476461811 podStartE2EDuration="3.576067387s" totalImagesPullingTime="1.037408392s" totalInitContainerRuntime="62.197184ms" isStatefulPod=true podCreationTimestamp="2026-09-13 20:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:53.575304799 +0000 UTC m=+293.632412568" watchObservedRunningTime="2026-09-13 20:17:53.576067387 +0000 UTC m=+293.633175160" Sep 13 20:17:53.678205 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.678128 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:53.680931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.680909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.680945 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-grpc-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.680977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-metrics-client-ca\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681021 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.681014 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.681048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.681080 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmdf\" (UniqueName: \"kubernetes.io/projected/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-kube-api-access-hrmdf\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.681108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.681231 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.681127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781493 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781557 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-grpc-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781579 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-metrics-client-ca\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781860 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781697 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781860 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.781860 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.781852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmdf\" (UniqueName: \"kubernetes.io/projected/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-kube-api-access-hrmdf\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.782455 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.782416 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-metrics-client-ca\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.784548 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.784492 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.784681 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.784548 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.784681 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.784650 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.784952 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.784932 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.785151 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.785125 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.785314 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.785297 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-secret-grpc-tls\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.789822 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.789802 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmdf\" (UniqueName: \"kubernetes.io/projected/6b2fb5bd-7f26-4707-9c59-de2ab2cc9370-kube-api-access-hrmdf\") pod \"thanos-querier-657cb8474-s86dc\" (UID: \"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370\") " pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.799690 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.799666 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:53.887011 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:53.886973 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:54.076249 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:54.076157 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-657cb8474-s86dc"] Sep 13 20:17:54.080109 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:54.080079 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2fb5bd_7f26_4707_9c59_de2ab2cc9370.slice/crio-0d88eaf2530ecd0c8c974d5a7eee45fc6825a5e9ddb8174ef5381406b0601733 WatchSource:0}: Error finding container 0d88eaf2530ecd0c8c974d5a7eee45fc6825a5e9ddb8174ef5381406b0601733: Status 404 returned error can't find the container with id 0d88eaf2530ecd0c8c974d5a7eee45fc6825a5e9ddb8174ef5381406b0601733 Sep 13 20:17:54.549798 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:54.549762 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"0d88eaf2530ecd0c8c974d5a7eee45fc6825a5e9ddb8174ef5381406b0601733"} Sep 13 20:17:55.282294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.282262 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h"] Sep 13 20:17:55.284130 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.284080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.285660 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.285637 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.287595 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.287575 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 13 20:17:55.287685 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.287669 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7qlb6\"" Sep 13 20:17:55.294845 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.294817 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h"] Sep 13 20:17:55.295263 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.295233 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.295374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.295306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2vh\" (UniqueName: \"kubernetes.io/projected/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-kube-api-access-dn2vh\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.382314 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.382280 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.395645 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.395622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.395779 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.395672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2vh\" (UniqueName: \"kubernetes.io/projected/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-kube-api-access-dn2vh\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.400855 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.400834 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.403314 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.403287 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2vh\" (UniqueName: \"kubernetes.io/projected/0afad5f8-e7db-4ba6-b12c-b1d56b9b2994-kube-api-access-dn2vh\") pod \"monitoring-plugin-5d85778b9d-tpt5h\" (UID: \"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.494555 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.494517 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.593629 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.593542 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.597444 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.597422 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:55.694935 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.694896 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.791729 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.791692 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:55.870153 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:55.870119 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h"] Sep 13 20:17:56.223820 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:56.223743 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afad5f8_e7db_4ba6_b12c_b1d56b9b2994.slice/crio-346515ff6a8c5e56296e439f3ae8955c73d10b65c930ad7cc0b46333e3ebb821 WatchSource:0}: Error finding container 346515ff6a8c5e56296e439f3ae8955c73d10b65c930ad7cc0b46333e3ebb821: Status 404 returned error can't find the container with id 346515ff6a8c5e56296e439f3ae8955c73d10b65c930ad7cc0b46333e3ebb821 Sep 13 20:17:56.559548 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.559454 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"339d15629ed6e2451429c71e700802a0d0519dab9fc259c688dcd3b8da6230b0"} Sep 13 20:17:56.559548 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.559532 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"202504f83f55d7105b3fba1f5e283c7835172fec892661ed87d6a2a73b7932a1"} Sep 13 20:17:56.559759 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.559569 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"29149d14646d2486871da676b1b5098075a936f0cd16d1941c4415f42d03d321"} Sep 13 20:17:56.560635 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.560611 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" event={"ID":"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994","Type":"ContainerStarted","Data":"346515ff6a8c5e56296e439f3ae8955c73d10b65c930ad7cc0b46333e3ebb821"} Sep 13 20:17:56.721345 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.721303 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:56.725837 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.725814 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:17:56.730942 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.730927 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.733443 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733421 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 13 20:17:56.733564 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733465 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 13 20:17:56.733564 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733486 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 13 20:17:56.733564 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733547 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 13 20:17:56.733789 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733772 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kvhfb\"" Sep 13 20:17:56.733848 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733807 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 13 20:17:56.733848 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733818 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 13 20:17:56.733941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.733886 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fsjc3hnl8qr34\"" Sep 13 20:17:56.734271 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734251 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 13 20:17:56.734271 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734255 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 13 20:17:56.734412 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734270 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 13 20:17:56.734412 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734368 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 13 20:17:56.734681 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734664 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 13 20:17:56.734752 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734728 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 13 20:17:56.734896 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.734846 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 13 20:17:56.736291 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.736267 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 13 20:17:56.738883 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.738862 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 13 20:17:56.746077 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.746056 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:17:56.806653 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806653 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd69x\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.806874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806860 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806879 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806923 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.806958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807034 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807136 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807192 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807207 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.807257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.807255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908559 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908580 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908608 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908689 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.908818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908857 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908942 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.908967 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909047 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd69x\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909656 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909753 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909715 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909844 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909802 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.909904 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.909890 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.913394 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.912139 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.913394 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.912985 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.913598 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.913876 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.914186 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.914535 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.914724 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.914796 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915447 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915129 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915447 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915179 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915447 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915317 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915575 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915551 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915762 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915737 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.915916 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.915896 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.916727 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.916704 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.917357 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.917338 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:56.921060 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:56.921036 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd69x\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x\") pod \"prometheus-k8s-0\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:57.041633 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:57.041595 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:17:57.336684 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:57.336620 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:17:57.368708 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:17:57.368677 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb1909f_1ab8_493b_a02b_169c38a83545.slice/crio-afc0e53e1c6c2eada7e8ccf731379bd2ec59cc95737f006c5d278a429a1f49ae WatchSource:0}: Error finding container afc0e53e1c6c2eada7e8ccf731379bd2ec59cc95737f006c5d278a429a1f49ae: Status 404 returned error can't find the container with id afc0e53e1c6c2eada7e8ccf731379bd2ec59cc95737f006c5d278a429a1f49ae Sep 13 20:17:57.566429 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:57.566376 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"afc0e53e1c6c2eada7e8ccf731379bd2ec59cc95737f006c5d278a429a1f49ae"} Sep 13 20:17:58.573358 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.573321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"35948974f2eaa06385ea7d5f0a326d41105c88eb41baff0fd528681dec56005c"} Sep 13 20:17:58.573818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.573400 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"3028ca425f8e62b4a2a9724241a15a52b3087787088320cad2ce04beeeff340b"} Sep 13 20:17:58.573818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.573444 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" event={"ID":"6b2fb5bd-7f26-4707-9c59-de2ab2cc9370","Type":"ContainerStarted","Data":"3ce8bb487540ce35ee45ba745cbb91ca753489606f35d3fc9cf309e957d9e5bf"} Sep 13 20:17:58.573818 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.573492 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:17:58.574934 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.574906 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" event={"ID":"0afad5f8-e7db-4ba6-b12c-b1d56b9b2994","Type":"ContainerStarted","Data":"01c12d220709743cbcb6c42c399681152082200dcd86e4b9aebd2134e27747e0"} Sep 13 20:17:58.575089 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.575065 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:58.576662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.576636 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" exitCode=0 Sep 13 20:17:58.576780 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.576701 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} Sep 13 20:17:58.580408 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.580386 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" Sep 13 20:17:58.595609 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.595572 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" podStartSLOduration=2.126514493 podStartE2EDuration="5.595557802s" totalImagesPullingTime="3.469043309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:58.594784133 +0000 UTC m=+298.651891907" watchObservedRunningTime="2026-09-13 20:17:58.595557802 +0000 UTC m=+298.652665570" Sep 13 20:17:58.649104 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.649008 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-tpt5h" podStartSLOduration=2.089190982 podStartE2EDuration="3.648991146s" totalImagesPullingTime="1.559800164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:58.648071975 +0000 UTC m=+298.705179751" watchObservedRunningTime="2026-09-13 20:17:58.648991146 +0000 UTC m=+298.706098959" Sep 13 20:17:58.789334 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.789269 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:58.888874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:17:58.888845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:17:59.529581 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:17:59.529539 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cl629" podUID="8d579d23-826f-42e1-bdce-8bcc78ce62dd" Sep 13 20:18:00.300125 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.300089 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:18:00.301134 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.301112 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:18:00.314724 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.314701 2552 kubelet.go:1648] "Image garbage collection succeeded" Sep 13 20:18:00.496438 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.496205 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c6b49954-286m4" Sep 13 20:18:00.611283 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.611238 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:00.670300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.670264 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:00.794701 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.794644 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:00.849320 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:00.849284 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:02.548434 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.548352 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qqw6x" Sep 13 20:18:02.597115 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597074 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} Sep 13 20:18:02.597290 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} Sep 13 20:18:02.597290 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597198 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} Sep 13 20:18:02.597290 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597263 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} Sep 13 20:18:02.597402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597300 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} Sep 13 20:18:02.597402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.597339 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerStarted","Data":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} Sep 13 20:18:02.625463 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.625410 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.214519998 podStartE2EDuration="6.625393924s" totalImagesPullingTime="4.393338089s" totalInitContainerRuntime="17.535837ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:18:02.624307923 +0000 UTC m=+302.681415702" watchObservedRunningTime="2026-09-13 20:18:02.625393924 +0000 UTC m=+302.682501698" Sep 13 20:18:02.661126 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.661085 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:02.715268 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:02.715205 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:04.532665 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.532638 2552 scope.go:117] "RemoveContainer" containerID="a2b9096af989efce828c83c02a32597c029707b21eda3df61f633c81b0a16109" Sep 13 20:18:04.587748 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.587727 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-657cb8474-s86dc" Sep 13 20:18:04.607484 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.607459 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:18:04.607653 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.607558 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" event={"ID":"02c155be-6b92-4d6a-99e7-f7e3fd77923a","Type":"ContainerStarted","Data":"22aca0cb535e50af42d0b14acd0b823d74c7e4cb4decb1e2892098b1b799dd2a"} Sep 13 20:18:04.607947 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.607892 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:18:04.609370 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.609341 2552 patch_prober.go:28] interesting pod/console-operator-696884fb9c-6wsm2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.13:8443/readyz\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Sep 13 20:18:04.609468 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.609414 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podUID="02c155be-6b92-4d6a-99e7-f7e3fd77923a" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.13:8443/readyz\": dial tcp 10.134.0.13:8443: connect: connection refused" Sep 13 20:18:04.627751 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:04.627685 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" podStartSLOduration=53.541932385 podStartE2EDuration="56.627663609s" totalImagesPullingTime="3.085731224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:18:04.625722812 +0000 UTC m=+304.682830587" watchObservedRunningTime="2026-09-13 20:18:04.627663609 +0000 UTC m=+304.684771383" Sep 13 20:18:05.615643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:05.615611 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-6wsm2" Sep 13 20:18:05.715319 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:05.715280 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:05.785090 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:05.785061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:05.838752 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:05.838721 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:05.988889 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:05.988796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:06.174488 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:06.174455 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:06.368556 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:06.368526 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:06.469720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:06.469682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:06.771641 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:06.771555 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:06.962350 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:06.962318 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:07.014267 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:07.014234 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:07.042207 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:07.042128 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:18:07.577873 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:07.577845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:07.774075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:07.774044 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:07.874914 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:07.874876 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:08.392861 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:08.392831 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:08.442605 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:08.442576 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:12.115628 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:12.115592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:12.165080 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:12.165050 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:12.527395 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:12.527314 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:18:13.670466 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:13.670431 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:13.716580 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:13.716550 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:19.789109 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:19.789074 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:19.839677 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:19.839632 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:23.391895 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:23.391858 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:23.685130 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:23.685095 2552 generic.go:356] "Generic (PLEG): container finished" podID="847a4ad7-2e78-4aaf-ac34-53527005f060" containerID="de72626a1fe1032f733a230c905fb7bfaeaa5ff8e37fdb79e0560544d482ce40" exitCode=0 Sep 13 20:18:23.685331 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:23.685172 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-cnhsh" event={"ID":"847a4ad7-2e78-4aaf-ac34-53527005f060","Type":"ContainerDied","Data":"de72626a1fe1032f733a230c905fb7bfaeaa5ff8e37fdb79e0560544d482ce40"} Sep 13 20:18:23.685580 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:23.685559 2552 scope.go:117] "RemoveContainer" containerID="de72626a1fe1032f733a230c905fb7bfaeaa5ff8e37fdb79e0560544d482ce40" Sep 13 20:18:24.593723 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:24.593692 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkjsq_dcad819b-8440-46b2-979e-e091d1f1e09b/serve-healthcheck-canary/0.log" Sep 13 20:18:24.691443 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:24.691409 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-cnhsh" event={"ID":"847a4ad7-2e78-4aaf-ac34-53527005f060","Type":"ContainerStarted","Data":"a64f40cb4b33a684d9a488da5010eece8cc9e1742324cdecd08bb4fd7db2ab13"} Sep 13 20:18:25.950999 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:25.950963 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:26.048941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:26.048905 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:30.023655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:30.023618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:30.074765 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:30.074713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:32.319856 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:32.319819 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:32.723636 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:32.723606 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9918ac4-0390-4193-925e-4f62703078c7" containerID="552e21b2d7cb29382183198b9387f3bdc8a0db9afbb4fd22ae74ba315906b545" exitCode=0 Sep 13 20:18:32.723795 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:32.723677 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" event={"ID":"b9918ac4-0390-4193-925e-4f62703078c7","Type":"ContainerDied","Data":"552e21b2d7cb29382183198b9387f3bdc8a0db9afbb4fd22ae74ba315906b545"} Sep 13 20:18:32.724017 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:32.724004 2552 scope.go:117] "RemoveContainer" containerID="552e21b2d7cb29382183198b9387f3bdc8a0db9afbb4fd22ae74ba315906b545" Sep 13 20:18:33.728986 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:33.728953 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-92mlh" event={"ID":"b9918ac4-0390-4193-925e-4f62703078c7","Type":"ContainerStarted","Data":"8e57808a2511270e4c30d8d17fff8be226cace45f016625a167457f5fa91d6d2"} Sep 13 20:18:34.641680 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:34.641641 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:34.693517 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:34.693482 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:34.749631 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:34.749590 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:35.491849 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:35.491773 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:35.593827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:35.593788 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:40.953693 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:40.953650 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:41.006663 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:41.006605 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:47.997998 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:47.997959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:48.098268 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:48.098230 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:48.151539 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:48.151502 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:55.950351 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:55.950248 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:56.002413 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:56.002384 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:18:57.042075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:57.042035 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:18:57.061378 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:57.061350 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:18:57.840241 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:18:57.840197 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:04.751771 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:04.751731 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:04.803693 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:04.803658 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:06.601181 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:06.601144 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:06.702330 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:06.702291 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:07.016374 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:07.016289 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:07.069202 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:07.069166 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:08.722018 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:08.721988 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:13.191967 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.191926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:19:13.194296 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.194272 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d579d23-826f-42e1-bdce-8bcc78ce62dd-metrics-certs\") pod \"network-metrics-daemon-cl629\" (UID: \"8d579d23-826f-42e1-bdce-8bcc78ce62dd\") " pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:19:13.430799 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.430766 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5c5lx\"" Sep 13 20:19:13.439294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.439272 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cl629" Sep 13 20:19:13.712089 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.712059 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cl629"] Sep 13 20:19:13.714655 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:19:13.714629 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d579d23_826f_42e1_bdce_8bcc78ce62dd.slice/crio-3c1dc6d64690a54ae5fdcd6d749f173f01aa28bac325608da7024c4bf1d91145 WatchSource:0}: Error finding container 3c1dc6d64690a54ae5fdcd6d749f173f01aa28bac325608da7024c4bf1d91145: Status 404 returned error can't find the container with id 3c1dc6d64690a54ae5fdcd6d749f173f01aa28bac325608da7024c4bf1d91145 Sep 13 20:19:13.716692 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.716676 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:19:13.891139 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:13.891104 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl629" event={"ID":"8d579d23-826f-42e1-bdce-8bcc78ce62dd","Type":"ContainerStarted","Data":"3c1dc6d64690a54ae5fdcd6d749f173f01aa28bac325608da7024c4bf1d91145"} Sep 13 20:19:14.897040 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:14.897006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl629" event={"ID":"8d579d23-826f-42e1-bdce-8bcc78ce62dd","Type":"ContainerStarted","Data":"816c43840f8689289b5a03f20d80165dc121fd18931817de8a75d453cd809c08"} Sep 13 20:19:14.897413 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:14.897065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cl629" event={"ID":"8d579d23-826f-42e1-bdce-8bcc78ce62dd","Type":"ContainerStarted","Data":"034b257664a5c07849e2cf761fc0054bbb25277c305c09f2a9c2d82b28009aa3"} Sep 13 20:19:14.910711 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:14.910663 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cl629" podStartSLOduration=373.943047034 podStartE2EDuration="6m14.910647512s" totalImagesPullingTime="967.600478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:14.909475623 +0000 UTC m=+374.966583396" watchObservedRunningTime="2026-09-13 20:19:14.910647512 +0000 UTC m=+374.967755337" Sep 13 20:19:14.996835 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:14.996732 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:15.066095 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066060 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:15.066401 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066365 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="prometheus" containerID="cri-o://bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" gracePeriod=600 Sep 13 20:19:15.066401 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066385 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy" containerID="cri-o://f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" gracePeriod=600 Sep 13 20:19:15.066608 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066401 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="thanos-sidecar" containerID="cri-o://41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" gracePeriod=600 Sep 13 20:19:15.066608 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066410 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="config-reloader" containerID="cri-o://08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" gracePeriod=600 Sep 13 20:19:15.066608 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066468 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" gracePeriod=600 Sep 13 20:19:15.066608 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.066479 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-web" containerID="cri-o://b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" gracePeriod=600 Sep 13 20:19:15.074405 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.074304 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:15.195816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.195775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:15.302244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.302207 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:15.309912 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.309886 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310052 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.309940 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310052 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.309973 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310052 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.309996 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310052 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310028 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310055 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310081 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd69x\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310105 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310136 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310160 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310190 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310237 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310280 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310270 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310303 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310340 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310372 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310397 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310427 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310452 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310490 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310500 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls\") pod \"deb1909f-1ab8-493b-a02b-169c38a83545\" (UID: \"deb1909f-1ab8-493b-a02b-169c38a83545\") " Sep 13 20:19:15.310664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310532 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.311098 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310785 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.311098 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310804 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.311098 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.310966 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.311622 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.311574 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.312248 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.312161 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.312501 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.312475 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:19:15.312869 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.312705 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.313153 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.313129 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:15.313384 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.313359 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.313719 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.313689 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.314106 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.314064 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.314616 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.314591 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.314855 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.314827 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x" (OuterVolumeSpecName: "kube-api-access-fd69x") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "kube-api-access-fd69x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:19:15.314961 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.314922 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:19:15.315034 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.314977 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.315267 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.315241 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.315511 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.315482 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out" (OuterVolumeSpecName: "config-out") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:19:15.315706 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.315686 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config" (OuterVolumeSpecName: "config") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.316117 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.316099 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.323760 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.323740 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config" (OuterVolumeSpecName: "web-config") pod "deb1909f-1ab8-493b-a02b-169c38a83545" (UID: "deb1909f-1ab8-493b-a02b-169c38a83545"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:15.411613 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411582 2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-grpc-tls\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411613 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411608 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411613 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411620 2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411631 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-metrics-client-ca\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411641 2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-metrics-client-certs\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411649 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411658 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd69x\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-kube-api-access-fd69x\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411667 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-web-config\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411674 2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-kube-rbac-proxy\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411682 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411690 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411699 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411708 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-db\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411718 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411726 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb1909f-1ab8-493b-a02b-169c38a83545-config-out\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411734 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb1909f-1ab8-493b-a02b-169c38a83545-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411742 2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb1909f-1ab8-493b-a02b-169c38a83545-config\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.411827 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.411749 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb1909f-1ab8-493b-a02b-169c38a83545-tls-assets\") on node \"ip-10-0-140-25.ec2.internal\" DevicePath \"\"" Sep 13 20:19:15.904024 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.903995 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" exitCode=0 Sep 13 20:19:15.904024 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904018 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" exitCode=0 Sep 13 20:19:15.904024 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904024 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" exitCode=0 Sep 13 20:19:15.904024 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904030 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" exitCode=0 Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904035 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" exitCode=0 Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904040 2552 generic.go:356] "Generic (PLEG): container finished" podID="deb1909f-1ab8-493b-a02b-169c38a83545" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" exitCode=0 Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904076 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904076 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904161 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904205 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904231 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904263 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904304 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904344 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} Sep 13 20:19:15.904565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.904391 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb1909f-1ab8-493b-a02b-169c38a83545","Type":"ContainerDied","Data":"afc0e53e1c6c2eada7e8ccf731379bd2ec59cc95737f006c5d278a429a1f49ae"} Sep 13 20:19:15.912565 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.912207 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.919373 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.919357 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.926270 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.926246 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:15.926544 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.926528 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.930438 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.930418 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:15.933996 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.933969 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.940830 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.940808 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.949387 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.949366 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.955500 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955474 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:15.955884 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955868 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="thanos-sidecar" Sep 13 20:19:15.955931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955890 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="thanos-sidecar" Sep 13 20:19:15.955931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955905 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="config-reloader" Sep 13 20:19:15.955931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955914 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="config-reloader" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955933 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-web" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955942 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-web" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955960 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955970 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955983 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-thanos" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.955992 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-thanos" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956013 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="init-config-reloader" Sep 13 20:19:15.956023 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956022 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="init-config-reloader" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956030 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="prometheus" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956038 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="prometheus" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956109 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="config-reloader" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956121 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-thanos" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956130 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="prometheus" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956143 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy-web" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956151 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="kube-rbac-proxy" Sep 13 20:19:15.956294 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.956161 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" containerName="thanos-sidecar" Sep 13 20:19:15.960539 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.960520 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.960850 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.960828 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.960895 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.960859 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.960895 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.960890 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.961171 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.961152 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.961244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961178 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.961244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961195 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.961332 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961252 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:15.961497 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.961469 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.961781 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961504 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.961781 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961526 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.961930 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.961826 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.961930 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961859 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.961930 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.961877 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.962172 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.962154 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.962240 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962175 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.962240 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962189 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.962485 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.962465 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.962524 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962493 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.962524 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962508 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.962798 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:19:15.962781 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.962856 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962802 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:15.962856 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.962815 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.963056 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963034 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.963094 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963059 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.963353 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963334 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 13 20:19:15.963439 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963340 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.963439 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963388 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.963588 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963465 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 13 20:19:15.963700 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963681 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 13 20:19:15.963788 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963701 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.963788 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963720 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.963892 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963877 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 13 20:19:15.963929 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963902 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 13 20:19:15.964006 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.963945 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 13 20:19:15.964069 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964044 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.964069 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964057 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 13 20:19:15.964069 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964066 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.964353 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964335 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.964425 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964354 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.964425 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964398 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 13 20:19:15.964525 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964487 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fsjc3hnl8qr34\"" Sep 13 20:19:15.964525 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964487 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 13 20:19:15.964606 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964527 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 13 20:19:15.964662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964499 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 13 20:19:15.964662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964632 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.964662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964654 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.964820 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964772 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 13 20:19:15.964820 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964807 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 13 20:19:15.964938 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.964921 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kvhfb\"" Sep 13 20:19:15.965154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.965131 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:15.965250 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.965157 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.965670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.965644 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.965670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.965670 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.966035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.965986 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.966035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966016 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.966300 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966280 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.966386 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966301 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.966644 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966618 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.966730 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966646 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.966956 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966934 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.967022 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.966957 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.967286 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967270 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.967286 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967285 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.967463 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967349 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 13 20:19:15.967530 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967507 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:15.967589 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967534 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.967817 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967790 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.967892 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.967818 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.968035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968007 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.968035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968032 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.968467 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968441 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.968467 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968466 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.968732 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968693 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.968808 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968734 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.969001 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.968978 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.969060 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.969004 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.969341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.969297 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.969341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.969321 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.969942 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.969820 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 13 20:19:15.976710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.973616 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:15.976710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.975621 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:15.976710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.975651 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.976710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.976091 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.976710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.976115 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.977132 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977103 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.977132 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977126 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.977443 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977420 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.977443 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977444 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.977725 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977705 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.977797 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977725 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.977958 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977938 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.978008 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.977959 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.978189 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978169 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.978274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978189 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.978469 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978446 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:15.978526 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978472 2552 scope.go:117] "RemoveContainer" containerID="8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657" Sep 13 20:19:15.978708 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978687 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657"} err="failed to get container status \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": rpc error: code = NotFound desc = could not find container \"8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657\": container with ID starting with 8e6458dfabc7cda45bc669a319bcc1f059eadabd2483c025b7ae1e8deb735657 not found: ID does not exist" Sep 13 20:19:15.978708 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978707 2552 scope.go:117] "RemoveContainer" containerID="f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c" Sep 13 20:19:15.978897 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978881 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c"} err="failed to get container status \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": rpc error: code = NotFound desc = could not find container \"f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c\": container with ID starting with f788c76bf2d6cc54664315181a8efaef9c44855f3f103745248033d8050dac2c not found: ID does not exist" Sep 13 20:19:15.978948 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.978897 2552 scope.go:117] "RemoveContainer" containerID="b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab" Sep 13 20:19:15.979088 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979072 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab"} err="failed to get container status \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": rpc error: code = NotFound desc = could not find container \"b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab\": container with ID starting with b6e35f7806f1fae488480ce615c2766a2f988a224128ea91f9ba12723327e9ab not found: ID does not exist" Sep 13 20:19:15.979134 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979088 2552 scope.go:117] "RemoveContainer" containerID="41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513" Sep 13 20:19:15.979284 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979269 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513"} err="failed to get container status \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": rpc error: code = NotFound desc = could not find container \"41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513\": container with ID starting with 41257646d824082cf42bd7629dfc19496ced87ada0308127724d36fad72fd513 not found: ID does not exist" Sep 13 20:19:15.979335 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979285 2552 scope.go:117] "RemoveContainer" containerID="08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994" Sep 13 20:19:15.979486 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979471 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994"} err="failed to get container status \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": rpc error: code = NotFound desc = could not find container \"08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994\": container with ID starting with 08b638592318867011a34a53b4369d50357ff39bb0c3ee070eb79dc486041994 not found: ID does not exist" Sep 13 20:19:15.979486 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979485 2552 scope.go:117] "RemoveContainer" containerID="bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a" Sep 13 20:19:15.979707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979682 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a"} err="failed to get container status \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": rpc error: code = NotFound desc = could not find container \"bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a\": container with ID starting with bf7c108c4abb60d93f6b030a889a9641389580fb963d1f619930aa388cf2c73a not found: ID does not exist" Sep 13 20:19:15.979748 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979710 2552 scope.go:117] "RemoveContainer" containerID="e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf" Sep 13 20:19:15.979996 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:15.979977 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf"} err="failed to get container status \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": rpc error: code = NotFound desc = could not find container \"e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf\": container with ID starting with e3cf2e1a9dc82e9a1880e0df80920ca7ed837fd812e3aba1819ed31a636d59cf not found: ID does not exist" Sep 13 20:19:16.016756 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016756 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016824 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016842 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.016943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016932 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlwxh\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-kube-api-access-zlwxh\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016961 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.016997 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config-out\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017038 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017051 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017242 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017189 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017542 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017258 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017542 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017282 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-web-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017542 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017309 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.017542 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.017336 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118728 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118686 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118728 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118727 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config-out\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118870 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.118970 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.118894 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-web-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119068 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119121 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119153 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119188 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119295 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119278 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119348 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119389 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlwxh\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-kube-api-access-zlwxh\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119414 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119541 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119549 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119960 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119692 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.119960 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.119807 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.120646 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.120334 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.120773 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.120713 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.121706 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.121677 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config-out\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.122006 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.121980 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.122121 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.122100 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.122257 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.122233 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-web-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.122555 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.122528 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.122650 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.122626 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.123265 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.123247 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.123518 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.123501 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.124402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.124372 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-config\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.124754 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.124730 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.124831 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.124771 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.125837 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.125816 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.126402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.126386 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.128919 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.128894 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlwxh\" (UniqueName: \"kubernetes.io/projected/495be1e4-c18b-4c6d-af31-f4fc4e13f91a-kube-api-access-zlwxh\") pod \"prometheus-k8s-0\" (UID: \"495be1e4-c18b-4c6d-af31-f4fc4e13f91a\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.274104 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.273999 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:16.534209 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.534125 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb1909f-1ab8-493b-a02b-169c38a83545" path="/var/lib/kubelet/pods/deb1909f-1ab8-493b-a02b-169c38a83545/volumes" Sep 13 20:19:16.559106 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.559077 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 13 20:19:16.560367 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:19:16.560343 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495be1e4_c18b_4c6d_af31_f4fc4e13f91a.slice/crio-5c7768c1fe7f38420a0e7997d75c297e3a66cea5d76e01763ec2f2375e74a48c WatchSource:0}: Error finding container 5c7768c1fe7f38420a0e7997d75c297e3a66cea5d76e01763ec2f2375e74a48c: Status 404 returned error can't find the container with id 5c7768c1fe7f38420a0e7997d75c297e3a66cea5d76e01763ec2f2375e74a48c Sep 13 20:19:16.911862 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.911833 2552 generic.go:356] "Generic (PLEG): container finished" podID="495be1e4-c18b-4c6d-af31-f4fc4e13f91a" containerID="8ef95bca22ec337a11774f3d3c2103b96083e3dfffd99ea1590a74946795a404" exitCode=0 Sep 13 20:19:16.912269 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.911922 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerDied","Data":"8ef95bca22ec337a11774f3d3c2103b96083e3dfffd99ea1590a74946795a404"} Sep 13 20:19:16.912269 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:16.912006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"5c7768c1fe7f38420a0e7997d75c297e3a66cea5d76e01763ec2f2375e74a48c"} Sep 13 20:19:17.919670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919631 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"58258c2a0e04e9df44673ab5f4ea9bbc52dee6b2b91431570c1d30cfceb8b4d1"} Sep 13 20:19:17.920049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919699 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"5a0b296ad7e29d8efdb819b33ca096df23368b436bba5e8690c648907397d4f7"} Sep 13 20:19:17.920049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919726 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"9e916daef918217f64650898cc54b8fb06e333a66b9fa6fc48c45b57d0b491fe"} Sep 13 20:19:17.920049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"ec758f02d243ef17e4283639b078615836e4b2ce7def3fd2eb5b679124a9bbd6"} Sep 13 20:19:17.920049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919773 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"3b47f1795ca6666c1d63d8ca971c5b7b2071621d54dbc3244ed470c053dfabd2"} Sep 13 20:19:17.920049 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.919796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"495be1e4-c18b-4c6d-af31-f4fc4e13f91a","Type":"ContainerStarted","Data":"e679bfc8619c973a846fa67509bdb5e0c8860ce0b0153064fac5b7c44b97eef2"} Sep 13 20:19:17.945004 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:17.944951 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.926076358 podStartE2EDuration="2.944934649s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.858291ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:17.943582107 +0000 UTC m=+378.000689892" watchObservedRunningTime="2026-09-13 20:19:17.944934649 +0000 UTC m=+378.002042422" Sep 13 20:19:20.125659 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:20.125623 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:20.182238 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:20.182195 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:20.230461 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:20.230424 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:21.274151 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:21.274088 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:19:25.956241 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:25.956181 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:26.055310 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:26.055274 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:54.787743 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:54.787701 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:56.729593 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:56.729554 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:56.776174 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:56.776138 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:58.104794 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:58.104754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:19:58.204207 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:19:58.204174 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:16.274990 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:16.274950 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:20:16.290675 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:16.290650 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:20:17.166035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:17.166006 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 13 20:20:29.740116 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:29.740028 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:30.559422 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:30.559381 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:33.347131 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:33.347090 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:33.397506 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:33.397474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:34.416278 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:34.416240 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:34.517464 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:34.517432 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:35.539152 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:35.539096 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:35.641677 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:35.641640 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:37.549783 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:37.549751 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:37.950397 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:37.950365 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:40.148721 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:40.148687 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:40.206947 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:40.206910 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:45.203165 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:45.203122 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:45.378546 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:45.378510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:46.150707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:46.150663 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:46.250778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:46.250717 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:51.746534 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:51.746494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:51.848052 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:51.848011 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:20:53.620553 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:20:53.620511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:05.474649 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:05.474610 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:09.876872 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.876836 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:09.922359 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.922322 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt"] Sep 13 20:21:09.925564 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.925548 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:09.928337 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.928314 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 13 20:21:09.928469 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.928393 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 13 20:21:09.928469 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.928450 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 13 20:21:09.928563 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.928456 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:21:09.928960 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.928944 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h792q\"" Sep 13 20:21:09.929080 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.929011 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 13 20:21:09.934929 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.934909 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt"] Sep 13 20:21:09.958013 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.957983 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:09.982106 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.982075 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb549cba-454f-4f4b-8f1b-fef9ed524589-manager-config\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:09.982258 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.982108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjrx\" (UniqueName: \"kubernetes.io/projected/eb549cba-454f-4f4b-8f1b-fef9ed524589-kube-api-access-nnjrx\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:09.982258 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.982136 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:09.982345 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:09.982287 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.083592 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.083555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.083780 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.083618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb549cba-454f-4f4b-8f1b-fef9ed524589-manager-config\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.083780 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.083636 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjrx\" (UniqueName: \"kubernetes.io/projected/eb549cba-454f-4f4b-8f1b-fef9ed524589-kube-api-access-nnjrx\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.083780 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.083656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.084365 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.084333 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eb549cba-454f-4f4b-8f1b-fef9ed524589-manager-config\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.086114 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.086089 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.086203 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.086127 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb549cba-454f-4f4b-8f1b-fef9ed524589-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.091319 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.091295 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjrx\" (UniqueName: \"kubernetes.io/projected/eb549cba-454f-4f4b-8f1b-fef9ed524589-kube-api-access-nnjrx\") pod \"lws-controller-manager-768f8bb9c7-wjbjt\" (UID: \"eb549cba-454f-4f4b-8f1b-fef9ed524589\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.235919 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.235834 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:10.505173 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:10.505151 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt"] Sep 13 20:21:10.507768 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:21:10.507737 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb549cba_454f_4f4b_8f1b_fef9ed524589.slice/crio-e3dc5043659fdca9fbf10fbd95f26220fd4cb255da9036b8c02a3258a3a1f71a WatchSource:0}: Error finding container e3dc5043659fdca9fbf10fbd95f26220fd4cb255da9036b8c02a3258a3a1f71a: Status 404 returned error can't find the container with id e3dc5043659fdca9fbf10fbd95f26220fd4cb255da9036b8c02a3258a3a1f71a Sep 13 20:21:11.359169 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:11.359083 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" event={"ID":"eb549cba-454f-4f4b-8f1b-fef9ed524589","Type":"ContainerStarted","Data":"e3dc5043659fdca9fbf10fbd95f26220fd4cb255da9036b8c02a3258a3a1f71a"} Sep 13 20:21:11.794271 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:11.794137 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:11.888093 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:11.887984 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:12.310338 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.310283 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:12.589266 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.589169 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:12.687589 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.687553 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:12.708318 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.708285 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt"] Sep 13 20:21:12.712232 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.712190 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.715307 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.715281 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 13 20:21:12.715444 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.715429 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q5p9w\"" Sep 13 20:21:12.715833 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.715723 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 13 20:21:12.715833 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.715761 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 13 20:21:12.715833 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.715794 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 13 20:21:12.727690 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.727663 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt"] Sep 13 20:21:12.807816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.807784 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.807984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.807833 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.807984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.807939 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.808074 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.807983 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl55t\" (UniqueName: \"kubernetes.io/projected/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-kube-api-access-kl55t\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.808074 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.808005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.824087 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.824041 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:12.909010 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.908977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.909206 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.909020 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.909206 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.909066 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.909206 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.909094 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl55t\" (UniqueName: \"kubernetes.io/projected/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-kube-api-access-kl55t\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.909206 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.909115 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.909451 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.909406 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.911494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.911460 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.911632 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.911613 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.911759 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.911740 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.916512 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.916491 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl55t\" (UniqueName: \"kubernetes.io/projected/b21a49ea-51d5-48cf-935a-5bb37fa60ac4-kube-api-access-kl55t\") pod \"opendatahub-operator-controller-manager-84f9f8b966-t6ldt\" (UID: \"b21a49ea-51d5-48cf-935a-5bb37fa60ac4\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:12.925441 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:12.925414 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:13.025626 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.025587 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:13.026493 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.026476 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:13.129047 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.129017 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:13.228546 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.228512 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:13.302867 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.302841 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt"] Sep 13 20:21:13.305101 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:21:13.305073 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21a49ea_51d5_48cf_935a_5bb37fa60ac4.slice/crio-5eae6296e5b0ca4efcbb4628282eade667265f267dc4357eb302157ba9c4bcf8 WatchSource:0}: Error finding container 5eae6296e5b0ca4efcbb4628282eade667265f267dc4357eb302157ba9c4bcf8: Status 404 returned error can't find the container with id 5eae6296e5b0ca4efcbb4628282eade667265f267dc4357eb302157ba9c4bcf8 Sep 13 20:21:13.369395 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.369337 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" event={"ID":"b21a49ea-51d5-48cf-935a-5bb37fa60ac4","Type":"ContainerStarted","Data":"5eae6296e5b0ca4efcbb4628282eade667265f267dc4357eb302157ba9c4bcf8"} Sep 13 20:21:13.370976 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.370938 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" event={"ID":"eb549cba-454f-4f4b-8f1b-fef9ed524589","Type":"ContainerStarted","Data":"927ce6ff03a9bd07c51a3acaa3d069b21f8703309f21c7f757af51313df118bd"} Sep 13 20:21:13.371112 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.371063 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:13.390184 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:13.390097 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" podStartSLOduration=2.079577058 podStartE2EDuration="4.390080295s" totalImagesPullingTime="2.310503237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:13.388958464 +0000 UTC m=+493.446066238" watchObservedRunningTime="2026-09-13 20:21:13.390080295 +0000 UTC m=+493.447188069" Sep 13 20:21:17.399064 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:17.399031 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" event={"ID":"b21a49ea-51d5-48cf-935a-5bb37fa60ac4","Type":"ContainerStarted","Data":"28547ff4cd5c2efb0408d3fa5d3da1d1bea493cdd07a325ba2e1cc8c04b62970"} Sep 13 20:21:18.404145 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:18.404111 2552 generic.go:356] "Generic (PLEG): container finished" podID="b21a49ea-51d5-48cf-935a-5bb37fa60ac4" containerID="28547ff4cd5c2efb0408d3fa5d3da1d1bea493cdd07a325ba2e1cc8c04b62970" exitCode=0 Sep 13 20:21:18.404578 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:18.404202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" event={"ID":"b21a49ea-51d5-48cf-935a-5bb37fa60ac4","Type":"ContainerDied","Data":"28547ff4cd5c2efb0408d3fa5d3da1d1bea493cdd07a325ba2e1cc8c04b62970"} Sep 13 20:21:19.409791 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:19.409754 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" event={"ID":"b21a49ea-51d5-48cf-935a-5bb37fa60ac4","Type":"ContainerStarted","Data":"0b067cd3c87b08534ebf47ff20e48e028173042f00dc9010a702db65d999be4e"} Sep 13 20:21:19.410286 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:19.409888 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:19.431600 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:19.431552 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" podStartSLOduration=2.988291763 podStartE2EDuration="7.431536553s" totalImagesPullingTime="3.341979256s" totalInitContainerRuntime="1.101265534s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:19.429672139 +0000 UTC m=+499.486779913" watchObservedRunningTime="2026-09-13 20:21:19.431536553 +0000 UTC m=+499.488644327" Sep 13 20:21:24.380730 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:24.380694 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-wjbjt" Sep 13 20:21:30.417015 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:30.416982 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-t6ldt" Sep 13 20:21:31.984907 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:31.984856 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:32.109543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:32.109507 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:32.510572 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:32.510538 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:33.098142 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:33.098077 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:33.599540 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:33.599511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:33.685984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:33.685946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:34.465080 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:34.465042 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:38.735195 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:38.735164 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:38.840365 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:38.840289 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:39.289192 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.289152 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv"] Sep 13 20:21:39.297524 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.297493 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.299568 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.299544 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 13 20:21:39.299704 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.299567 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 13 20:21:39.299704 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.299628 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bcfkc\"" Sep 13 20:21:39.299704 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.299567 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 13 20:21:39.302686 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.302665 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv"] Sep 13 20:21:39.310790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.310769 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:39.441951 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.441897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.441951 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.441950 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442026 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcdj\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-kube-api-access-mwcdj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442113 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442244 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442247 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.442460 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.442284 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543417 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543329 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543417 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543380 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543652 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543495 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543652 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543537 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543755 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543719 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543816 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543870 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543844 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.543945 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544071 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.544051 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544165 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.544138 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544285 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.544164 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcdj\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-kube-api-access-mwcdj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544285 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.543993 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544409 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.544381 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.544409 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.544397 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.546545 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.546526 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.546730 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.546716 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.549323 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.549297 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:39.551277 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.551198 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.551663 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.551646 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcdj\" (UniqueName: \"kubernetes.io/projected/f7cd61e1-d943-4232-b8a1-184ee38acbf5-kube-api-access-mwcdj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv\" (UID: \"f7cd61e1-d943-4232-b8a1-184ee38acbf5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.608707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.608669 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:39.651174 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.651143 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:39.898530 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:39.898489 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv"] Sep 13 20:21:39.901498 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:21:39.901467 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cd61e1_d943_4232_b8a1_184ee38acbf5.slice/crio-7c5daf2c26e3795f1c5e536a7811d35e96480c6367b147cb6c14038ceaf2e018 WatchSource:0}: Error finding container 7c5daf2c26e3795f1c5e536a7811d35e96480c6367b147cb6c14038ceaf2e018: Status 404 returned error can't find the container with id 7c5daf2c26e3795f1c5e536a7811d35e96480c6367b147cb6c14038ceaf2e018 Sep 13 20:21:40.497053 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:40.497020 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" event={"ID":"f7cd61e1-d943-4232-b8a1-184ee38acbf5","Type":"ContainerStarted","Data":"7c5daf2c26e3795f1c5e536a7811d35e96480c6367b147cb6c14038ceaf2e018"} Sep 13 20:21:42.667634 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.667593 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:21:42.667910 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.667676 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:21:42.667910 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.667702 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:21:42.912725 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.912684 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbvz"] Sep 13 20:21:42.916059 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.916012 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:42.918188 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.918163 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kzldh\"" Sep 13 20:21:42.918368 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.918335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 13 20:21:42.927240 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.927197 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbvz"] Sep 13 20:21:42.939028 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.938981 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:42.972310 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.972277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:42.972471 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:42.972317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qprsp\" (UniqueName: \"kubernetes.io/projected/6dce5708-4475-4842-a27f-696c9ea83fb5-kube-api-access-qprsp\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:43.039359 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.039327 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:43.073611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.073574 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:43.073611 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.073618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qprsp\" (UniqueName: \"kubernetes.io/projected/6dce5708-4475-4842-a27f-696c9ea83fb5-kube-api-access-qprsp\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:43.073854 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:21:43.073729 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 13 20:21:43.073854 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:21:43.073803 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert podName:6dce5708-4475-4842-a27f-696c9ea83fb5 nodeName:}" failed. No retries permitted until 2026-09-13 20:21:43.57378196 +0000 UTC m=+523.630889726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert") pod "odh-model-controller-7998c67dc4-2nbvz" (UID: "6dce5708-4475-4842-a27f-696c9ea83fb5") : secret "odh-model-controller-webhook-cert" not found Sep 13 20:21:43.083748 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.083722 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qprsp\" (UniqueName: \"kubernetes.io/projected/6dce5708-4475-4842-a27f-696c9ea83fb5-kube-api-access-qprsp\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:43.294874 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.294754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:43.354771 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.354740 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:43.480622 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.480586 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:43.512675 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.512633 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" event={"ID":"f7cd61e1-d943-4232-b8a1-184ee38acbf5","Type":"ContainerStarted","Data":"c562c7db0370f9cc12474311d5b76958470f2a5088ba33822363675293ac0488"} Sep 13 20:21:43.528490 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.528445 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" podStartSLOduration=1.764591501 podStartE2EDuration="4.528429536s" totalImagesPullingTime="2.763838035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:43.52733029 +0000 UTC m=+523.584438063" watchObservedRunningTime="2026-09-13 20:21:43.528429536 +0000 UTC m=+523.585537380" Sep 13 20:21:43.577929 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.577847 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:43.578080 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:21:43.577995 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 13 20:21:43.578080 ip-10-0-140-25 kubenswrapper[2552]: E0913 20:21:43.578065 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert podName:6dce5708-4475-4842-a27f-696c9ea83fb5 nodeName:}" failed. No retries permitted until 2026-09-13 20:21:44.578044469 +0000 UTC m=+524.635152239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert") pod "odh-model-controller-7998c67dc4-2nbvz" (UID: "6dce5708-4475-4842-a27f-696c9ea83fb5") : secret "odh-model-controller-webhook-cert" not found Sep 13 20:21:43.609803 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.609771 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:43.614164 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.614139 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:43.634551 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:43.634525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:44.517548 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.517517 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:44.518606 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.518584 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv" Sep 13 20:21:44.588354 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.588317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:44.590602 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.590579 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dce5708-4475-4842-a27f-696c9ea83fb5-cert\") pod \"odh-model-controller-7998c67dc4-2nbvz\" (UID: \"6dce5708-4475-4842-a27f-696c9ea83fb5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:44.729083 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.729043 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:44.995740 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:44.995710 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nbvz"] Sep 13 20:21:45.000253 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:21:45.000201 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dce5708_4475_4842_a27f_696c9ea83fb5.slice/crio-53a6f144a70cc5c57e115eedd421648c7873bf32c5b1cb258cded53b149c747a WatchSource:0}: Error finding container 53a6f144a70cc5c57e115eedd421648c7873bf32c5b1cb258cded53b149c747a: Status 404 returned error can't find the container with id 53a6f144a70cc5c57e115eedd421648c7873bf32c5b1cb258cded53b149c747a Sep 13 20:21:45.136784 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:45.136744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:45.522813 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:45.522725 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" event={"ID":"6dce5708-4475-4842-a27f-696c9ea83fb5","Type":"ContainerStarted","Data":"53a6f144a70cc5c57e115eedd421648c7873bf32c5b1cb258cded53b149c747a"} Sep 13 20:21:48.537831 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:48.537797 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" event={"ID":"6dce5708-4475-4842-a27f-696c9ea83fb5","Type":"ContainerStarted","Data":"ebfa5e59c83f01129b95a4c966aec4be80e9274297f4911f6a7fd5bb74ba1dd7"} Sep 13 20:21:48.538210 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:48.537914 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:21:48.557113 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:48.557059 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" podStartSLOduration=3.640454549 podStartE2EDuration="6.557043187s" totalImagesPullingTime="2.916588638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:48.555647915 +0000 UTC m=+528.612755689" watchObservedRunningTime="2026-09-13 20:21:48.557043187 +0000 UTC m=+528.614151013" Sep 13 20:21:49.171976 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.171940 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl"] Sep 13 20:21:49.175329 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.175311 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.178790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.178766 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 13 20:21:49.179190 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.179172 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 13 20:21:49.179465 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.179446 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sjpzs\"" Sep 13 20:21:49.180519 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.180505 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 13 20:21:49.201352 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.201323 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl"] Sep 13 20:21:49.231781 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.231747 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.231900 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.231802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xnz\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-kube-api-access-b8xnz\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.231900 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.231890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.232001 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.231918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.232040 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.232013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ab8caf-9d90-491b-aac5-e86787b4f258-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.232075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.232045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.232075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.232064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333362 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333327 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333511 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ab8caf-9d90-491b-aac5-e86787b4f258-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333511 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333416 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333511 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333511 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333457 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333651 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333615 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xnz\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-kube-api-access-b8xnz\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.333730 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.333704 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.334264 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.334210 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.335766 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.335744 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.335882 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.335746 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4ab8caf-9d90-491b-aac5-e86787b4f258-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.335949 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.335937 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.336005 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.335957 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4ab8caf-9d90-491b-aac5-e86787b4f258-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.340455 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.340432 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xnz\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-kube-api-access-b8xnz\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.341022 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.341004 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4ab8caf-9d90-491b-aac5-e86787b4f258-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-th2fl\" (UID: \"a4ab8caf-9d90-491b-aac5-e86787b4f258\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.442007 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.441921 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:49.484181 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.484151 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:49.761541 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:49.761511 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl"] Sep 13 20:21:49.763342 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:21:49.763315 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ab8caf_9d90_491b_aac5_e86787b4f258.slice/crio-a1d637d523bf66cbcbe39c5e95d90226fcd0cb3e9edea99fde462a75aa4cc03f WatchSource:0}: Error finding container a1d637d523bf66cbcbe39c5e95d90226fcd0cb3e9edea99fde462a75aa4cc03f: Status 404 returned error can't find the container with id a1d637d523bf66cbcbe39c5e95d90226fcd0cb3e9edea99fde462a75aa4cc03f Sep 13 20:21:50.549968 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:50.549933 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" event={"ID":"a4ab8caf-9d90-491b-aac5-e86787b4f258","Type":"ContainerStarted","Data":"a1d637d523bf66cbcbe39c5e95d90226fcd0cb3e9edea99fde462a75aa4cc03f"} Sep 13 20:21:51.394729 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:51.394692 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:51.475039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:51.474954 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:51.735928 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:51.735840 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:51.933683 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:51.933649 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:21:51.933765 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:51.933716 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:21:52.054778 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.054746 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:52.561379 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.561345 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" event={"ID":"a4ab8caf-9d90-491b-aac5-e86787b4f258","Type":"ContainerStarted","Data":"6e44701f53ecb0d6b3bfaf5f88c0d0393e96fba730e762630fc11119eaf2201c"} Sep 13 20:21:52.561784 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.561522 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:52.563538 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.563509 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-th2fl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 13 20:21:52.563662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.563569 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" podUID="a4ab8caf-9d90-491b-aac5-e86787b4f258" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 13 20:21:52.602485 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.602435 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" podStartSLOduration=1.434347555 podStartE2EDuration="3.602417993s" totalImagesPullingTime="2.168070438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:52.599590075 +0000 UTC m=+532.656697848" watchObservedRunningTime="2026-09-13 20:21:52.602417993 +0000 UTC m=+532.659525766" Sep 13 20:21:52.651377 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.651339 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:52.707633 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.707567 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:52.807946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:52.807910 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:53.566572 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:53.566546 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-th2fl" Sep 13 20:21:55.997545 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:55.997491 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:21:59.546185 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:21:59.546157 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nbvz" Sep 13 20:22:44.022434 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:22:44.022384 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:22:44.120613 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:22:44.120571 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:22:56.911707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:22:56.911662 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:22:59.696035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:22:59.696003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:00.331600 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:00.331568 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:23:00.332841 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:00.332816 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:23:01.471799 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:01.471762 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:01.768941 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:01.768851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:01.872678 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:01.872649 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:02.481067 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:02.481024 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:02.972802 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:02.972759 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:03.918662 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:03.918609 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:04.014906 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:04.014866 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:05.671664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:05.671622 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:06.075657 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:06.075569 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:07.903897 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:07.903863 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:08.002274 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:08.002231 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:09.472075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:09.472035 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:09.573966 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:09.573936 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:11.476654 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:11.476623 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:11.577103 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:11.577070 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:12.733801 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:12.733765 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:12.865880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:12.865841 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:17.212655 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:17.212618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:17.312625 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:17.312585 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:17.412681 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:17.412650 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:20.707348 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:20.707316 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:20.808710 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:20.808674 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:26.066365 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:26.066278 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:26.165839 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:26.165799 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:28.646164 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:28.646117 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:28.746424 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:28.746385 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:31.638848 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:31.638792 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:31.752784 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:31.752751 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:32.119386 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:32.119349 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:32.174496 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:32.174452 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:32.231314 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:32.231279 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:37.259765 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:37.259726 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:37.358884 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:37.358844 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:38.051638 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:38.051601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:38.156044 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:38.156012 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:38.252364 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:38.252324 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:38.353204 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:38.353170 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:45.217521 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:45.217476 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:45.317678 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:45.317650 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:53.245959 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.245923 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5"] Sep 13 20:23:53.249809 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.249792 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.251886 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.251865 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lnpln\"" Sep 13 20:23:53.260003 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.259981 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5"] Sep 13 20:23:53.284311 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.284276 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:53.328258 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328207 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328258 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328262 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328470 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328324 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328470 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328372 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328470 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328414 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.328731 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.328625 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdccr\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-kube-api-access-vdccr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429190 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429158 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429190 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429194 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429335 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429448 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdccr\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-kube-api-access-vdccr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429455 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429498 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429643 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429685 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429790 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429769 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429868 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429851 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.429902 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.429856 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.430048 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.430031 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.431800 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.431777 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.431926 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.431908 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.436474 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.436446 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.436634 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.436610 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdccr\" (UniqueName: \"kubernetes.io/projected/dda5e0f7-679b-45e2-9be5-4b05c45a56b3-kube-api-access-vdccr\") pod \"maas-default-gateway-openshift-default-78bb78ff78-krlx5\" (UID: \"dda5e0f7-679b-45e2-9be5-4b05c45a56b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.552465 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.552373 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:53.560369 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.560350 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:53.832810 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.832770 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5"] Sep 13 20:23:53.836357 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:23:53.836325 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda5e0f7_679b_45e2_9be5_4b05c45a56b3.slice/crio-b296da9ff8dae8b3ef076107bc78d4ccbef0454d75044ed827cc6b998a4857be WatchSource:0}: Error finding container b296da9ff8dae8b3ef076107bc78d4ccbef0454d75044ed827cc6b998a4857be: Status 404 returned error can't find the container with id b296da9ff8dae8b3ef076107bc78d4ccbef0454d75044ed827cc6b998a4857be Sep 13 20:23:53.838720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.838685 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:23:53.838804 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.838746 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:23:53.838804 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:53.838775 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:23:54.098035 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:54.098008 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" event={"ID":"dda5e0f7-679b-45e2-9be5-4b05c45a56b3","Type":"ContainerStarted","Data":"9c0e4490fc7dca24ff2b6a21d4c839e595faed6865a6462dc0741f43399ee588"} Sep 13 20:23:54.098253 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:54.098056 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" event={"ID":"dda5e0f7-679b-45e2-9be5-4b05c45a56b3","Type":"ContainerStarted","Data":"b296da9ff8dae8b3ef076107bc78d4ccbef0454d75044ed827cc6b998a4857be"} Sep 13 20:23:54.115805 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:54.115742 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podStartSLOduration=1.115723847 podStartE2EDuration="1.115723847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:23:54.113892931 +0000 UTC m=+654.171000706" watchObservedRunningTime="2026-09-13 20:23:54.115723847 +0000 UTC m=+654.172831623" Sep 13 20:23:54.561445 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:54.561362 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:54.566127 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:54.566104 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:55.092313 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.092266 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:55.102890 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.102855 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:55.103796 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.103774 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:23:55.205044 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.205004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:55.263036 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.263003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:55.905919 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:55.905888 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:23:56.005882 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:23:56.005847 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:16.264589 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:16.264550 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:16.380751 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:16.380716 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:16.650055 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:16.650026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:28.614414 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:28.614373 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:28.834521 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:28.834484 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:34.818253 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:34.818176 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:34.889039 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:34.889005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:34.940984 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:34.940943 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:35.049450 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:35.049413 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:35.143093 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:35.143054 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:38.415753 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:38.415713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:38.511453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:38.511414 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:24:49.138931 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:24:49.138902 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:09.920742 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:09.920643 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:10.023439 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:10.023403 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:11.402736 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:11.402673 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:11.501077 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:11.501037 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:11.650089 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:11.650052 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:11.918663 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:11.918635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:12.029154 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:12.029118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:12.102704 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:12.102670 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:21.487454 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.487421 2552 generic.go:356] "Generic (PLEG): container finished" podID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerID="9c0e4490fc7dca24ff2b6a21d4c839e595faed6865a6462dc0741f43399ee588" exitCode=0 Sep 13 20:25:21.487454 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.487459 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" event={"ID":"dda5e0f7-679b-45e2-9be5-4b05c45a56b3","Type":"ContainerDied","Data":"9c0e4490fc7dca24ff2b6a21d4c839e595faed6865a6462dc0741f43399ee588"} Sep 13 20:25:21.487879 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.487835 2552 scope.go:117] "RemoveContainer" containerID="9c0e4490fc7dca24ff2b6a21d4c839e595faed6865a6462dc0741f43399ee588" Sep 13 20:25:21.488870 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.488843 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:25:21.488943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.488927 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:25:21.488988 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:21.488975 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 13 20:25:22.493554 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.493514 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" event={"ID":"dda5e0f7-679b-45e2-9be5-4b05c45a56b3","Type":"ContainerStarted","Data":"4209cad2b6f54dfb0ad9962ea60483b0a665119e37bc99230a5949d6741ed035"} Sep 13 20:25:22.555478 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.555442 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:22.561147 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.561124 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:25:22.562238 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.562196 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-krlx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 13 20:25:22.562325 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.562254 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podUID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 13 20:25:22.656926 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:22.656882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:23.561273 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:23.561200 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-krlx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 13 20:25:23.561681 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:23.561310 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podUID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 13 20:25:24.561061 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:24.561030 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-krlx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 13 20:25:24.561262 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:24.561081 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podUID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 13 20:25:25.103349 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:25.103306 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:25:25.561834 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:25.561745 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-krlx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 13 20:25:25.561834 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:25.561805 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podUID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 13 20:25:26.560922 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:26.560891 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-krlx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Sep 13 20:25:26.561360 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:26.560945 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" podUID="dda5e0f7-679b-45e2-9be5-4b05c45a56b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Sep 13 20:25:27.565045 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:27.565016 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:25:27.566077 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:27.566056 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-krlx5" Sep 13 20:25:37.420844 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:37.420809 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:44.276642 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.276612 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp"] Sep 13 20:25:44.279090 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.279065 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.281965 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.281938 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 13 20:25:44.282086 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.281971 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 13 20:25:44.282086 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.281979 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 13 20:25:44.282204 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.282128 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9rx5w\"" Sep 13 20:25:44.293200 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.293167 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp"] Sep 13 20:25:44.306018 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.305990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.306163 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.306053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.306163 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.306075 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvpw\" (UniqueName: \"kubernetes.io/projected/b8c549a6-6e11-451e-9121-f2df84742d9f-kube-api-access-4wvpw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.306163 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.306110 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c549a6-6e11-451e-9121-f2df84742d9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.306378 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.306193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.306378 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.306233 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.316716 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.316690 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:44.407327 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407294 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c549a6-6e11-451e-9121-f2df84742d9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407327 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407355 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407552 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407702 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvpw\" (UniqueName: \"kubernetes.io/projected/b8c549a6-6e11-451e-9121-f2df84742d9f-kube-api-access-4wvpw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407791 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407762 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407806 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.407946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.407886 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.409727 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.409705 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c549a6-6e11-451e-9121-f2df84742d9f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.409878 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.409863 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c549a6-6e11-451e-9121-f2df84742d9f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.414328 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.414309 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvpw\" (UniqueName: \"kubernetes.io/projected/b8c549a6-6e11-451e-9121-f2df84742d9f-kube-api-access-4wvpw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wbdhp\" (UID: \"b8c549a6-6e11-451e-9121-f2df84742d9f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.589830 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.589748 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:44.858028 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.858002 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp"] Sep 13 20:25:44.860279 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:25:44.860245 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c549a6_6e11_451e_9121_f2df84742d9f.slice/crio-742805e43fb7d8a1674f871858376cdc6558dabe1bb15754bbffae311fac20c2 WatchSource:0}: Error finding container 742805e43fb7d8a1674f871858376cdc6558dabe1bb15754bbffae311fac20c2: Status 404 returned error can't find the container with id 742805e43fb7d8a1674f871858376cdc6558dabe1bb15754bbffae311fac20c2 Sep 13 20:25:44.861918 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:44.861899 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:25:45.611234 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:45.611183 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" event={"ID":"b8c549a6-6e11-451e-9121-f2df84742d9f","Type":"ContainerStarted","Data":"742805e43fb7d8a1674f871858376cdc6558dabe1bb15754bbffae311fac20c2"} Sep 13 20:25:46.616879 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:46.616838 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" event={"ID":"b8c549a6-6e11-451e-9121-f2df84742d9f","Type":"ContainerStarted","Data":"31e05da42895c9ff0e901ec31fad31ef5382656308b7f185d0b7ea1cd0b5e1dc"} Sep 13 20:25:46.633468 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:46.633418 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" podStartSLOduration=1.5480136949999999 podStartE2EDuration="2.633402135s" totalImagesPullingTime="1.08538844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:25:46.63198099 +0000 UTC m=+766.689088768" watchObservedRunningTime="2026-09-13 20:25:46.633402135 +0000 UTC m=+766.690509908" Sep 13 20:25:51.419402 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:51.419350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:25:54.589929 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:54.589892 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:54.590418 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:54.589957 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:54.602339 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:54.602315 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:54.662660 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:54.662624 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wbdhp" Sep 13 20:25:59.550782 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:25:59.550747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:06.489474 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.489435 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q"] Sep 13 20:26:06.494075 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.494051 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.496019 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.495994 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 13 20:26:06.505297 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.505261 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q"] Sep 13 20:26:06.613293 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.613293 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613304 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.613494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.613494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613352 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.613494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2tq\" (UniqueName: \"kubernetes.io/projected/bec13caa-b95b-4ec4-8a8c-1629001a45d3-kube-api-access-tf2tq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.613494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.613428 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.686406 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.686369 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:06.714649 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.714812 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714755 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.714812 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.714910 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.714910 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.715004 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.714915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2tq\" (UniqueName: \"kubernetes.io/projected/bec13caa-b95b-4ec4-8a8c-1629001a45d3-kube-api-access-tf2tq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.715287 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.715264 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.715382 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.715262 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.715382 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.715356 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.716966 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.716946 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bec13caa-b95b-4ec4-8a8c-1629001a45d3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.717229 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.717200 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bec13caa-b95b-4ec4-8a8c-1629001a45d3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.721907 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.721882 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2tq\" (UniqueName: \"kubernetes.io/projected/bec13caa-b95b-4ec4-8a8c-1629001a45d3-kube-api-access-tf2tq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b5b2q\" (UID: \"bec13caa-b95b-4ec4-8a8c-1629001a45d3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:06.805327 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:06.805236 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:07.078989 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:07.078963 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q"] Sep 13 20:26:07.081689 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:26:07.081643 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec13caa_b95b_4ec4_8a8c_1629001a45d3.slice/crio-133161bee7dc5a68329792a8a62d73d9f2cf098ef9e41ab86640e91dcb03de99 WatchSource:0}: Error finding container 133161bee7dc5a68329792a8a62d73d9f2cf098ef9e41ab86640e91dcb03de99: Status 404 returned error can't find the container with id 133161bee7dc5a68329792a8a62d73d9f2cf098ef9e41ab86640e91dcb03de99 Sep 13 20:26:07.710559 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:07.710520 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" event={"ID":"bec13caa-b95b-4ec4-8a8c-1629001a45d3","Type":"ContainerStarted","Data":"2e03c8a407b92320e87b2ad9ba6a848880e8ef18751c593bf988674c7f432cce"} Sep 13 20:26:07.711038 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:07.710580 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" event={"ID":"bec13caa-b95b-4ec4-8a8c-1629001a45d3","Type":"ContainerStarted","Data":"133161bee7dc5a68329792a8a62d73d9f2cf098ef9e41ab86640e91dcb03de99"} Sep 13 20:26:07.726576 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:07.726514 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" podStartSLOduration=1.5167362450000001 podStartE2EDuration="1.726475544s" totalImagesPullingTime="209.739299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:26:07.726016611 +0000 UTC m=+787.783124409" watchObservedRunningTime="2026-09-13 20:26:07.726475544 +0000 UTC m=+787.783583322" Sep 13 20:26:16.806268 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:16.806208 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:16.806696 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:16.806296 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:16.818814 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:16.818787 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:17.772842 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:17.772810 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b5b2q" Sep 13 20:26:20.331929 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:20.331892 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:24.092842 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.092754 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc"] Sep 13 20:26:24.096513 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.096494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.098811 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.098786 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 13 20:26:24.104861 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.104611 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc"] Sep 13 20:26:24.122119 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.122080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:24.168445 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168409 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.168445 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168445 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.168634 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6aaf5b4-580a-4280-8115-5702555c18c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.168634 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168605 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.168735 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168648 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.168735 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.168669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlr7c\" (UniqueName: \"kubernetes.io/projected/c6aaf5b4-580a-4280-8115-5702555c18c8-kube-api-access-vlr7c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270074 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270036 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270277 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270277 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlr7c\" (UniqueName: \"kubernetes.io/projected/c6aaf5b4-580a-4280-8115-5702555c18c8-kube-api-access-vlr7c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270398 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270277 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270398 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270398 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6aaf5b4-580a-4280-8115-5702555c18c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.270543 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270528 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.271004 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.270786 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.271708 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.271682 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.273185 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.273140 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6aaf5b4-580a-4280-8115-5702555c18c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.273880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.273507 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6aaf5b4-580a-4280-8115-5702555c18c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.278720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.278698 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlr7c\" (UniqueName: \"kubernetes.io/projected/c6aaf5b4-580a-4280-8115-5702555c18c8-kube-api-access-vlr7c\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6fktc\" (UID: \"c6aaf5b4-580a-4280-8115-5702555c18c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.409382 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.409348 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:24.677946 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.677895 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc"] Sep 13 20:26:24.680057 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:26:24.680031 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6aaf5b4_580a_4280_8115_5702555c18c8.slice/crio-86300eb3f5342793847a9f3b73c1dd528fd29e2997123b87068635f439df0732 WatchSource:0}: Error finding container 86300eb3f5342793847a9f3b73c1dd528fd29e2997123b87068635f439df0732: Status 404 returned error can't find the container with id 86300eb3f5342793847a9f3b73c1dd528fd29e2997123b87068635f439df0732 Sep 13 20:26:24.788743 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:24.788710 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" event={"ID":"c6aaf5b4-580a-4280-8115-5702555c18c8","Type":"ContainerStarted","Data":"86300eb3f5342793847a9f3b73c1dd528fd29e2997123b87068635f439df0732"} Sep 13 20:26:25.794792 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:25.794760 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" event={"ID":"c6aaf5b4-580a-4280-8115-5702555c18c8","Type":"ContainerStarted","Data":"15d377e584ee6cb3ae7ac09faf5a02cad342181ccca87ce6b0670b5afdcd81cd"} Sep 13 20:26:25.811434 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:25.811372 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" podStartSLOduration=1.6386707390000002 podStartE2EDuration="1.811357616s" totalImagesPullingTime="172.686877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:26:25.809352103 +0000 UTC m=+805.866459878" watchObservedRunningTime="2026-09-13 20:26:25.811357616 +0000 UTC m=+805.868465431" Sep 13 20:26:28.014828 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:28.014792 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:34.409488 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:34.409448 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:34.409869 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:34.409521 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:34.421833 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:34.421810 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:34.849871 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:34.849845 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6fktc" Sep 13 20:26:51.757129 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:51.757093 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:26:51.810502 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:26:51.810469 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:27:32.012637 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:27:32.012602 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:27:44.697691 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:27:44.697642 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:27:44.855670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:27:44.855635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:27:56.004982 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:27:56.004895 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:28:00.366814 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:28:00.366780 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:28:00.368575 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:28:00.368552 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:29:45.309847 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:29:45.309811 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:30:00.145091 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.145054 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx"] Sep 13 20:30:00.148431 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.148413 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" Sep 13 20:30:00.150494 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.150470 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fzlf8\"" Sep 13 20:30:00.158525 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.158501 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" Sep 13 20:30:00.158670 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.158614 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx"] Sep 13 20:30:00.430007 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.429983 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx"] Sep 13 20:30:00.432585 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:30:00.432559 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c534953_7032_4c1a_a209_29061d32a718.slice/crio-7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8 WatchSource:0}: Error finding container 7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8: Status 404 returned error can't find the container with id 7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8 Sep 13 20:30:00.798341 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:00.798255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" event={"ID":"4c534953-7032-4c1a-a209-29061d32a718","Type":"ContainerStarted","Data":"7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8"} Sep 13 20:30:03.820141 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:03.820056 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" event={"ID":"4c534953-7032-4c1a-a209-29061d32a718","Type":"ContainerStarted","Data":"f17575b75a87cc8c837e99032dff533d1589239d345863fe98a5bda51c623389"} Sep 13 20:30:03.833585 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:03.833536 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" podStartSLOduration=1.176983707 podStartE2EDuration="3.833520619s" totalImagesPullingTime="2.656536912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:30:03.832285246 +0000 UTC m=+1023.889393088" watchObservedRunningTime="2026-09-13 20:30:03.833520619 +0000 UTC m=+1023.890628392" Sep 13 20:30:04.826743 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:04.826712 2552 generic.go:356] "Generic (PLEG): container finished" podID="4c534953-7032-4c1a-a209-29061d32a718" containerID="f17575b75a87cc8c837e99032dff533d1589239d345863fe98a5bda51c623389" exitCode=0 Sep 13 20:30:04.827132 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:04.826797 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" event={"ID":"4c534953-7032-4c1a-a209-29061d32a718","Type":"ContainerDied","Data":"f17575b75a87cc8c837e99032dff533d1589239d345863fe98a5bda51c623389"} Sep 13 20:30:05.960693 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:05.960665 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" Sep 13 20:30:06.836765 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:06.836690 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" Sep 13 20:30:06.836905 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:06.836689 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29822190-x76jx" event={"ID":"4c534953-7032-4c1a-a209-29061d32a718","Type":"ContainerDied","Data":"7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8"} Sep 13 20:30:06.836905 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:30:06.836804 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7baee9891bc384a46748aa54a9f4682a3dc8fa7fa3551d259e669ca6b8e172d8" Sep 13 20:31:29.764849 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:29.764816 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:31:29.818190 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:29.818140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:31:32.525690 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:32.525660 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b5l5x_c235cfe3-95ee-4cdb-a7b7-64a0a770be3b/global-pull-secret-syncer/0.log" Sep 13 20:31:32.621292 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:32.621265 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" Sep 13 20:31:32.706430 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:32.706404 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-25.ec2.internal_fc52f9b4ca129427164928f70b41a169/haproxy/0.log" Sep 13 20:31:38.288064 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:38.288031 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:31:38.398000 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:38.397959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h2zm_222bcd42-3864-4319-a437-f2981088b13d/konnectivity-agent/0.log" limit=1024 Sep 13 20:31:39.663674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:39.663638 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-tpt5h_0afad5f8-e7db-4ba6-b12c-b1d56b9b2994/monitoring-plugin/0.log" Sep 13 20:31:39.855456 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:39.855425 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpnz4_50243467-0613-4730-a475-e5e24034289e/node-exporter/0.log" Sep 13 20:31:39.882767 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:39.882740 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpnz4_50243467-0613-4730-a475-e5e24034289e/kube-rbac-proxy/0.log" Sep 13 20:31:39.909186 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:39.909156 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpnz4_50243467-0613-4730-a475-e5e24034289e/init-textfile/0.log" Sep 13 20:31:40.074029 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.073949 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/prometheus/0.log" Sep 13 20:31:40.104453 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.104427 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/config-reloader/0.log" Sep 13 20:31:40.141024 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.141001 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/thanos-sidecar/0.log" Sep 13 20:31:40.176046 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.176019 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/kube-rbac-proxy-web/0.log" Sep 13 20:31:40.196977 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.196952 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/kube-rbac-proxy/0.log" Sep 13 20:31:40.221769 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.221742 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/kube-rbac-proxy-thanos/0.log" Sep 13 20:31:40.244707 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.244683 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_495be1e4-c18b-4c6d-af31-f4fc4e13f91a/init-config-reloader/0.log" Sep 13 20:31:40.504194 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.504168 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/thanos-query/0.log" Sep 13 20:31:40.532340 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.532313 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/kube-rbac-proxy-web/0.log" Sep 13 20:31:40.553885 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.553860 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/kube-rbac-proxy/0.log" Sep 13 20:31:40.577522 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.577489 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/prom-label-proxy/0.log" Sep 13 20:31:40.608059 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.608026 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/kube-rbac-proxy-rules/0.log" Sep 13 20:31:40.630114 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:40.630086 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657cb8474-s86dc_6b2fb5bd-7f26-4707-9c59-de2ab2cc9370/kube-rbac-proxy-metrics/0.log" Sep 13 20:31:42.662888 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.662859 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/2.log" Sep 13 20:31:42.666649 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.666629 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6wsm2_02c155be-6b92-4d6a-99e7-f7e3fd77923a/console-operator/3.log" Sep 13 20:31:42.852995 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.852963 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz"] Sep 13 20:31:42.853327 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.853314 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c534953-7032-4c1a-a209-29061d32a718" containerName="cleanup" Sep 13 20:31:42.853383 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.853328 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c534953-7032-4c1a-a209-29061d32a718" containerName="cleanup" Sep 13 20:31:42.853419 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.853396 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c534953-7032-4c1a-a209-29061d32a718" containerName="cleanup" Sep 13 20:31:42.856334 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.856316 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:42.858842 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.858822 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6p8pc\"/\"default-dockercfg-kbdk7\"" Sep 13 20:31:42.858842 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.858836 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6p8pc\"/\"openshift-service-ca.crt\"" Sep 13 20:31:42.859016 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.858822 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6p8pc\"/\"kube-root-ca.crt\"" Sep 13 20:31:42.863168 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.862999 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz"] Sep 13 20:31:42.948920 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.948829 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8wp5\" (UniqueName: \"kubernetes.io/projected/26366a87-eb89-48b3-858c-c0acfdc72c9b-kube-api-access-c8wp5\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:42.948920 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.948886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-proc\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:42.949133 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.948937 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-lib-modules\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:42.949133 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.948956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-podres\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:42.949133 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:42.949028 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-sys\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049586 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-proc\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-lib-modules\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-podres\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049670 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-sys\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049676 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-proc\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049770 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wp5\" (UniqueName: \"kubernetes.io/projected/26366a87-eb89-48b3-858c-c0acfdc72c9b-kube-api-access-c8wp5\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049979 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049787 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-sys\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049979 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049799 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-podres\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.049979 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.049795 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26366a87-eb89-48b3-858c-c0acfdc72c9b-lib-modules\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.056771 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.056744 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8wp5\" (UniqueName: \"kubernetes.io/projected/26366a87-eb89-48b3-858c-c0acfdc72c9b-kube-api-access-c8wp5\") pod \"perf-node-gather-daemonset-j7nlz\" (UID: \"26366a87-eb89-48b3-858c-c0acfdc72c9b\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.166572 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.166533 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:43.437307 ip-10-0-140-25 kubenswrapper[2552]: W0913 20:31:43.437276 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26366a87_eb89_48b3_858c_c0acfdc72c9b.slice/crio-09d6df1a086ca983478d2f4ab9edc9b7421da6244a14cc05ba3b99cf73efb26f WatchSource:0}: Error finding container 09d6df1a086ca983478d2f4ab9edc9b7421da6244a14cc05ba3b99cf73efb26f: Status 404 returned error can't find the container with id 09d6df1a086ca983478d2f4ab9edc9b7421da6244a14cc05ba3b99cf73efb26f Sep 13 20:31:43.437431 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:43.437392 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz"] Sep 13 20:31:44.298138 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:44.298106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" event={"ID":"26366a87-eb89-48b3-858c-c0acfdc72c9b","Type":"ContainerStarted","Data":"d76c366fc1bfeabd9e85022b6d385042e2836094ae45cdc1f4169d7bdf0a381d"} Sep 13 20:31:44.298138 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:44.298155 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" event={"ID":"26366a87-eb89-48b3-858c-c0acfdc72c9b","Type":"ContainerStarted","Data":"09d6df1a086ca983478d2f4ab9edc9b7421da6244a14cc05ba3b99cf73efb26f"} Sep 13 20:31:44.298637 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:44.298249 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:44.312757 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:44.312708 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" podStartSLOduration=2.312691416 podStartE2EDuration="2.312691416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:31:44.311032993 +0000 UTC m=+1124.368140768" watchObservedRunningTime="2026-09-13 20:31:44.312691416 +0000 UTC m=+1124.369799233" Sep 13 20:31:45.014592 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:45.014559 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqw6x_adf37eaa-5232-4fd6-9bcd-f30e038121e7/dns/0.log" Sep 13 20:31:45.032877 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:45.032852 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qqw6x_adf37eaa-5232-4fd6-9bcd-f30e038121e7/kube-rbac-proxy/0.log" Sep 13 20:31:45.097429 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:45.097395 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-txg5f_2ebeedaf-987e-4115-bd68-a91831c60851/dns-node-resolver/0.log" Sep 13 20:31:45.590627 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:45.590589 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59c6b49954-286m4_77b7a8d4-bed4-4926-ad4f-0805dc800292/registry/0.log" Sep 13 20:31:45.610060 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:45.610034 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-55hxr_8fba836b-de7b-4c89-a6d3-15a67df7bfc1/node-ca/0.log" Sep 13 20:31:46.521880 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:46.521847 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv_f7cd61e1-d943-4232-b8a1-184ee38acbf5/istio-proxy/0.log" Sep 13 20:31:46.563574 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:46.563549 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-th2fl_a4ab8caf-9d90-491b-aac5-e86787b4f258/discovery/0.log" Sep 13 20:31:46.632296 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:46.632266 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/1.log" Sep 13 20:31:46.632674 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:46.632600 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/0.log" Sep 13 20:31:47.290664 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.290632 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gkjsq_dcad819b-8440-46b2-979e-e091d1f1e09b/serve-healthcheck-canary/0.log" Sep 13 20:31:47.792578 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.792547 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-cnhsh_847a4ad7-2e78-4aaf-ac34-53527005f060/insights-operator/1.log" Sep 13 20:31:47.792995 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.792642 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-cnhsh_847a4ad7-2e78-4aaf-ac34-53527005f060/insights-operator/0.log" Sep 13 20:31:47.937624 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.937594 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkjjb_31340230-69dd-40ed-a553-c81cde570ddd/kube-rbac-proxy/0.log" Sep 13 20:31:47.955684 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.955658 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkjjb_31340230-69dd-40ed-a553-c81cde570ddd/exporter/0.log" Sep 13 20:31:47.973950 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:47.973922 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vkjjb_31340230-69dd-40ed-a553-c81cde570ddd/extractor/0.log" Sep 13 20:31:50.205227 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:50.205186 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2nbvz_6dce5708-4475-4842-a27f-696c9ea83fb5/manager/0.log" Sep 13 20:31:50.312663 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:50.312634 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-j7nlz" Sep 13 20:31:50.329739 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:50.329715 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9f8b966-t6ldt_b21a49ea-51d5-48cf-935a-5bb37fa60ac4/manager/0.log" Sep 13 20:31:50.349869 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:50.349846 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9f8b966-t6ldt_b21a49ea-51d5-48cf-935a-5bb37fa60ac4/copy-manifests/0.log" Sep 13 20:31:51.564592 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:51.564563 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-768f8bb9c7-wjbjt_eb549cba-454f-4f4b-8f1b-fef9ed524589/manager/0.log" Sep 13 20:31:53.449318 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:53.449283 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv_f7cd61e1-d943-4232-b8a1-184ee38acbf5/istio-proxy/0.log" Sep 13 20:31:53.486197 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:53.486166 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-th2fl_a4ab8caf-9d90-491b-aac5-e86787b4f258/discovery/0.log" Sep 13 20:31:53.534702 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:53.534676 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/1.log" Sep 13 20:31:53.535076 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:53.535059 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/0.log" Sep 13 20:31:54.754131 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:54.754098 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-vczdv_f7cd61e1-d943-4232-b8a1-184ee38acbf5/istio-proxy/0.log" Sep 13 20:31:54.792870 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:54.792839 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-th2fl_a4ab8caf-9d90-491b-aac5-e86787b4f258/discovery/0.log" Sep 13 20:31:54.840532 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:54.840506 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/1.log" Sep 13 20:31:54.840837 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:54.840821 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-krlx5_dda5e0f7-679b-45e2-9be5-4b05c45a56b3/istio-proxy/0.log" Sep 13 20:31:58.078613 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.078582 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8dgpt_62de7027-443f-4614-bf0a-b253fbef2177/kube-multus/0.log" Sep 13 20:31:58.235135 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.235109 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/kube-multus-additional-cni-plugins/0.log" Sep 13 20:31:58.252907 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.252886 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/egress-router-binary-copy/0.log" Sep 13 20:31:58.270273 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.270251 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/cni-plugins/0.log" Sep 13 20:31:58.288005 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.287985 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/bond-cni-plugin/0.log" Sep 13 20:31:58.306576 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.306554 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/routeoverride-cni/0.log" Sep 13 20:31:58.327033 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.327006 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/whereabouts-cni-bincopy/0.log" Sep 13 20:31:58.345364 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.345301 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rdzf4_9a19bd69-fd59-4e29-b790-c0c1d55091cc/whereabouts-cni/0.log" Sep 13 20:31:58.649334 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.649304 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cl629_8d579d23-826f-42e1-bdce-8bcc78ce62dd/network-metrics-daemon/0.log" Sep 13 20:31:58.666429 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:58.666407 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cl629_8d579d23-826f-42e1-bdce-8bcc78ce62dd/kube-rbac-proxy/0.log" Sep 13 20:31:59.777720 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.777694 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/ovn-controller/0.log" Sep 13 20:31:59.795189 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.795162 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/ovn-acl-logging/0.log" Sep 13 20:31:59.818737 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.818699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/kube-rbac-proxy-node/0.log" Sep 13 20:31:59.836943 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.836921 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/kube-rbac-proxy-ovn-metrics/0.log" Sep 13 20:31:59.853809 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.853769 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/northd/0.log" Sep 13 20:31:59.871606 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.871577 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/nbdb/0.log" Sep 13 20:31:59.889729 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.889704 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/sbdb/0.log" Sep 13 20:31:59.921795 ip-10-0-140-25 kubenswrapper[2552]: I0913 20:31:59.921774 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgmk9_dd41443e-a134-4b67-a1ab-5ea2b9526f7e/ovnkube-controller/0.log"