Jul 10 18:40:12.699457 ip-10-0-138-0 systemd[1]: Starting Kubernetes Kubelet... Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.111631 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116126 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116145 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116149 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116152 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116158 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116162 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.166185 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116164 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116167 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116170 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116173 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116176 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116178 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116181 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116183 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116186 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116189 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116192 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116195 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116197 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116200 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116203 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116206 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116209 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116211 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116214 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.170870 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116219 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116222 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116224 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116228 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116237 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116240 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116243 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116245 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116248 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116251 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116253 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116256 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116258 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116262 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116264 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116267 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116270 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116272 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116275 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116279 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.171562 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116281 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116284 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116286 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116289 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116292 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116295 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116300 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116304 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116307 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116310 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116313 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116315 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116317 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116320 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116323 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116325 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116328 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116330 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116332 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116335 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.174580 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116338 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116340 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116343 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116345 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116348 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116350 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116353 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116356 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116358 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116362 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116364 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116367 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116369 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116372 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116374 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116377 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116380 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116384 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116388 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.176018 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116391 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116394 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116397 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116401 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116404 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116407 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116410 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116413 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116415 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116418 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116420 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116423 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.116425 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117166 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117175 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117178 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117181 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117184 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.179393 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117187 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117189 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117192 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117195 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117197 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117200 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117202 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117205 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117208 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117210 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117213 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117215 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117218 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117223 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117226 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117229 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117232 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117235 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117238 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.180549 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117240 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117243 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117245 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117248 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117250 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117252 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117256 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117258 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117261 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117263 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117266 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117269 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117271 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117274 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117276 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117280 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117282 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117285 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117288 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117290 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.184980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117292 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.184834 ip-10-0-138-0 systemd[1]: Started Kubernetes Kubelet. Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117295 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117298 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117300 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117303 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117306 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117309 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117312 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117315 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117317 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117320 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117322 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117325 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117327 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117330 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117332 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117335 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117337 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117343 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117346 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.186138 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117349 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117352 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117354 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117357 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117360 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117362 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117365 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117367 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117370 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117372 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117375 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117377 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117380 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117383 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117385 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117388 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117390 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117393 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117395 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.190638 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117399 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117401 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117404 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117407 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117410 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117413 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117416 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117419 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117421 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117424 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117426 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117430 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117433 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117436 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117439 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117441 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117829 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117834 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117837 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117839 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.191325 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117842 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117844 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117847 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117850 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117854 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117858 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117861 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117864 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117867 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117870 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117873 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117876 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117879 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117882 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117885 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117887 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117890 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117892 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117895 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.195277 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117897 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117899 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117902 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117904 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117908 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117911 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117914 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117916 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117919 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117921 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117924 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117926 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117929 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117931 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117933 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117936 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117938 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117940 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117943 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117945 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.196129 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117948 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117950 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117953 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117956 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117958 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117961 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117964 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117966 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117968 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117971 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117975 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117978 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117981 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117984 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117986 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117989 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117992 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117997 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.117999 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.201199 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118002 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118004 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118007 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118010 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118012 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118016 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118018 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118021 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118023 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118026 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118028 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118031 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118033 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118035 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118038 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118040 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118043 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118045 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118048 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.202553 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118050 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118055 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118058 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118061 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118064 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118067 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118078 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118081 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118098 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118101 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118105 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118110 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118113 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118115 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118118 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118120 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118123 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118125 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118197 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118205 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 18:40:13.295892 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118212 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118217 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118221 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118224 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118228 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118233 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118237 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118240 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118244 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118247 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118250 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118253 2563 flags.go:64] FLAG: --cgroup-root="" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118255 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118258 2563 flags.go:64] FLAG: --client-ca-file="" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118262 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118265 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118269 2563 flags.go:64] FLAG: --cluster-domain="" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118272 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118275 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118278 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118281 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118285 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118289 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 18:40:13.296949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118293 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118296 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118300 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118303 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118306 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118309 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118312 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118316 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118319 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118322 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118325 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118328 2563 flags.go:64] FLAG: --enable-server="true" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118331 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118338 2563 flags.go:64] FLAG: --event-burst="100" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118341 2563 flags.go:64] FLAG: --event-qps="50" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118344 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118347 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118350 2563 flags.go:64] FLAG: --eviction-hard="" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118354 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118356 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118359 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118362 2563 flags.go:64] FLAG: --eviction-soft="" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118365 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118368 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118374 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 18:40:13.301505 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118377 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118380 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118383 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118386 2563 flags.go:64] FLAG: --feature-gates="" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118389 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118392 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118396 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118401 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118404 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118407 2563 flags.go:64] FLAG: --help="false" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118410 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118413 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118416 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118419 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118422 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118425 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118428 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118431 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118434 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118437 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118439 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118442 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118445 2563 flags.go:64] FLAG: --kube-reserved="" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118448 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 18:40:13.302557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118451 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118454 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118457 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118460 2563 flags.go:64] FLAG: --lock-file="" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118463 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118465 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118468 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118474 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118477 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118480 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118483 2563 flags.go:64] FLAG: --logging-format="text" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118485 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118489 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118491 2563 flags.go:64] FLAG: --manifest-url="" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118495 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118501 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118504 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118508 2563 flags.go:64] FLAG: --max-pods="110" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118511 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118514 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118516 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118519 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118522 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118525 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118528 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 18:40:13.303594 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118535 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118538 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118541 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118544 2563 flags.go:64] FLAG: --pod-cidr="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118547 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118553 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118556 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118559 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118562 2563 flags.go:64] FLAG: --port="10250" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118565 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118568 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ce5900fd41f9b68e" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118571 2563 flags.go:64] FLAG: --qos-reserved="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118574 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118577 2563 flags.go:64] FLAG: --register-node="true" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118580 2563 flags.go:64] FLAG: --register-with-taints="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118583 2563 flags.go:64] FLAG: --registry-burst="10" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118587 2563 flags.go:64] FLAG: --registry-qps="5" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118589 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118592 2563 flags.go:64] FLAG: --reserved-memory="" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118596 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118599 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118603 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118606 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118610 2563 flags.go:64] FLAG: --runonce="false" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118613 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 18:40:13.307891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118616 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118620 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118622 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118625 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118628 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118631 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118634 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118637 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118640 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118643 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118645 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118648 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118651 2563 flags.go:64] FLAG: --system-cgroups="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118654 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118659 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118662 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118664 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118668 2563 flags.go:64] FLAG: --tls-min-version="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118671 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118673 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118676 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118679 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118682 2563 flags.go:64] FLAG: --v="2" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118686 2563 flags.go:64] FLAG: --version="false" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118691 2563 flags.go:64] FLAG: --vmodule="" Jul 10 18:40:13.308978 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118694 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.118698 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118814 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118819 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118823 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118827 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118830 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118833 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118835 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118838 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118840 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118843 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118845 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118848 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118850 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118853 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118855 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118858 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118861 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118863 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.310046 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118866 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118868 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118871 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118873 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118875 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118878 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118880 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118883 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118886 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118888 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118891 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118893 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118896 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118898 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118901 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118905 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118907 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118912 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118915 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118917 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.312207 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118920 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118922 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118925 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118927 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118930 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118932 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118935 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118937 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118940 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118942 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118945 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118947 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118950 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118952 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118955 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118957 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118959 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118962 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118965 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118967 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.312914 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118970 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118973 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118975 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118978 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118981 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118984 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118986 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118990 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118993 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.118997 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119000 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119003 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119008 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119011 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119014 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119017 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119019 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119022 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119025 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.315777 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119027 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119030 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119032 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119039 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119042 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119044 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119047 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119049 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119051 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119054 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119057 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119060 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119063 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119066 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119076 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119079 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119082 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119096 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119099 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.316487 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119102 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119107 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.119111 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.119962 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.127212 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.127231 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.127250 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.127258 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127340 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127346 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127349 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127352 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127355 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127358 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.405579 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127361 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127364 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127367 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127370 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127372 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127376 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127380 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127383 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127393 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127397 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127400 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127402 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127405 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127408 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127410 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127413 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127416 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127419 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127422 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127425 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.406307 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127428 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127430 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127433 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127437 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127439 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127442 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127445 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127447 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127450 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127452 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127455 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127457 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127460 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127462 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127465 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127467 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127470 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127472 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127475 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127477 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.500368 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127480 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127483 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127487 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127490 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127494 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127497 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127499 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127502 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127505 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127508 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127510 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127513 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127515 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127519 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127523 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127526 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127529 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127532 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127535 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.501449 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127537 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127540 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127542 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127545 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127547 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127550 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127553 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127555 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127558 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127561 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127563 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127565 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127568 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127571 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127573 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127576 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127579 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127581 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127584 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127586 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.502197 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127588 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127591 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127598 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127600 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127603 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127606 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127608 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127611 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127613 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127616 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127619 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127621 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127624 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127626 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.127631 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:13.503583 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127747 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127753 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127756 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127760 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127764 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127767 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127770 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127774 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127777 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127780 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127783 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127786 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127788 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127791 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127794 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127796 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127799 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127802 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127804 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:40:13.504312 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127809 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127813 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127816 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127819 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127822 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127824 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127827 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127829 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127835 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127837 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127840 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127842 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127845 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127847 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127850 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127853 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127856 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127858 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127861 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:40:13.505378 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127863 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127866 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127868 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127870 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127873 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127875 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127878 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127881 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127883 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127888 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127891 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127895 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127899 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127901 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127904 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127906 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127909 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127912 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127914 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:40:13.506103 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127916 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127919 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127922 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127925 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127927 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127930 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127933 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127935 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127938 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127940 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127942 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127945 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127947 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127950 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127952 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127955 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127957 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127960 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127962 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:40:13.507188 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127965 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127967 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127970 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127972 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127975 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127979 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127983 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127986 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127988 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127991 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127993 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127996 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.127999 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128003 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128006 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128008 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128012 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128015 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128018 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:40:13.508980 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128020 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:13.128023 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.128028 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.128183 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.130192 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.131632 2563 server.go:1019] "Starting client certificate rotation" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.131743 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.132539 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.134199 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.136387 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.147334 2563 log.go:25] "Validated CRI v1 runtime API" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.153280 2563 log.go:25] "Validated CRI v1 image API" Jul 10 18:40:13.509651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.154109 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 18:40:13.510033 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.156776 2563 fs.go:135] Filesystem UUIDs: map[5614155f-70a1-474f-95cd-c0acae8e452a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b92cc3a1-b5e7-4f31-985f-5f36c003a9a1:/dev/nvme0n1p3] Jul 10 18:40:13.510033 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.156796 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.163102 2563 manager.go:216] Machine: {Timestamp:2026-07-10 18:40:13.161747975 +0000 UTC m=+0.333900854 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098394 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fdea896f586ec09eaec7efbe0cc10 SystemUUID:ec2fdea8-96f5-86ec-09ea-ec7efbe0cc10 BootID:dc6f83e2-26ce-41a7-8925-85e793b50f09 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:be:38:a1:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:be:38:a1:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:db:f0:11:ee:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.163217 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.163360 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.165997 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.166032 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.167549 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.167564 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.167572 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.168172 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.169265 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.170345 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172158 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172278 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172306 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172317 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172329 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 18:40:13.510124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172340 2563 kubelet.go:398] "Adding apiserver pod source" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172349 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172714 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.172728 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.176581 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178696 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178731 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178918 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178948 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178956 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178977 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.178996 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179003 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179410 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179422 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179428 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179433 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179446 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.179462 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.180127 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.180144 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.182891 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.182976 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.182975 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.183815 2563 server.go:1268] "Started kubelet" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.183908 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.184048 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.184163 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.185473 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.188494 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.190586 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.192943 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2ddk" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.190340 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c101b7108d7561 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-10 18:40:13.183776097 +0000 UTC m=+0.355928976,LastTimestamp:2026-07-10 18:40:13.183776097 +0000 UTC m=+0.355928976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.193656 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.193668 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.193755 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194510 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194527 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194546 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194690 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194701 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 10 18:40:13.510688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194846 2563 factory.go:55] Registering systemd factory Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.194866 2563 factory.go:223] Registration of the systemd container factory successfully Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.195113 2563 factory.go:153] Registering CRI-O factory Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.195127 2563 factory.go:223] Registration of the crio container factory successfully Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.195176 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.195201 2563 factory.go:103] Registering Raw factory Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.195215 2563 manager.go:1196] Started watching for new ooms in manager Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.196167 2563 manager.go:349] Starting recovery of all containers Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.200811 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k2ddk" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.201787 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.202000 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.206214 2563 manager.go:354] Recovery completed Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.212082 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.213969 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.213997 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.214009 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.214653 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.214665 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.214683 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.214684 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.215483 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.215507 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.215521 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.216212 2563 policy_none.go:49] "None policy: Start" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.216234 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.216247 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.216828 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c101b7125a6060 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-10 18:40:13.213982816 +0000 UTC m=+0.386135694,LastTimestamp:2026-07-10 18:40:13.213982816 +0000 UTC m=+0.386135694,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.217384 2563 policy_none.go:47] "Start" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.294615 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.394847 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.409385 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.511950 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.495579 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.596727 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.596550 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.598816 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.598799 2563 manager.go:337] "Starting Device Plugin manager" Jul 10 18:40:13.598903 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.598843 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 18:40:13.598903 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.598854 2563 server.go:87] "Starting device plugin registration server" Jul 10 18:40:13.599222 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.599196 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 18:40:13.599307 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.599219 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 18:40:13.599307 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.599293 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 18:40:13.599405 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.599398 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 18:40:13.599405 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.599404 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 18:40:13.600016 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.600001 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 18:40:13.600080 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.600041 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.699808 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.699774 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.700960 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.700785 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.700960 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.700836 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.700960 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.700865 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.700960 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.700908 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.702226 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.702203 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 18:40:13.703660 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.703637 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 18:40:13.703752 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.703673 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 18:40:13.703752 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.703695 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 18:40:13.703752 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.703728 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 18:40:13.707531 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.707515 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:13.712345 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.712331 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.712415 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.712354 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-0.ec2.internal\": node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.788238 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.788147 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.805269 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.804539 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"] Jul 10 18:40:13.805412 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.805307 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.806306 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.806288 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.806400 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.806320 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.806400 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.806330 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.807490 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.807478 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.807632 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.807600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.807724 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.807643 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.808250 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808233 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.808340 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808263 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.808340 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808273 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.808340 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808239 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.808340 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808325 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.808340 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.808335 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.809482 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.809469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.809521 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.809495 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:40:13.810131 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.810116 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:40:13.810214 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.810141 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:40:13.810214 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.810150 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:40:13.831165 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.831138 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.834755 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.834734 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.888730 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.888701 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.899181 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.899153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6997a03359e3b626c552aedfb5b0c321-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"6997a03359e3b626c552aedfb5b0c321\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.899321 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.899185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.899321 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.899209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.989244 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:13.989217 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:13.999637 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6997a03359e3b626c552aedfb5b0c321-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"6997a03359e3b626c552aedfb5b0c321\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.999690 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.999726 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.999758 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6997a03359e3b626c552aedfb5b0c321-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"6997a03359e3b626c552aedfb5b0c321\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.999758 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:13.999758 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:13.999735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f96e34d9178647af1e5b0fedc7f0f722-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"f96e34d9178647af1e5b0fedc7f0f722\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:14.089834 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:14.089764 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:14.131283 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.131257 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 18:40:14.131454 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.131430 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 18:40:14.133439 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.133412 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:14.138236 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.138216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:14.168205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.168169 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:14.190570 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:14.190535 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:14.204461 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.204414 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:35:13 +0000 UTC" deadline="2028-04-18 20:05:16.544252482 +0000 UTC" Jul 10 18:40:14.204461 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.204451 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15553h25m2.339804699s" Jul 10 18:40:14.291655 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:14.291617 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:14.392167 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:14.392079 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 10 18:40:14.438897 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.438872 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:14.493916 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.493892 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 10 18:40:14.506030 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.506003 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:40:14.507257 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.507241 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 10 18:40:14.513773 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.513753 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:40:14.569463 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.569438 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:14.795122 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:14.795078 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6997a03359e3b626c552aedfb5b0c321.slice/crio-fc4c9291062a3595473fb8520860393a5248384353a6ac2c1511eea8e7b50928 WatchSource:0}: Error finding container fc4c9291062a3595473fb8520860393a5248384353a6ac2c1511eea8e7b50928: Status 404 returned error can't find the container with id fc4c9291062a3595473fb8520860393a5248384353a6ac2c1511eea8e7b50928 Jul 10 18:40:14.799498 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:14.799480 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:40:14.820019 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:14.819995 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96e34d9178647af1e5b0fedc7f0f722.slice/crio-b45a02b7bfcdd2e221b9d2613adfcb1cfb667ea0d6c680bb5debf06308966984 WatchSource:0}: Error finding container b45a02b7bfcdd2e221b9d2613adfcb1cfb667ea0d6c680bb5debf06308966984: Status 404 returned error can't find the container with id b45a02b7bfcdd2e221b9d2613adfcb1cfb667ea0d6c680bb5debf06308966984 Jul 10 18:40:15.174333 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.174240 2563 apiserver.go:52] "Watching apiserver" Jul 10 18:40:15.181493 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.181467 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 18:40:15.182657 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.182636 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph","openshift-cluster-node-tuning-operator/tuned-gzrqm","openshift-dns/node-resolver-9t9wr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal","openshift-multus/multus-j9r96","openshift-network-diagnostics/network-check-target-m7sk2","kube-system/global-pull-secret-syncer-stdf8","openshift-image-registry/node-ca-wp989","openshift-multus/multus-additional-cni-plugins-n2zzn","openshift-multus/network-metrics-daemon-xrpg8","openshift-network-operator/iptables-alerter-sgbsf","openshift-ovn-kubernetes/ovnkube-node-v7p7g","kube-system/konnectivity-agent-vhbqx","kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"] Jul 10 18:40:15.185500 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.185473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.186679 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.186659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.187746 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.187727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.188269 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.188247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 18:40:15.188369 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.188253 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6nnz4\"" Jul 10 18:40:15.188369 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.188302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.188369 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.188311 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.188913 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.188898 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.189344 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189324 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 18:40:15.189344 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 18:40:15.189499 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189349 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ntzfd\"" Jul 10 18:40:15.189950 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189935 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.190038 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189969 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s8ghq\"" Jul 10 18:40:15.190038 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.189975 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.190330 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.190316 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.191677 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.191502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.191677 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.191565 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xjlrg\"" Jul 10 18:40:15.191677 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.191570 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:15.191677 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.191592 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.191677 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.191638 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 18:40:15.191908 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.191644 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.192499 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.192483 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.193132 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.192996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 18:40:15.193132 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193011 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 18:40:15.193132 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193022 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hv9sp\"" Jul 10 18:40:15.193545 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193527 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 18:40:15.193646 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193588 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.193646 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193613 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 18:40:15.193827 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193810 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 18:40:15.193937 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.193923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.194007 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.193988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:15.195351 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.195334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.196627 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.196602 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:15.196702 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.196663 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:15.197434 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.197412 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 18:40:15.197768 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.197751 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.198001 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.197959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.198102 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.198017 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 18:40:15.198102 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.198026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 18:40:15.198213 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.198143 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.198290 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.198256 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qkhjt\"" Jul 10 18:40:15.199367 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.199349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.200310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.200294 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 18:40:15.200557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.200542 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.200626 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.200593 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xbtkr\"" Jul 10 18:40:15.200703 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.200668 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.200760 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.200742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.201958 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.201940 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 18:40:15.202031 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.202017 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z292f\"" Jul 10 18:40:15.203763 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.203747 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znqk9\"" Jul 10 18:40:15.203856 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.203752 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:40:15.204366 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204350 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 18:40:15.204893 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.204942 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a95f62d-e232-4534-b621-39e3ed634488-agent-certs\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.204942 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-systemd-units\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-ovn\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bznf\" (UniqueName: \"kubernetes.io/projected/1a759fa5-5a0f-49ec-b327-a578419c882b-kube-api-access-5bznf\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.204996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvmn\" (UniqueName: \"kubernetes.io/projected/79ef32f7-0a7f-460d-a902-89dc172b2c9e-kube-api-access-xzvmn\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-kubelet-config\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-cnibin\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-sys-fs\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.205184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-netns\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-systemd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98a526a-2939-4ded-863e-b0465789c4f9-tmp-dir\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-socket-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-netd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f09e463-c794-44b5-ae39-0fac266bd33c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-dbus\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-os-release\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98a526a-2939-4ded-863e-b0465789c4f9-hosts-file\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-kubelet\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.205602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-config\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv4gd\" (UniqueName: \"kubernetes.io/projected/0f09e463-c794-44b5-ae39-0fac266bd33c-kube-api-access-qv4gd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6pc4\" (UniqueName: \"kubernetes.io/projected/b98a526a-2939-4ded-863e-b0465789c4f9-kube-api-access-t6pc4\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a95f62d-e232-4534-b621-39e3ed634488-konnectivity-ca\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdsvh\" (UniqueName: \"kubernetes.io/projected/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kube-api-access-zdsvh\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-node-log\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-system-cni-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205783 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-host\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-serviceca\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hcd\" (UniqueName: \"kubernetes.io/projected/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-kube-api-access-g9hcd\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-registration-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-log-socket\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-env-overrides\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.205983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.206158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-device-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.206865 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-slash\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206865 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-var-lib-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206865 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-etc-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206865 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-bin\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.206865 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.206121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-script-lib\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.209319 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.208840 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:40:15.236640 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.236612 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vs5rf" Jul 10 18:40:15.245714 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.245689 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vs5rf" Jul 10 18:40:15.296451 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.296419 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 18:40:15.306399 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.306399 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4gd\" (UniqueName: \"kubernetes.io/projected/0f09e463-c794-44b5-ae39-0fac266bd33c-kube-api-access-qv4gd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ba34355-e094-4969-951e-e177ad8b4c5a-iptables-alerter-script\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6pc4\" (UniqueName: \"kubernetes.io/projected/b98a526a-2939-4ded-863e-b0465789c4f9-kube-api-access-t6pc4\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306491 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-node-log\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306563 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-node-log\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cni-binary-copy\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-socket-dir-parent\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.306630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysconfig\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.306658 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hcd\" (UniqueName: \"kubernetes.io/projected/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-kube-api-access-g9hcd\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.306748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:15.806713553 +0000 UTC m=+2.978866426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-log-socket\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-env-overrides\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306848 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-log-socket\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-systemd\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-sys\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-device-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-slash\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-var-lib-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.306998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-device-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-etc-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-slash\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307045 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-var-lib-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-etc-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-bin\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-k8s-cni-cncf-io\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307134 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-bin\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bznf\" (UniqueName: \"kubernetes.io/projected/1a759fa5-5a0f-49ec-b327-a578419c882b-kube-api-access-5bznf\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtwjx\" (UniqueName: \"kubernetes.io/projected/1ba34355-e094-4969-951e-e177ad8b4c5a-kube-api-access-xtwjx\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-system-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-etc-tuned\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-kubelet-config\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-env-overrides\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-cnibin\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-kubelet\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-daemon-config\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307428 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-kubelet-config\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307435 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-cnibin\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.307910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-multus-certs\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-lib-modules\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-host\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-netns\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cnibin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-socket-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-netd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f09e463-c794-44b5-ae39-0fac266bd33c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307635 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-run-netns\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-dbus\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-cni-netd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-os-release\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-socket-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-modprobe-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98a526a-2939-4ded-863e-b0465789c4f9-hosts-file\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307799 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-os-release\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.308528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-kubelet\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-config\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307849 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-kubelet\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-hostroot\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a95f62d-e232-4534-b621-39e3ed634488-konnectivity-ca\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307893 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-dbus\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307901 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98a526a-2939-4ded-863e-b0465789c4f9-hosts-file\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdsvh\" (UniqueName: \"kubernetes.io/projected/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kube-api-access-zdsvh\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-system-cni-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.307951 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308199 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a759fa5-5a0f-49ec-b327-a578419c882b-system-cni-dir\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-os-release\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-conf-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-host\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-serviceca\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-registration-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308393 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-host\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.309372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308430 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-config\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba34355-e094-4969-951e-e177ad8b4c5a-host-slash\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-bin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308472 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a95f62d-e232-4534-b621-39e3ed634488-konnectivity-ca\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-etc-kubernetes\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308501 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-registration-dir\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-kubernetes\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-script-lib\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-netns\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.308771 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-conf\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-run\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:15.310002 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308898 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-serviceca\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a95f62d-e232-4534-b621-39e3ed634488-agent-certs\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.308950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-systemd-units\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.308968 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:15.808948028 +0000 UTC m=+2.981100897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-systemd-units\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-ovn\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-multus\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-ovn\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvmn\" (UniqueName: \"kubernetes.io/projected/79ef32f7-0a7f-460d-a902-89dc172b2c9e-kube-api-access-xzvmn\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309160 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f09e463-c794-44b5-ae39-0fac266bd33c-ovnkube-script-lib\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6phw\" (UniqueName: \"kubernetes.io/projected/482b3da1-5851-4e2f-8f79-2af8a537cc7b-kube-api-access-c6phw\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-var-lib-kubelet\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-sys-fs\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-systemd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.310634 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-sys-fs\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309371 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-openvswitch\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309415 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309418 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f09e463-c794-44b5-ae39-0fac266bd33c-run-systemd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-tmp\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7bvn\" (UniqueName: \"kubernetes.io/projected/02642297-0565-4067-99b6-f1cf7f71b81c-kube-api-access-j7bvn\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98a526a-2939-4ded-863e-b0465789c4f9-tmp-dir\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309793 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98a526a-2939-4ded-863e-b0465789c4f9-tmp-dir\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.311207 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.309885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a759fa5-5a0f-49ec-b327-a578419c882b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.312034 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.311998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f09e463-c794-44b5-ae39-0fac266bd33c-ovn-node-metrics-cert\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.312146 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.312014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a95f62d-e232-4534-b621-39e3ed634488-agent-certs\") pod \"konnectivity-agent-vhbqx\" (UID: \"0a95f62d-e232-4534-b621-39e3ed634488\") " pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.318947 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.318905 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4gd\" (UniqueName: \"kubernetes.io/projected/0f09e463-c794-44b5-ae39-0fac266bd33c-kube-api-access-qv4gd\") pod \"ovnkube-node-v7p7g\" (UID: \"0f09e463-c794-44b5-ae39-0fac266bd33c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.318947 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.318918 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hcd\" (UniqueName: \"kubernetes.io/projected/d3dd4bb9-5062-4ff8-8595-42b46a63bbb7-kube-api-access-g9hcd\") pod \"node-ca-wp989\" (UID: \"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7\") " pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.319392 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.319348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6pc4\" (UniqueName: \"kubernetes.io/projected/b98a526a-2939-4ded-863e-b0465789c4f9-kube-api-access-t6pc4\") pod \"node-resolver-9t9wr\" (UID: \"b98a526a-2939-4ded-863e-b0465789c4f9\") " pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.319969 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.319953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdsvh\" (UniqueName: \"kubernetes.io/projected/1b32cdb1-c26e-4f68-b5fa-31b026daa74b-kube-api-access-zdsvh\") pod \"aws-ebs-csi-driver-node-s6bph\" (UID: \"1b32cdb1-c26e-4f68-b5fa-31b026daa74b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.319969 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.319961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bznf\" (UniqueName: \"kubernetes.io/projected/1a759fa5-5a0f-49ec-b327-a578419c882b-kube-api-access-5bznf\") pod \"multus-additional-cni-plugins-n2zzn\" (UID: \"1a759fa5-5a0f-49ec-b327-a578419c882b\") " pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.320463 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.320420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvmn\" (UniqueName: \"kubernetes.io/projected/79ef32f7-0a7f-460d-a902-89dc172b2c9e-kube-api-access-xzvmn\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.410013 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.409976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-modprobe-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-hostroot\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-os-release\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-conf-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba34355-e094-4969-951e-e177ad8b4c5a-host-slash\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-bin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-etc-kubernetes\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410217 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-kubernetes\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-netns\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-conf\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-run\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-multus\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ba34355-e094-4969-951e-e177ad8b4c5a-host-slash\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6phw\" (UniqueName: \"kubernetes.io/projected/482b3da1-5851-4e2f-8f79-2af8a537cc7b-kube-api-access-c6phw\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410392 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-hostroot\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-var-lib-kubelet\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-tmp\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7bvn\" (UniqueName: \"kubernetes.io/projected/02642297-0565-4067-99b6-f1cf7f71b81c-kube-api-access-j7bvn\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ba34355-e094-4969-951e-e177ad8b4c5a-iptables-alerter-script\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cni-binary-copy\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-socket-dir-parent\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysconfig\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.410620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410628 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-bin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-systemd\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-systemd\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-sys\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-socket-dir-parent\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-k8s-cni-cncf-io\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysconfig\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtwjx\" (UniqueName: \"kubernetes.io/projected/1ba34355-e094-4969-951e-e177ad8b4c5a-kube-api-access-xtwjx\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-system-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410794 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-cni-multus\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-etc-kubernetes\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410832 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-system-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-var-lib-kubelet\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-k8s-cni-cncf-io\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410883 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-kubernetes\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410884 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-cni-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-netns\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.411410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411021 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-sysctl-conf\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.410898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-etc-tuned\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411055 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-etc-modprobe-d\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-kubelet\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411120 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cni-binary-copy\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-sys\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-os-release\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-daemon-config\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-multus-certs\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-lib-modules\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-host\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cnibin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411304 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-run-multus-certs\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-run\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411330 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-cnibin\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-host\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-host-var-lib-kubelet\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02642297-0565-4067-99b6-f1cf7f71b81c-lib-modules\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.412251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411472 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-conf-dir\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.413106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411608 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482b3da1-5851-4e2f-8f79-2af8a537cc7b-multus-daemon-config\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.413106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.411630 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ba34355-e094-4969-951e-e177ad8b4c5a-iptables-alerter-script\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.414188 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.414164 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-tmp\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.414326 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.414186 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02642297-0565-4067-99b6-f1cf7f71b81c-etc-tuned\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.418926 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.418902 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:15.419056 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.418932 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:15.419056 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.418946 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:15.419056 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.419024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:15.919006232 +0000 UTC m=+3.091159099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:15.421654 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.421624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtwjx\" (UniqueName: \"kubernetes.io/projected/1ba34355-e094-4969-951e-e177ad8b4c5a-kube-api-access-xtwjx\") pod \"iptables-alerter-sgbsf\" (UID: \"1ba34355-e094-4969-951e-e177ad8b4c5a\") " pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.422069 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.422025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6phw\" (UniqueName: \"kubernetes.io/projected/482b3da1-5851-4e2f-8f79-2af8a537cc7b-kube-api-access-c6phw\") pod \"multus-j9r96\" (UID: \"482b3da1-5851-4e2f-8f79-2af8a537cc7b\") " pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.423082 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.423056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7bvn\" (UniqueName: \"kubernetes.io/projected/02642297-0565-4067-99b6-f1cf7f71b81c-kube-api-access-j7bvn\") pod \"tuned-gzrqm\" (UID: \"02642297-0565-4067-99b6-f1cf7f71b81c\") " pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.496769 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.496686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wp989" Jul 10 18:40:15.502573 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.502541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:15.508510 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.508478 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3dd4bb9_5062_4ff8_8595_42b46a63bbb7.slice/crio-026b061ce51e0150ab556b5ff086c539d2eab23f794f754e1ff872fcb1c59eef WatchSource:0}: Error finding container 026b061ce51e0150ab556b5ff086c539d2eab23f794f754e1ff872fcb1c59eef: Status 404 returned error can't find the container with id 026b061ce51e0150ab556b5ff086c539d2eab23f794f754e1ff872fcb1c59eef Jul 10 18:40:15.510987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.510962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9t9wr" Jul 10 18:40:15.513118 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.513074 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a95f62d_e232_4534_b621_39e3ed634488.slice/crio-d652fe1c51f2de73378c84b9a9051e0a58a5311273421fe88ffe51ec9fbedfab WatchSource:0}: Error finding container d652fe1c51f2de73378c84b9a9051e0a58a5311273421fe88ffe51ec9fbedfab: Status 404 returned error can't find the container with id d652fe1c51f2de73378c84b9a9051e0a58a5311273421fe88ffe51ec9fbedfab Jul 10 18:40:15.514655 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.514623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" Jul 10 18:40:15.520584 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.520548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:15.523359 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.523305 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98a526a_2939_4ded_863e_b0465789c4f9.slice/crio-88c420940528edd2679cc882ec070cb8c100c5a7bef4831e49344f26defcd3e3 WatchSource:0}: Error finding container 88c420940528edd2679cc882ec070cb8c100c5a7bef4831e49344f26defcd3e3: Status 404 returned error can't find the container with id 88c420940528edd2679cc882ec070cb8c100c5a7bef4831e49344f26defcd3e3 Jul 10 18:40:15.526160 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.526124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" Jul 10 18:40:15.531370 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.531341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b32cdb1_c26e_4f68_b5fa_31b026daa74b.slice/crio-459e0b99bf211637fec5bd732d702380d8d95fc75d4de96bae701e3735e299af WatchSource:0}: Error finding container 459e0b99bf211637fec5bd732d702380d8d95fc75d4de96bae701e3735e299af: Status 404 returned error can't find the container with id 459e0b99bf211637fec5bd732d702380d8d95fc75d4de96bae701e3735e299af Jul 10 18:40:15.532038 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.532017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sgbsf" Jul 10 18:40:15.534522 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.534474 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f09e463_c794_44b5_ae39_0fac266bd33c.slice/crio-2243308cfee41691654c2e028ae330ae024d53b6713de9057fb01a3a402ba526 WatchSource:0}: Error finding container 2243308cfee41691654c2e028ae330ae024d53b6713de9057fb01a3a402ba526: Status 404 returned error can't find the container with id 2243308cfee41691654c2e028ae330ae024d53b6713de9057fb01a3a402ba526 Jul 10 18:40:15.539494 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.539470 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a759fa5_5a0f_49ec_b327_a578419c882b.slice/crio-dd26f4bfbd4a537058fc8530d2879bf9a5fff3b618b052a4792b5f2eccba2ad0 WatchSource:0}: Error finding container dd26f4bfbd4a537058fc8530d2879bf9a5fff3b618b052a4792b5f2eccba2ad0: Status 404 returned error can't find the container with id dd26f4bfbd4a537058fc8530d2879bf9a5fff3b618b052a4792b5f2eccba2ad0 Jul 10 18:40:15.539595 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.539559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9r96" Jul 10 18:40:15.544356 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.544312 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba34355_e094_4969_951e_e177ad8b4c5a.slice/crio-c6eae7b575b568d0ba5d7c5832b9e914795295439ab8454fdbea050e47592d4f WatchSource:0}: Error finding container c6eae7b575b568d0ba5d7c5832b9e914795295439ab8454fdbea050e47592d4f: Status 404 returned error can't find the container with id c6eae7b575b568d0ba5d7c5832b9e914795295439ab8454fdbea050e47592d4f Jul 10 18:40:15.546228 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.546071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" Jul 10 18:40:15.551263 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.551231 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482b3da1_5851_4e2f_8f79_2af8a537cc7b.slice/crio-36653db1a92cbb62ed452c3b91a4666718afe4c51b62f33bc654cece7d8f38dc WatchSource:0}: Error finding container 36653db1a92cbb62ed452c3b91a4666718afe4c51b62f33bc654cece7d8f38dc: Status 404 returned error can't find the container with id 36653db1a92cbb62ed452c3b91a4666718afe4c51b62f33bc654cece7d8f38dc Jul 10 18:40:15.561572 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:40:15.561366 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02642297_0565_4067_99b6_f1cf7f71b81c.slice/crio-5d62de334665eda4914a928317d1404f8dd215262190f5d0c61b45d6c9df279d WatchSource:0}: Error finding container 5d62de334665eda4914a928317d1404f8dd215262190f5d0c61b45d6c9df279d: Status 404 returned error can't find the container with id 5d62de334665eda4914a928317d1404f8dd215262190f5d0c61b45d6c9df279d Jul 10 18:40:15.561572 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.561564 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:40:15.709174 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.709118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"2243308cfee41691654c2e028ae330ae024d53b6713de9057fb01a3a402ba526"} Jul 10 18:40:15.710407 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.710350 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhbqx" event={"ID":"0a95f62d-e232-4534-b621-39e3ed634488","Type":"ContainerStarted","Data":"d652fe1c51f2de73378c84b9a9051e0a58a5311273421fe88ffe51ec9fbedfab"} Jul 10 18:40:15.712156 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.712125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wp989" event={"ID":"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7","Type":"ContainerStarted","Data":"026b061ce51e0150ab556b5ff086c539d2eab23f794f754e1ff872fcb1c59eef"} Jul 10 18:40:15.713392 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.713365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" event={"ID":"02642297-0565-4067-99b6-f1cf7f71b81c","Type":"ContainerStarted","Data":"5d62de334665eda4914a928317d1404f8dd215262190f5d0c61b45d6c9df279d"} Jul 10 18:40:15.714648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.714624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerStarted","Data":"dd26f4bfbd4a537058fc8530d2879bf9a5fff3b618b052a4792b5f2eccba2ad0"} Jul 10 18:40:15.715826 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.715802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" event={"ID":"1b32cdb1-c26e-4f68-b5fa-31b026daa74b","Type":"ContainerStarted","Data":"459e0b99bf211637fec5bd732d702380d8d95fc75d4de96bae701e3735e299af"} Jul 10 18:40:15.716996 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.716972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9t9wr" event={"ID":"b98a526a-2939-4ded-863e-b0465789c4f9","Type":"ContainerStarted","Data":"88c420940528edd2679cc882ec070cb8c100c5a7bef4831e49344f26defcd3e3"} Jul 10 18:40:15.718132 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.718112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"f96e34d9178647af1e5b0fedc7f0f722","Type":"ContainerStarted","Data":"b45a02b7bfcdd2e221b9d2613adfcb1cfb667ea0d6c680bb5debf06308966984"} Jul 10 18:40:15.719332 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.719304 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"6997a03359e3b626c552aedfb5b0c321","Type":"ContainerStarted","Data":"fc4c9291062a3595473fb8520860393a5248384353a6ac2c1511eea8e7b50928"} Jul 10 18:40:15.720512 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.720488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9r96" event={"ID":"482b3da1-5851-4e2f-8f79-2af8a537cc7b","Type":"ContainerStarted","Data":"36653db1a92cbb62ed452c3b91a4666718afe4c51b62f33bc654cece7d8f38dc"} Jul 10 18:40:15.721849 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.721826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sgbsf" event={"ID":"1ba34355-e094-4969-951e-e177ad8b4c5a","Type":"ContainerStarted","Data":"c6eae7b575b568d0ba5d7c5832b9e914795295439ab8454fdbea050e47592d4f"} Jul 10 18:40:15.813424 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.813332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:15.813424 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:15.813406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:15.813649 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.813509 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:15.813649 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.813581 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:16.813567673 +0000 UTC m=+3.985720537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:15.813649 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.813508 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:15.813775 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:15.813664 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:16.813641855 +0000 UTC m=+3.985794733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:16.014926 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.014886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:16.015111 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.015028 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:16.015111 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.015044 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:16.015111 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.015060 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:16.015230 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.015130 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:17.015110869 +0000 UTC m=+4.187263742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:16.247681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.247582 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:35:15 +0000 UTC" deadline="2027-12-13 16:19:47.634592937 +0000 UTC" Jul 10 18:40:16.247681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.247621 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12501h39m31.386976351s" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.704396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.704526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.704921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.705024 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.705107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:16.705316 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.705183 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:16.759145 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.759042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"6997a03359e3b626c552aedfb5b0c321","Type":"ContainerStarted","Data":"b2bc4d04014fe6621b240f66fe16e9c2ba4bca46cc52bb59f43d286e499a09c7"} Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.822685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:16.822793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.822959 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.823036 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:18.82301497 +0000 UTC m=+5.995167858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.823548 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:16.823688 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:16.823600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:18.823585179 +0000 UTC m=+5.995738044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:17.024847 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:17.024762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:17.025003 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:17.024982 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:17.025003 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:17.025003 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:17.025129 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:17.025016 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:17.025129 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:17.025076 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:19.025058828 +0000 UTC m=+6.197211698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:17.248667 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:17.248567 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:35:15 +0000 UTC" deadline="2028-03-31 16:45:15.984919706 +0000 UTC" Jul 10 18:40:17.248667 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:17.248632 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15118h4m58.736291521s" Jul 10 18:40:18.707422 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:18.706299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:18.707422 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.706667 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:18.707422 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:18.707236 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:18.707422 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:18.707275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:18.707422 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.707364 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:18.708337 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.707543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:18.840240 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:18.840191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:18.840426 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:18.840286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:18.840488 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.840432 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:18.840555 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.840498 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:22.840478446 +0000 UTC m=+10.012631335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:18.840985 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.840958 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:18.841110 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:18.841020 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:22.841005003 +0000 UTC m=+10.013157884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:19.042357 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:19.042184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:19.042357 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:19.042356 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:19.042650 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:19.042376 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:19.042650 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:19.042389 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:19.042650 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:19.042452 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:23.042432273 +0000 UTC m=+10.214585155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:20.704800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:20.704941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:20.705337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:20.705432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:20.705482 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:20.705603 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:20.705558 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:22.704070 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:22.703956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:22.704566 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.704115 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:22.704566 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:22.704432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:22.704566 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:22.704473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:22.704719 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.704582 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:22.704719 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.704689 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:22.875043 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:22.875004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:22.875227 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:22.875079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:22.875287 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.875245 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:22.875331 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.875311 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:30.875291233 +0000 UTC m=+18.047444100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:22.875574 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.875472 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:22.875574 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:22.875544 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:30.875525839 +0000 UTC m=+18.047678705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:23.076528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:23.076431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:23.076686 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:23.076628 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:23.076686 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:23.076654 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:23.076686 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:23.076666 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:23.076840 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:23.076734 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:31.076714568 +0000 UTC m=+18.248867447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:24.704816 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:24.704783 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:24.705267 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:24.704921 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:24.705650 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:24.705322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:24.705650 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:24.705446 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:24.705650 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:24.705503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:24.705650 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:24.705602 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:26.703975 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:26.703947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:26.704363 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:26.703977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:26.704363 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:26.703947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:26.704363 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:26.704074 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:26.704363 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:26.704158 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:26.704363 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:26.704256 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:28.704272 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:28.704238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:28.704272 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:28.704260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:28.704272 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:28.704264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:28.704846 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:28.704370 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:28.704846 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:28.704408 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:28.704846 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:28.704460 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:30.703913 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:30.703878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:30.704355 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.704002 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:30.704355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:30.704023 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:30.704355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:30.704034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:30.704355 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.704124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:30.704355 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.704210 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:30.935032 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:30.934988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:30.935246 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:30.935098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:30.935246 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.935193 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:30.935246 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.935211 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:30.935409 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.935286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:40:46.935264194 +0000 UTC m=+34.107417079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:30.935409 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:30.935308 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:40:46.935297945 +0000 UTC m=+34.107450812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:31.136985 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:31.136890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:31.137171 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:31.137075 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:31.137171 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:31.137128 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:31.137171 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:31.137141 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:31.137342 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:31.137207 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:40:47.137188362 +0000 UTC m=+34.309341249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:32.703975 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:32.703927 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:32.704523 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:32.704057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:32.704523 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:32.704073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:32.704523 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:32.704069 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:32.704523 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:32.704195 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:32.704523 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:32.704297 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:34.704472 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:34.704439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:34.704472 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:34.704462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:34.705007 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:34.704437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:34.705007 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:34.704562 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:34.705007 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:34.704623 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:34.705007 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:34.704709 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:35.811790 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.811539 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" event={"ID":"02642297-0565-4067-99b6-f1cf7f71b81c","Type":"ContainerStarted","Data":"80fdd35bdff402eae93719f3216113ef06dde7dd63941a685a470f5319b5fb20"} Jul 10 18:40:35.814549 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.813077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerStarted","Data":"dbd4e06bee74c775dff7266d3729f066b1684d617be647bfc1dcefed5fff37f1"} Jul 10 18:40:35.816386 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.816307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" event={"ID":"1b32cdb1-c26e-4f68-b5fa-31b026daa74b","Type":"ContainerStarted","Data":"2052096efa4b2eead7f92a8827ef927f2547b02794ee513a6ce796d687b11b01"} Jul 10 18:40:35.819673 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.818264 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9t9wr" event={"ID":"b98a526a-2939-4ded-863e-b0465789c4f9","Type":"ContainerStarted","Data":"b855ca61e573b86f8ede72d6bb584bac46648bd4a0b153ccdc7ff98740e3c4e4"} Jul 10 18:40:35.821891 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.821860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"f96e34d9178647af1e5b0fedc7f0f722","Type":"ContainerStarted","Data":"cd340a853086b7b104670f55fd1853ceeb6304d55f7b1b594429bbf87c26e4e4"} Jul 10 18:40:35.823972 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.823943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9r96" event={"ID":"482b3da1-5851-4e2f-8f79-2af8a537cc7b","Type":"ContainerStarted","Data":"58706015ffeb0ec1258dc111b00c1431203f851e0c4630d8fabdca50ee6530d3"} Jul 10 18:40:35.826014 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.825986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"3866419b4c9b91ac06f2399483c3026a6345f0edd612828da86740a7428ca68f"} Jul 10 18:40:35.827963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.827940 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhbqx" event={"ID":"0a95f62d-e232-4534-b621-39e3ed634488","Type":"ContainerStarted","Data":"856a7c569a786eec0a3a51b18e186e4659e848538d9c4ff1765fed56e010a1be"} Jul 10 18:40:35.829605 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.829579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wp989" event={"ID":"d3dd4bb9-5062-4ff8-8595-42b46a63bbb7","Type":"ContainerStarted","Data":"c8ebb765209973c55e9212eb407b5dcc83ae8376808e616bcbaf973090773562"} Jul 10 18:40:35.838763 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.838708 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" podStartSLOduration=21.838690166 podStartE2EDuration="21.838690166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:16.778375157 +0000 UTC m=+3.950528064" watchObservedRunningTime="2026-07-10 18:40:35.838690166 +0000 UTC m=+23.010843053" Jul 10 18:40:35.859078 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.859034 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gzrqm" podStartSLOduration=2.175247569 podStartE2EDuration="21.859018686s" totalImagesPullingTime="19.683771117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:35.858603329 +0000 UTC m=+23.030756215" watchObservedRunningTime="2026-07-10 18:40:35.859018686 +0000 UTC m=+23.031171571" Jul 10 18:40:35.873883 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.873833 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vhbqx" podStartSLOduration=3.58853973 podStartE2EDuration="22.873816379s" totalImagesPullingTime="19.285276649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:35.873109256 +0000 UTC m=+23.045262141" watchObservedRunningTime="2026-07-10 18:40:35.873816379 +0000 UTC m=+23.045969266" Jul 10 18:40:35.903860 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.903810 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wp989" podStartSLOduration=3.200978319 podStartE2EDuration="22.903793228s" totalImagesPullingTime="19.702814909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:35.903510877 +0000 UTC m=+23.075663792" watchObservedRunningTime="2026-07-10 18:40:35.903793228 +0000 UTC m=+23.075946114" Jul 10 18:40:35.919421 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.919370 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9t9wr" podStartSLOduration=3.197358144 podStartE2EDuration="22.919353423s" totalImagesPullingTime="19.721995279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:35.919326625 +0000 UTC m=+23.091479512" watchObservedRunningTime="2026-07-10 18:40:35.919353423 +0000 UTC m=+23.091506309" Jul 10 18:40:35.938303 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:35.938215 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9r96" podStartSLOduration=2.245981348 podStartE2EDuration="21.938198513s" totalImagesPullingTime="19.692217165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:35.937786892 +0000 UTC m=+23.109939777" watchObservedRunningTime="2026-07-10 18:40:35.938198513 +0000 UTC m=+23.110351399" Jul 10 18:40:36.705153 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.704883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:36.705153 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.704928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:36.705153 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.704936 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:36.705367 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:36.705176 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:36.705367 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:36.705268 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:36.705367 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:36.705326 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:36.832819 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.832782 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="dbd4e06bee74c775dff7266d3729f066b1684d617be647bfc1dcefed5fff37f1" exitCode=0 Jul 10 18:40:36.833617 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.832835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"dbd4e06bee74c775dff7266d3729f066b1684d617be647bfc1dcefed5fff37f1"} Jul 10 18:40:36.834394 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.834374 2563 generic.go:356] "Generic (PLEG): container finished" podID="f96e34d9178647af1e5b0fedc7f0f722" containerID="cd340a853086b7b104670f55fd1853ceeb6304d55f7b1b594429bbf87c26e4e4" exitCode=0 Jul 10 18:40:36.834483 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.834448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"f96e34d9178647af1e5b0fedc7f0f722","Type":"ContainerDied","Data":"cd340a853086b7b104670f55fd1853ceeb6304d55f7b1b594429bbf87c26e4e4"} Jul 10 18:40:36.835822 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.835794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sgbsf" event={"ID":"1ba34355-e094-4969-951e-e177ad8b4c5a","Type":"ContainerStarted","Data":"098d47dd404560061bf5e6377664948da0ccfc360478bf70092d2594e2b0e4b6"} Jul 10 18:40:36.841283 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:40:36.841567 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841548 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f09e463-c794-44b5-ae39-0fac266bd33c" containerID="44e25ddbef9da5b18bb6793576442e772af6d1ebb580038f065509b4231b0de0" exitCode=1 Jul 10 18:40:36.841666 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"deb578b8f828259aca6071b0a02cac594043b90b036c4bcd252309b44d5cfc9f"} Jul 10 18:40:36.841765 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"1ab72af54992dcb8f9ee640b9fa1d962bb790ef826f243469d0af2af448ebd5b"} Jul 10 18:40:36.841824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"9087f0ffba269eef35247c0989489f49a821bec8e4f754ca1f64f9424b246c3b"} Jul 10 18:40:36.841879 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"385ce306606df6c8c4e26792e2b5879877c0c0b1843add2ceec91c42d4b7f591"} Jul 10 18:40:36.841938 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.841910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerDied","Data":"44e25ddbef9da5b18bb6793576442e772af6d1ebb580038f065509b4231b0de0"} Jul 10 18:40:36.875052 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:36.874997 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sgbsf" podStartSLOduration=3.210406315 podStartE2EDuration="22.874981077s" totalImagesPullingTime="19.664574762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:36.874758821 +0000 UTC m=+24.046911736" watchObservedRunningTime="2026-07-10 18:40:36.874981077 +0000 UTC m=+24.047133962" Jul 10 18:40:37.087740 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.087713 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 18:40:37.614279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.614168 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:40:37.087733296Z","UUID":"ec1e5456-7b01-4437-9b21-ebf24165aed5","Handler":null,"Name":"","Endpoint":""} Jul 10 18:40:37.615979 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.615950 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 18:40:37.616146 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.615991 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 18:40:37.846814 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.846776 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" event={"ID":"1b32cdb1-c26e-4f68-b5fa-31b026daa74b","Type":"ContainerStarted","Data":"50f03f0780e05fc11596f306446d61316ad16dfd8ec04914a9a221bf7cd82d71"} Jul 10 18:40:37.849038 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:37.848959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"f96e34d9178647af1e5b0fedc7f0f722","Type":"ContainerStarted","Data":"1cd1b764a14b62f097043713a8c241c8d6a57b4736c1bb91ef317830489a3cd5"} Jul 10 18:40:38.704252 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.704206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:38.704463 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.704277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:38.704463 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.704217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:38.704463 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:38.704339 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:38.704463 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:38.704393 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:38.704670 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:38.704511 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:38.855864 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.855795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:40:38.856404 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.856296 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"f31f968791a4848273d8ec7838c4ff693dcf1b69694ae84dd1d65e35f52b2af8"} Jul 10 18:40:38.858620 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.858579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" event={"ID":"1b32cdb1-c26e-4f68-b5fa-31b026daa74b","Type":"ContainerStarted","Data":"59ddb0dcffe8262305b5a101f8e2c4442cf9c6c5f84b71232c0196dac9856147"} Jul 10 18:40:38.876910 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.876845 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6bph" podStartSLOduration=3.687953889 podStartE2EDuration="25.876822572s" totalImagesPullingTime="22.188868683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:38.876734793 +0000 UTC m=+26.048887679" watchObservedRunningTime="2026-07-10 18:40:38.876822572 +0000 UTC m=+26.048975478" Jul 10 18:40:38.877240 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:38.877206 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" podStartSLOduration=24.877184915 podStartE2EDuration="24.877184915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:37.865799292 +0000 UTC m=+25.037952179" watchObservedRunningTime="2026-07-10 18:40:38.877184915 +0000 UTC m=+26.049337801" Jul 10 18:40:39.584957 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:39.584923 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:39.585619 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:39.585593 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:39.861222 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:39.861136 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:39.861675 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:39.861573 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vhbqx" Jul 10 18:40:40.704443 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:40.704245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:40.704616 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:40.704297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:40.704616 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:40.704538 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:40.704616 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:40.704596 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:40.704616 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:40.704297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:40.704788 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:40.704740 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:41.868472 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.868301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:40:41.869259 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.868805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"214fba12fd268902a24ee631ed031d3a280e46edad19e1a10870593fb27968f9"} Jul 10 18:40:41.869259 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.869063 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:41.869343 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.869258 2563 scope.go:117] "RemoveContainer" containerID="44e25ddbef9da5b18bb6793576442e772af6d1ebb580038f065509b4231b0de0" Jul 10 18:40:41.870852 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.870820 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="499f7dce48bb18d28e65c8e276d9d3c787262a0d4988d3306308d3013b6c9bed" exitCode=0 Jul 10 18:40:41.870955 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.870934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"499f7dce48bb18d28e65c8e276d9d3c787262a0d4988d3306308d3013b6c9bed"} Jul 10 18:40:41.886051 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:41.886019 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:42.704895 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.704855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:42.704895 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.704895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:42.705198 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.704962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:42.705198 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:42.704980 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:42.705198 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:42.705038 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:42.705198 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:42.705121 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:42.877162 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.877132 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:40:42.877546 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.877441 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" event={"ID":"0f09e463-c794-44b5-ae39-0fac266bd33c","Type":"ContainerStarted","Data":"28bdeddf7511440bb1fef91afac28acad9448f8d4f7d5009d7381993c8317978"} Jul 10 18:40:42.877650 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.877636 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:42.877699 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.877693 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:42.893005 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.892979 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:40:42.909176 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:42.909133 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" podStartSLOduration=9.782681197 podStartE2EDuration="29.909117187s" totalImagesPullingTime="20.12643599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:42.907772844 +0000 UTC m=+30.079925751" watchObservedRunningTime="2026-07-10 18:40:42.909117187 +0000 UTC m=+30.081270070" Jul 10 18:40:43.882796 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:43.882761 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="53dcbc8e0c2da7316af084be389a75ba0245ffecca7f42b54245bd3e1b4330e6" exitCode=0 Jul 10 18:40:43.883175 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:43.882853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"53dcbc8e0c2da7316af084be389a75ba0245ffecca7f42b54245bd3e1b4330e6"} Jul 10 18:40:44.704123 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:44.704076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:44.704337 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:44.704132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:44.704337 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:44.704206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:44.704337 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:44.704132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:44.704337 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:44.704269 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:44.704337 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:44.704320 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:45.888686 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:45.888650 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="05e424f29928177ac492f9bbcc51d88edcb3d4c9c475905895733859bad59cd3" exitCode=0 Jul 10 18:40:45.889172 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:45.888741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"05e424f29928177ac492f9bbcc51d88edcb3d4c9c475905895733859bad59cd3"} Jul 10 18:40:46.704012 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:46.703966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:46.704287 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:46.704104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:46.704287 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:46.704118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:46.704287 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.704124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:46.704287 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.704210 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:46.704499 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.704315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:46.957742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:46.957651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:46.957742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:46.957719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:46.958277 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.957814 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:46.958277 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.957817 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:46.958277 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.957874 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs podName:79ef32f7-0a7f-460d-a902-89dc172b2c9e nodeName:}" failed. No retries permitted until 2026-07-10 18:41:18.957855127 +0000 UTC m=+66.130008000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs") pod "network-metrics-daemon-xrpg8" (UID: "79ef32f7-0a7f-460d-a902-89dc172b2c9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:40:46.958277 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:46.957888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret podName:aed8a6c4-2179-42d3-8bf5-d0f93e0f914c nodeName:}" failed. No retries permitted until 2026-07-10 18:41:18.957882335 +0000 UTC m=+66.130035199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret") pod "global-pull-secret-syncer-stdf8" (UID: "aed8a6c4-2179-42d3-8bf5-d0f93e0f914c") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:40:47.159447 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:47.159396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:47.159629 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:47.159558 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:40:47.159629 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:47.159584 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:40:47.159629 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:47.159598 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sxk78 for pod openshift-network-diagnostics/network-check-target-m7sk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:47.159771 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:47.159666 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78 podName:8e75bc25-8bc8-4ad8-a534-73b6484d6ce5 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:19.159642372 +0000 UTC m=+66.331795239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sxk78" (UniqueName: "kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78") pod "network-check-target-m7sk2" (UID: "8e75bc25-8bc8-4ad8-a534-73b6484d6ce5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:40:48.704719 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:48.704684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:48.705148 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:48.704726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:48.705148 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:48.704731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:48.705148 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:48.704824 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:48.705148 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:48.704870 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:48.705148 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:48.704954 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:50.704870 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:50.704829 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:50.705362 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:50.704831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:50.705362 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:50.704952 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:50.705362 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:50.704840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:50.705362 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:50.705017 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:50.705362 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:50.705122 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:50.903673 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:50.903637 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="72fdc9f893540cf234513c8586ab83e7d76a3b6e4c821aa4309ae3cb040d16ad" exitCode=0 Jul 10 18:40:50.903836 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:50.903688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"72fdc9f893540cf234513c8586ab83e7d76a3b6e4c821aa4309ae3cb040d16ad"} Jul 10 18:40:51.909317 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:51.909283 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a759fa5-5a0f-49ec-b327-a578419c882b" containerID="35f66e86fceddcb4e6b7e2ba702b994d1ae1478a1df9c77e252925eeaf386ac7" exitCode=0 Jul 10 18:40:51.909676 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:51.909343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerDied","Data":"35f66e86fceddcb4e6b7e2ba702b994d1ae1478a1df9c77e252925eeaf386ac7"} Jul 10 18:40:52.704738 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:52.704699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:52.704939 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:52.704698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:52.704939 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:52.704830 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:52.704939 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:52.704720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:52.704939 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:52.704882 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:52.705150 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:52.704994 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:52.915083 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:52.915045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" event={"ID":"1a759fa5-5a0f-49ec-b327-a578419c882b","Type":"ContainerStarted","Data":"7945b1ec18c2a36cd610458e9c9654f6ea3797195ac31dd8fc337e6e294bfb6d"} Jul 10 18:40:52.939815 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:52.939763 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n2zzn" podStartSLOduration=8.853366608 podStartE2EDuration="38.939746937s" totalImagesPullingTime="30.086380329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:40:52.938464799 +0000 UTC m=+40.110617704" watchObservedRunningTime="2026-07-10 18:40:52.939746937 +0000 UTC m=+40.111899801" Jul 10 18:40:54.704739 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:54.704701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:54.705197 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:54.704701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:54.705197 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:54.704809 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:54.705197 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:54.704701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:54.705197 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:54.704886 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:54.705197 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:54.704919 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:56.704833 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:56.704652 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:56.705245 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:56.704660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:56.705245 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:56.704917 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:56.705245 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:56.704672 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:56.705245 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:56.705003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:56.705245 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:56.705164 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:57.055853 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.055818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7sk2"] Jul 10 18:40:57.056029 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.055964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:57.056354 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:57.056078 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:40:57.061923 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.061890 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stdf8"] Jul 10 18:40:57.062069 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.062019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:57.062154 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:57.062127 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:57.064553 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.064526 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xrpg8"] Jul 10 18:40:57.064709 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:57.064687 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:57.064836 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:57.064810 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:58.704532 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:58.704494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:40:58.704532 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:58.704533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:40:58.705195 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:40:58.704601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:40:58.705195 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:58.704624 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:40:58.705195 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:58.704729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:40:58.705195 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:40:58.704785 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:41:00.704732 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:00.704690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:00.704732 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:00.704718 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:41:00.705283 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:00.704726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:41:00.705283 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:41:00.704826 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m7sk2" podUID="8e75bc25-8bc8-4ad8-a534-73b6484d6ce5" Jul 10 18:41:00.705283 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:41:00.704915 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stdf8" podUID="aed8a6c4-2179-42d3-8bf5-d0f93e0f914c" Jul 10 18:41:00.705283 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:41:00.705013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xrpg8" podUID="79ef32f7-0a7f-460d-a902-89dc172b2c9e" Jul 10 18:41:01.119489 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.119461 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeReady" Jul 10 18:41:01.119658 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.119624 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:41:01.173848 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.173814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fd4d9b8df-8qppk"] Jul 10 18:41:01.209607 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.209521 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2f"] Jul 10 18:41:01.209753 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.209654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.225487 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.225460 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd4d9b8df-8qppk"] Jul 10 18:41:01.225652 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.225496 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m9scc"] Jul 10 18:41:01.225652 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.225591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.245577 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.245543 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:41:01.245736 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.245546 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2f"] Jul 10 18:41:01.245736 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.245632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.252748 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252716 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k929x\"" Jul 10 18:41:01.252868 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252764 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 18:41:01.252939 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252862 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:41:01.252939 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252862 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k5slx\"" Jul 10 18:41:01.253101 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252928 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:41:01.253101 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252972 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:41:01.253101 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.252992 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:41:01.253287 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.253247 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 18:41:01.254361 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.254290 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xwhdh\"" Jul 10 18:41:01.254498 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.254361 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:41:01.255142 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.255124 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9scc"] Jul 10 18:41:01.256855 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.256835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 18:41:01.261668 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.261650 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 18:41:01.268344 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.268322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:41:01.309459 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.308419 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xhnm4"] Jul 10 18:41:01.338873 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.338843 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.342030 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.342007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:41:01.342206 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.342046 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jc4wc\"" Jul 10 18:41:01.353414 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.353390 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:41:01.361864 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.361840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shs86\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-kube-api-access-shs86\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.361888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj8mh\" (UniqueName: \"kubernetes.io/projected/5cf7faef-3ea2-4891-9cf3-532439315284-kube-api-access-nj8mh\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.362010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.361907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-crio-socket\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.362010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.361985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-data-volume\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.362010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/370b3278-26cc-4bda-b649-427b570d4e08-ca-trust-extracted\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.362158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-registry-tls\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-registry-certificates\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-trusted-ca\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-image-registry-private-configuration\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-bound-sa-token\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-installation-pull-secrets\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.362304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362238 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7faef-3ea2-4891-9cf3-532439315284-cert\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.362304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6h9\" (UniqueName: \"kubernetes.io/projected/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-api-access-sm6h9\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.362304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.362280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.407030 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.407000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhnm4"] Jul 10 18:41:01.463310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463222 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-bound-sa-token\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-installation-pull-secrets\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7faef-3ea2-4891-9cf3-532439315284-cert\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.463310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6h9\" (UniqueName: \"kubernetes.io/projected/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-api-access-sm6h9\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463625 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eabf1172-1e21-4615-b400-7f93c4e79486-config-volume\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.463625 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463625 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqb9k\" (UniqueName: \"kubernetes.io/projected/eabf1172-1e21-4615-b400-7f93c4e79486-kube-api-access-bqb9k\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.463625 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shs86\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-kube-api-access-shs86\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463625 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabf1172-1e21-4615-b400-7f93c4e79486-tmp-dir\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.463841 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj8mh\" (UniqueName: \"kubernetes.io/projected/5cf7faef-3ea2-4891-9cf3-532439315284-kube-api-access-nj8mh\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.463841 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-crio-socket\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463841 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-data-volume\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/370b3278-26cc-4bda-b649-427b570d4e08-ca-trust-extracted\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-registry-tls\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-crio-socket\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-registry-certificates\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.463992 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.463969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-trusted-ca\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.464265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.464000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eabf1172-1e21-4615-b400-7f93c4e79486-metrics-tls\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.464265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.464044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-image-registry-private-configuration\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.464265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.464172 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-data-volume\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.464384 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.464349 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/370b3278-26cc-4bda-b649-427b570d4e08-ca-trust-extracted\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.464831 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.464808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-registry-certificates\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.465199 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.465177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/370b3278-26cc-4bda-b649-427b570d4e08-trusted-ca\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.465333 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.465315 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.467744 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.467720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.467835 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.467754 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-image-registry-private-configuration\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.467835 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.467798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/370b3278-26cc-4bda-b649-427b570d4e08-installation-pull-secrets\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.467907 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.467832 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7faef-3ea2-4891-9cf3-532439315284-cert\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.467963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.467941 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-registry-tls\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.478064 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.478034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-bound-sa-token\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.478191 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.478162 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6h9\" (UniqueName: \"kubernetes.io/projected/7a239d7e-0128-466d-a83d-0c4f4b52d8dd-kube-api-access-sm6h9\") pod \"insights-runtime-extractor-m9scc\" (UID: \"7a239d7e-0128-466d-a83d-0c4f4b52d8dd\") " pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.478267 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.478196 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shs86\" (UniqueName: \"kubernetes.io/projected/370b3278-26cc-4bda-b649-427b570d4e08-kube-api-access-shs86\") pod \"image-registry-fd4d9b8df-8qppk\" (UID: \"370b3278-26cc-4bda-b649-427b570d4e08\") " pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.479639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.479618 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj8mh\" (UniqueName: \"kubernetes.io/projected/5cf7faef-3ea2-4891-9cf3-532439315284-kube-api-access-nj8mh\") pod \"ingress-canary-ssq2f\" (UID: \"5cf7faef-3ea2-4891-9cf3-532439315284\") " pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.521512 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.521466 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.533624 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.533591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2f" Jul 10 18:41:01.554940 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.554922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9scc" Jul 10 18:41:01.565304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eabf1172-1e21-4615-b400-7f93c4e79486-metrics-tls\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.565416 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eabf1172-1e21-4615-b400-7f93c4e79486-config-volume\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.565416 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqb9k\" (UniqueName: \"kubernetes.io/projected/eabf1172-1e21-4615-b400-7f93c4e79486-kube-api-access-bqb9k\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.565416 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabf1172-1e21-4615-b400-7f93c4e79486-tmp-dir\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.565778 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565755 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabf1172-1e21-4615-b400-7f93c4e79486-tmp-dir\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.565927 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.565910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eabf1172-1e21-4615-b400-7f93c4e79486-config-volume\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.575346 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.575326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eabf1172-1e21-4615-b400-7f93c4e79486-metrics-tls\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.584756 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.584728 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqb9k\" (UniqueName: \"kubernetes.io/projected/eabf1172-1e21-4615-b400-7f93c4e79486-kube-api-access-bqb9k\") pod \"dns-default-xhnm4\" (UID: \"eabf1172-1e21-4615-b400-7f93c4e79486\") " pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.647117 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.646929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:01.761643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.761573 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2f"] Jul 10 18:41:01.762728 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.762650 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd4d9b8df-8qppk"] Jul 10 18:41:01.765932 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:01.765886 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf7faef_3ea2_4891_9cf3_532439315284.slice/crio-17dbe2dcd795a12445d18ffc48f83784d80fdaf984a8cb771a4c75b020c464ce WatchSource:0}: Error finding container 17dbe2dcd795a12445d18ffc48f83784d80fdaf984a8cb771a4c75b020c464ce: Status 404 returned error can't find the container with id 17dbe2dcd795a12445d18ffc48f83784d80fdaf984a8cb771a4c75b020c464ce Jul 10 18:41:01.766288 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:01.766269 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370b3278_26cc_4bda_b649_427b570d4e08.slice/crio-ef24074b080ee61cd4218e451850d8a0b5413155fd4b7e6bb69739f1d26ffaef WatchSource:0}: Error finding container ef24074b080ee61cd4218e451850d8a0b5413155fd4b7e6bb69739f1d26ffaef: Status 404 returned error can't find the container with id ef24074b080ee61cd4218e451850d8a0b5413155fd4b7e6bb69739f1d26ffaef Jul 10 18:41:01.787274 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.787244 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9scc"] Jul 10 18:41:01.791302 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:01.791271 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a239d7e_0128_466d_a83d_0c4f4b52d8dd.slice/crio-00713ed9c7f3e98f886e4f2d8e316d6a156a616fa5d2410e3bb8aeaf2a1b15fe WatchSource:0}: Error finding container 00713ed9c7f3e98f886e4f2d8e316d6a156a616fa5d2410e3bb8aeaf2a1b15fe: Status 404 returned error can't find the container with id 00713ed9c7f3e98f886e4f2d8e316d6a156a616fa5d2410e3bb8aeaf2a1b15fe Jul 10 18:41:01.833475 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.833448 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhnm4"] Jul 10 18:41:01.837463 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:01.837438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabf1172_1e21_4615_b400_7f93c4e79486.slice/crio-d134825e98134a9cbd74e20fc4fa387b042274d8585a7fc046c43a5dc9a38cb5 WatchSource:0}: Error finding container d134825e98134a9cbd74e20fc4fa387b042274d8585a7fc046c43a5dc9a38cb5: Status 404 returned error can't find the container with id d134825e98134a9cbd74e20fc4fa387b042274d8585a7fc046c43a5dc9a38cb5 Jul 10 18:41:01.935535 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.935497 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhnm4" event={"ID":"eabf1172-1e21-4615-b400-7f93c4e79486","Type":"ContainerStarted","Data":"d134825e98134a9cbd74e20fc4fa387b042274d8585a7fc046c43a5dc9a38cb5"} Jul 10 18:41:01.936767 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.936734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9scc" event={"ID":"7a239d7e-0128-466d-a83d-0c4f4b52d8dd","Type":"ContainerStarted","Data":"00713ed9c7f3e98f886e4f2d8e316d6a156a616fa5d2410e3bb8aeaf2a1b15fe"} Jul 10 18:41:01.937919 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.937896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssq2f" event={"ID":"5cf7faef-3ea2-4891-9cf3-532439315284","Type":"ContainerStarted","Data":"17dbe2dcd795a12445d18ffc48f83784d80fdaf984a8cb771a4c75b020c464ce"} Jul 10 18:41:01.939501 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.939472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" event={"ID":"370b3278-26cc-4bda-b649-427b570d4e08","Type":"ContainerStarted","Data":"d0766876837f6854d944545da1ee55dcd8901a9b3d448bb4cd28aac27d35b803"} Jul 10 18:41:01.939582 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.939513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" event={"ID":"370b3278-26cc-4bda-b649-427b570d4e08","Type":"ContainerStarted","Data":"ef24074b080ee61cd4218e451850d8a0b5413155fd4b7e6bb69739f1d26ffaef"} Jul 10 18:41:01.939644 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.939611 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:01.968046 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:01.967986 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" podStartSLOduration=5.967965118 podStartE2EDuration="5.967965118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:01.967577744 +0000 UTC m=+49.139730649" watchObservedRunningTime="2026-07-10 18:41:01.967965118 +0000 UTC m=+49.140118005" Jul 10 18:41:02.704873 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.704837 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:41:02.705060 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.704838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:02.705741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.705336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709204 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709408 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709573 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709626 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6dtsl\"" Jul 10 18:41:02.709823 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:02.709576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p7c5\"" Jul 10 18:41:07.958804 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:07.958348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssq2f" event={"ID":"5cf7faef-3ea2-4891-9cf3-532439315284","Type":"ContainerStarted","Data":"734f1099b568134ac3577da1b38961700a903865191d3a8f702c4c89bcadad1e"} Jul 10 18:41:07.960831 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:07.960797 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhnm4" event={"ID":"eabf1172-1e21-4615-b400-7f93c4e79486","Type":"ContainerStarted","Data":"16fcffd0dd5420a1237c2757b84ede0d4f547e63759422a365553422fcf71a47"} Jul 10 18:41:07.966526 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:07.966499 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9scc" event={"ID":"7a239d7e-0128-466d-a83d-0c4f4b52d8dd","Type":"ContainerStarted","Data":"4dac278554d19820eda89e1c345373ed5fa4f5c574e7c75a155d563adc126992"} Jul 10 18:41:07.985959 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:07.985889 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ssq2f" podStartSLOduration=0.992606756 podStartE2EDuration="6.985866673s" totalImagesPullingTime="5.993259917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:07.984745001 +0000 UTC m=+55.156897886" watchObservedRunningTime="2026-07-10 18:41:07.985866673 +0000 UTC m=+55.158019561" Jul 10 18:41:08.972188 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:08.972155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhnm4" event={"ID":"eabf1172-1e21-4615-b400-7f93c4e79486","Type":"ContainerStarted","Data":"d439cae8ccd1c9991d8f003eeef55c482534fad21580a35cc758969c02f6d115"} Jul 10 18:41:08.972651 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:08.972255 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:08.973940 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:08.973917 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9scc" event={"ID":"7a239d7e-0128-466d-a83d-0c4f4b52d8dd","Type":"ContainerStarted","Data":"04cf9162824647a2f33e629499cdc371a138283ab046e2fb974bb003d190f13a"} Jul 10 18:41:08.999116 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:08.999042 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xhnm4" podStartSLOduration=2.077580485 podStartE2EDuration="7.999023268s" totalImagesPullingTime="5.921442783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:08.998358948 +0000 UTC m=+56.170511849" watchObservedRunningTime="2026-07-10 18:41:08.999023268 +0000 UTC m=+56.171176195" Jul 10 18:41:11.987641 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:11.987607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9scc" event={"ID":"7a239d7e-0128-466d-a83d-0c4f4b52d8dd","Type":"ContainerStarted","Data":"18ee3e1bf28067cb21cb65fa09b43da1625c38946a229daa6ef73dbec19ac3a4"} Jul 10 18:41:12.014313 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:12.014255 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m9scc" podStartSLOduration=1.850618957 podStartE2EDuration="11.014236362s" totalImagesPullingTime="9.163617405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:12.013999857 +0000 UTC m=+59.186152743" watchObservedRunningTime="2026-07-10 18:41:12.014236362 +0000 UTC m=+59.186389247" Jul 10 18:41:13.632110 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.632063 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f4ff7"] Jul 10 18:41:13.656222 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.656178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.658834 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.658809 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2kssn\"" Jul 10 18:41:13.658972 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.658835 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:41:13.659839 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.659813 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:41:13.659974 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.659856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:41:13.659974 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.659871 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:41:13.659974 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.659886 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:41:13.659974 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.659924 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:41:13.761611 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-textfile\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761611 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-tls\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761820 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-metrics-client-ca\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761820 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-sys\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761820 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761820 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761820 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-root\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761967 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf5g\" (UniqueName: \"kubernetes.io/projected/8af16626-2016-4153-ab82-039d9ce13ab2-kube-api-access-swf5g\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.761967 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.761858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-wtmp\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863212 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf5g\" (UniqueName: \"kubernetes.io/projected/8af16626-2016-4153-ab82-039d9ce13ab2-kube-api-access-swf5g\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863212 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-wtmp\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-textfile\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-tls\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-metrics-client-ca\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-sys\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-wtmp\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863476 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-root\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-sys\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863574 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8af16626-2016-4153-ab82-039d9ce13ab2-root\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.863824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.863674 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-textfile\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.864346 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.864117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-metrics-client-ca\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.864346 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.864166 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.867420 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.867391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.867538 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.867489 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8af16626-2016-4153-ab82-039d9ce13ab2-node-exporter-tls\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.874118 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.874064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf5g\" (UniqueName: \"kubernetes.io/projected/8af16626-2016-4153-ab82-039d9ce13ab2-kube-api-access-swf5g\") pod \"node-exporter-f4ff7\" (UID: \"8af16626-2016-4153-ab82-039d9ce13ab2\") " pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.966033 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:13.965991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4ff7" Jul 10 18:41:13.992445 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:13.992404 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af16626_2016_4153_ab82_039d9ce13ab2.slice/crio-f36b4e52f6667bfa176eda8ee688c883e10e96fbfa0167901c7fb8065ddcdc2c WatchSource:0}: Error finding container f36b4e52f6667bfa176eda8ee688c883e10e96fbfa0167901c7fb8065ddcdc2c: Status 404 returned error can't find the container with id f36b4e52f6667bfa176eda8ee688c883e10e96fbfa0167901c7fb8065ddcdc2c Jul 10 18:41:14.630803 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.630770 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:14.633291 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.633268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.636691 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.636665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:41:14.638139 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.637998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:41:14.638139 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638010 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rpflm\"" Jul 10 18:41:14.638139 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638017 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:41:14.638661 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638633 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:41:14.638879 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638644 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:41:14.638963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638654 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:41:14.638963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:41:14.639079 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638696 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:41:14.639079 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.638705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:41:14.660491 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.660455 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:14.668879 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.668847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.668885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.668954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669106 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4nf\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669301 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669301 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669301 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669301 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669492 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669492 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669492 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.669492 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.669468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.770595 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.770551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.770845 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.770623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.770845 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.770662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.770845 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.770686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4nf\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.770845 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:41:14.770810 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 18:41:14.771076 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:41:14.770896 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls podName:c08bae19-3af0-4ced-8e39-f14db4131d63 nodeName:}" failed. No retries permitted until 2026-07-10 18:41:15.270873704 +0000 UTC m=+62.443026591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63") : secret "alertmanager-main-tls" not found Jul 10 18:41:14.771076 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771196 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.771639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.771349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.772527 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.772498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.773357 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.773330 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.774069 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.774020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.774704 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.774658 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.774801 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.774743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.775308 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.775284 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.775529 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.775506 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.775629 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.775601 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.775765 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.775747 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.776357 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.776335 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.780933 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.780907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4nf\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:14.896060 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:14.895980 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7p7g" Jul 10 18:41:15.002036 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:15.001993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4ff7" event={"ID":"8af16626-2016-4153-ab82-039d9ce13ab2","Type":"ContainerStarted","Data":"f36b4e52f6667bfa176eda8ee688c883e10e96fbfa0167901c7fb8065ddcdc2c"} Jul 10 18:41:15.275405 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:15.275361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:15.277743 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:15.277721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:15.545190 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:15.545082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:41:15.687224 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:15.687201 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:41:15.689776 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:15.689750 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08bae19_3af0_4ced_8e39_f14db4131d63.slice/crio-f5798b70970e0681e78b654a27484973a1d2d3fcaec71bd4f8a5d35f0de716aa WatchSource:0}: Error finding container f5798b70970e0681e78b654a27484973a1d2d3fcaec71bd4f8a5d35f0de716aa: Status 404 returned error can't find the container with id f5798b70970e0681e78b654a27484973a1d2d3fcaec71bd4f8a5d35f0de716aa Jul 10 18:41:16.007367 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:16.007329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"f5798b70970e0681e78b654a27484973a1d2d3fcaec71bd4f8a5d35f0de716aa"} Jul 10 18:41:16.008920 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:16.008895 2563 generic.go:356] "Generic (PLEG): container finished" podID="8af16626-2016-4153-ab82-039d9ce13ab2" containerID="aa0cee2671e0deeb0a7140b7244357f75155b3afabf5bab87b0f53ecf082c437" exitCode=0 Jul 10 18:41:16.009028 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:16.008946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4ff7" event={"ID":"8af16626-2016-4153-ab82-039d9ce13ab2","Type":"ContainerDied","Data":"aa0cee2671e0deeb0a7140b7244357f75155b3afabf5bab87b0f53ecf082c437"} Jul 10 18:41:17.014349 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.014255 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e" exitCode=0 Jul 10 18:41:17.014797 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.014352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e"} Jul 10 18:41:17.016787 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.016764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4ff7" event={"ID":"8af16626-2016-4153-ab82-039d9ce13ab2","Type":"ContainerStarted","Data":"953f1eb02d43acb57cf6d11bd10be4f88897db70e5bd3b850e5e247fe3eca5fb"} Jul 10 18:41:17.016878 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.016814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4ff7" event={"ID":"8af16626-2016-4153-ab82-039d9ce13ab2","Type":"ContainerStarted","Data":"922cceac1420a95a43da8f6a5b753fdbab10754f9d3d769e5a93187f3a4b8219"} Jul 10 18:41:17.071486 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.071434 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f4ff7" podStartSLOduration=2.9277624810000002 podStartE2EDuration="4.071414216s" totalImagesPullingTime="1.07740685s" totalInitContainerRuntime="66.244885ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:17.070733563 +0000 UTC m=+64.242886481" watchObservedRunningTime="2026-07-10 18:41:17.071414216 +0000 UTC m=+64.243567102" Jul 10 18:41:17.153157 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.153123 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:41:17.155222 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.155196 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.157746 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.157724 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:41:17.157911 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.157889 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:41:17.158027 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.157945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:41:17.158027 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.157895 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:41:17.158182 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.158034 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:41:17.158182 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.158107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qq8s9\"" Jul 10 18:41:17.158397 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.158381 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:41:17.158397 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.158387 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:41:17.170704 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.170681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:41:17.191538 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.191538 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.191751 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.191751 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.191751 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.191751 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.191737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9hz\" (UniqueName: \"kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.293108 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9hz\" (UniqueName: \"kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.293404 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.293758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.294284 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.294369 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.295057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.297982 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.297959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.298719 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.298696 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.302830 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.302807 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9hz\" (UniqueName: \"kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz\") pod \"console-794fcc69d4-t4ng6\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.464876 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.464832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:17.605532 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.605452 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:41:17.609542 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:17.609510 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74642cc4_a414_4a41_9e9a_6d4ad6245492.slice/crio-0075f03911bb43745d51a2a57b8c56230c17e0b0adcbdf2daa5d81b5e8508971 WatchSource:0}: Error finding container 0075f03911bb43745d51a2a57b8c56230c17e0b0adcbdf2daa5d81b5e8508971: Status 404 returned error can't find the container with id 0075f03911bb43745d51a2a57b8c56230c17e0b0adcbdf2daa5d81b5e8508971 Jul 10 18:41:17.961619 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.961581 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6db855f7b8-nz4k2"] Jul 10 18:41:17.963878 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.963855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:17.967779 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.967748 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ie8r8v05v89o\"" Jul 10 18:41:17.967779 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.967767 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 18:41:17.967987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.967745 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 18:41:17.967987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.967761 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 18:41:17.968204 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.968179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 18:41:17.968283 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.968266 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xfsgm\"" Jul 10 18:41:17.984963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:17.984930 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6db855f7b8-nz4k2"] Jul 10 18:41:18.000923 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.000892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-client-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001122 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.000937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-client-certs\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001122 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.001003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-metrics-server-audit-profiles\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001122 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.001079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cnf\" (UniqueName: \"kubernetes.io/projected/0106afb6-a782-4968-b57c-6858149b8de5-kube-api-access-g6cnf\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001266 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.001186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0106afb6-a782-4968-b57c-6858149b8de5-audit-log\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001266 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.001206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-tls\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.001266 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.001229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.022485 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.022449 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794fcc69d4-t4ng6" event={"ID":"74642cc4-a414-4a41-9e9a-6d4ad6245492","Type":"ContainerStarted","Data":"0075f03911bb43745d51a2a57b8c56230c17e0b0adcbdf2daa5d81b5e8508971"} Jul 10 18:41:18.102203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0106afb6-a782-4968-b57c-6858149b8de5-audit-log\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-tls\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102438 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102438 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-client-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102438 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-client-certs\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102438 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-metrics-server-audit-profiles\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102438 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cnf\" (UniqueName: \"kubernetes.io/projected/0106afb6-a782-4968-b57c-6858149b8de5-kube-api-access-g6cnf\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.102739 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.102624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0106afb6-a782-4968-b57c-6858149b8de5-audit-log\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.103053 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.103030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.103475 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.103453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0106afb6-a782-4968-b57c-6858149b8de5-metrics-server-audit-profiles\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.105220 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.105197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-client-ca-bundle\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.105330 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.105260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-client-certs\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.105330 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.105280 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0106afb6-a782-4968-b57c-6858149b8de5-secret-metrics-server-tls\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.112869 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.112847 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cnf\" (UniqueName: \"kubernetes.io/projected/0106afb6-a782-4968-b57c-6858149b8de5-kube-api-access-g6cnf\") pod \"metrics-server-6db855f7b8-nz4k2\" (UID: \"0106afb6-a782-4968-b57c-6858149b8de5\") " pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.276395 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.276305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:18.796713 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.796686 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6db855f7b8-nz4k2"] Jul 10 18:41:18.800413 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:18.800377 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0106afb6_a782_4968_b57c_6858149b8de5.slice/crio-d08f00bac6a64c55900acf967f036667de5c07a73dba43f9835c111e5d0ad898 WatchSource:0}: Error finding container d08f00bac6a64c55900acf967f036667de5c07a73dba43f9835c111e5d0ad898: Status 404 returned error can't find the container with id d08f00bac6a64c55900acf967f036667de5c07a73dba43f9835c111e5d0ad898 Jul 10 18:41:18.980606 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:18.980576 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xhnm4" Jul 10 18:41:19.011302 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.011218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:41:19.011302 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.011290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:41:19.014637 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.014486 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:41:19.014637 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.014585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:41:19.027184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.027123 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ef32f7-0a7f-460d-a902-89dc172b2c9e-metrics-certs\") pod \"network-metrics-daemon-xrpg8\" (UID: \"79ef32f7-0a7f-460d-a902-89dc172b2c9e\") " pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:41:19.027602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.027347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aed8a6c4-2179-42d3-8bf5-d0f93e0f914c-original-pull-secret\") pod \"global-pull-secret-syncer-stdf8\" (UID: \"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c\") " pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:41:19.033426 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.033188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0"} Jul 10 18:41:19.033426 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.033281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea"} Jul 10 18:41:19.033426 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.033325 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe"} Jul 10 18:41:19.033426 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.033366 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e"} Jul 10 18:41:19.033881 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.033807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e"} Jul 10 18:41:19.035328 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.035303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" event={"ID":"0106afb6-a782-4968-b57c-6858149b8de5","Type":"ContainerStarted","Data":"d08f00bac6a64c55900acf967f036667de5c07a73dba43f9835c111e5d0ad898"} Jul 10 18:41:19.212746 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.212711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:19.215635 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.215588 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:41:19.221857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.221831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stdf8" Jul 10 18:41:19.226366 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.226341 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:41:19.236489 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.236465 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxk78\" (UniqueName: \"kubernetes.io/projected/8e75bc25-8bc8-4ad8-a534-73b6484d6ce5-kube-api-access-sxk78\") pod \"network-check-target-m7sk2\" (UID: \"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5\") " pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:19.241881 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.241858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p7c5\"" Jul 10 18:41:19.250187 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.250156 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xrpg8" Jul 10 18:41:19.397276 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.397190 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stdf8"] Jul 10 18:41:19.400538 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:19.400511 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed8a6c4_2179_42d3_8bf5_d0f93e0f914c.slice/crio-b98dfa7edb904fa872d17ed584652db57c093de14cb10afc18d15ca810a328ab WatchSource:0}: Error finding container b98dfa7edb904fa872d17ed584652db57c093de14cb10afc18d15ca810a328ab: Status 404 returned error can't find the container with id b98dfa7edb904fa872d17ed584652db57c093de14cb10afc18d15ca810a328ab Jul 10 18:41:19.426046 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.426012 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xrpg8"] Jul 10 18:41:19.430068 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:19.430037 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ef32f7_0a7f_460d_a902_89dc172b2c9e.slice/crio-0e25600467ff5c5790ad842a6febe71564dfa982e926e2d7d981592709e22f6d WatchSource:0}: Error finding container 0e25600467ff5c5790ad842a6febe71564dfa982e926e2d7d981592709e22f6d: Status 404 returned error can't find the container with id 0e25600467ff5c5790ad842a6febe71564dfa982e926e2d7d981592709e22f6d Jul 10 18:41:19.536535 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.536251 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6dtsl\"" Jul 10 18:41:19.544149 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.543929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:19.715897 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:19.715855 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m7sk2"] Jul 10 18:41:19.720116 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:19.720063 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e75bc25_8bc8_4ad8_a534_73b6484d6ce5.slice/crio-efbd483eaa5f9de1592f1018f712225004b98389cb48ebbcae02106a438ade45 WatchSource:0}: Error finding container efbd483eaa5f9de1592f1018f712225004b98389cb48ebbcae02106a438ade45: Status 404 returned error can't find the container with id efbd483eaa5f9de1592f1018f712225004b98389cb48ebbcae02106a438ade45 Jul 10 18:41:20.045658 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:20.045590 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7sk2" event={"ID":"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5","Type":"ContainerStarted","Data":"efbd483eaa5f9de1592f1018f712225004b98389cb48ebbcae02106a438ade45"} Jul 10 18:41:20.048527 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:20.048494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xrpg8" event={"ID":"79ef32f7-0a7f-460d-a902-89dc172b2c9e","Type":"ContainerStarted","Data":"0e25600467ff5c5790ad842a6febe71564dfa982e926e2d7d981592709e22f6d"} Jul 10 18:41:20.050078 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:20.050022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stdf8" event={"ID":"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c","Type":"ContainerStarted","Data":"b98dfa7edb904fa872d17ed584652db57c093de14cb10afc18d15ca810a328ab"} Jul 10 18:41:22.949777 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:22.949735 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fd4d9b8df-8qppk" Jul 10 18:41:25.076557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.076453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" event={"ID":"0106afb6-a782-4968-b57c-6858149b8de5","Type":"ContainerStarted","Data":"0823ca21e24adc67a282abaf32d0e3032eb4d9922518a1531eb3a7d2b4723217"} Jul 10 18:41:25.078025 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.077997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m7sk2" event={"ID":"8e75bc25-8bc8-4ad8-a534-73b6484d6ce5","Type":"ContainerStarted","Data":"1b695a7865d297035e2b1c66942e674eb1df74a8de8af5b27b3ef1100471be15"} Jul 10 18:41:25.078191 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.078063 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:25.079819 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.079786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xrpg8" event={"ID":"79ef32f7-0a7f-460d-a902-89dc172b2c9e","Type":"ContainerStarted","Data":"e2bac8add6f05851146be428e738d2d335a43a8e66a1fa384b8b8a101b33333e"} Jul 10 18:41:25.079926 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.079853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xrpg8" event={"ID":"79ef32f7-0a7f-460d-a902-89dc172b2c9e","Type":"ContainerStarted","Data":"d6c25681ee757ea3d240f2c8453abc8c98ce3daeaad756c33d64a40c275befbd"} Jul 10 18:41:25.081235 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.081209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stdf8" event={"ID":"aed8a6c4-2179-42d3-8bf5-d0f93e0f914c","Type":"ContainerStarted","Data":"96350dafe4db223ac376c2acca41db9ba5ed602b37600fcd7b8c6aa5e60d92d6"} Jul 10 18:41:25.084779 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.084751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerStarted","Data":"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83"} Jul 10 18:41:25.086258 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.086239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794fcc69d4-t4ng6" event={"ID":"74642cc4-a414-4a41-9e9a-6d4ad6245492","Type":"ContainerStarted","Data":"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452"} Jul 10 18:41:25.110558 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.110498 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" podStartSLOduration=2.178125299 podStartE2EDuration="8.110476836s" totalImagesPullingTime="5.932351537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.109781887 +0000 UTC m=+72.281934783" watchObservedRunningTime="2026-07-10 18:41:25.110476836 +0000 UTC m=+72.282629702" Jul 10 18:41:25.131828 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.131773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m7sk2" podStartSLOduration=66.095066139 podStartE2EDuration="1m11.131757217s" totalImagesPullingTime="5.036691078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.130745797 +0000 UTC m=+72.302898686" watchObservedRunningTime="2026-07-10 18:41:25.131757217 +0000 UTC m=+72.303910104" Jul 10 18:41:25.162567 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.162484 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.722881402 podStartE2EDuration="11.162461114s" totalImagesPullingTime="8.422804328s" totalInitContainerRuntime="16.775384ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.161358254 +0000 UTC m=+72.333511171" watchObservedRunningTime="2026-07-10 18:41:25.162461114 +0000 UTC m=+72.334614002" Jul 10 18:41:25.183213 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.183162 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794fcc69d4-t4ng6" podStartSLOduration=1.082670445 podStartE2EDuration="8.183143725s" totalImagesPullingTime="7.10047328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.181495172 +0000 UTC m=+72.353648059" watchObservedRunningTime="2026-07-10 18:41:25.183143725 +0000 UTC m=+72.355296611" Jul 10 18:41:25.200040 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.199984 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xrpg8" podStartSLOduration=66.896928819 podStartE2EDuration="1m12.199962449s" totalImagesPullingTime="5.30303363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.199638474 +0000 UTC m=+72.371791361" watchObservedRunningTime="2026-07-10 18:41:25.199962449 +0000 UTC m=+72.372115316" Jul 10 18:41:25.220103 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:25.220027 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-stdf8" podStartSLOduration=65.863670072 podStartE2EDuration="1m11.220005706s" totalImagesPullingTime="5.356335634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:25.219374131 +0000 UTC m=+72.391527029" watchObservedRunningTime="2026-07-10 18:41:25.220005706 +0000 UTC m=+72.392158592" Jul 10 18:41:27.464983 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.464940 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:27.465428 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.465031 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:27.469808 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.469783 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:27.955965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.955930 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:41:27.958024 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.958006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:27.966993 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.966968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:41:27.971819 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:27.971795 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:41:28.094740 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.094740 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.095010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094787 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.095010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8lbx\" (UniqueName: \"kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.095010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.095010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.095010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.094996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.101325 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.101302 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:41:28.196074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8lbx\" (UniqueName: \"kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196460 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196460 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.196557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.197013 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.196987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.197684 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.197656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.197965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.197940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.198445 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.198418 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.198867 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.198844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.199075 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.199056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.215853 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.215783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8lbx\" (UniqueName: \"kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx\") pod \"console-f86c78496-nmrsl\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.267787 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.267745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:28.410199 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:28.410162 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:41:28.413462 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:41:28.413433 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc110e61e_9d1f_4297_88cc_90e888eba8dc.slice/crio-346348dd595d125eed6feecf8bbbab115a55007086a3d4e48971a4862bee762c WatchSource:0}: Error finding container 346348dd595d125eed6feecf8bbbab115a55007086a3d4e48971a4862bee762c: Status 404 returned error can't find the container with id 346348dd595d125eed6feecf8bbbab115a55007086a3d4e48971a4862bee762c Jul 10 18:41:29.101888 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:29.101853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86c78496-nmrsl" event={"ID":"c110e61e-9d1f-4297-88cc-90e888eba8dc","Type":"ContainerStarted","Data":"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658"} Jul 10 18:41:29.102314 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:29.101904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86c78496-nmrsl" event={"ID":"c110e61e-9d1f-4297-88cc-90e888eba8dc","Type":"ContainerStarted","Data":"346348dd595d125eed6feecf8bbbab115a55007086a3d4e48971a4862bee762c"} Jul 10 18:41:29.127523 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:29.127464 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f86c78496-nmrsl" podStartSLOduration=2.127446223 podStartE2EDuration="2.127446223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:41:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:29.126632989 +0000 UTC m=+76.298785875" watchObservedRunningTime="2026-07-10 18:41:29.127446223 +0000 UTC m=+76.299599108" Jul 10 18:41:38.268924 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:38.268795 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:38.268924 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:38.268873 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:38.273611 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:38.273588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:38.276783 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:38.276756 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:38.276889 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:38.276815 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:39.143249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:39.143222 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:41:39.211638 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:39.211608 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:41:55.853179 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:55.853144 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/init-config-reloader/0.log" Jul 10 18:41:56.052986 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.052957 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/alertmanager/0.log" Jul 10 18:41:56.093148 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.093123 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m7sk2" Jul 10 18:41:56.252811 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.252783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/config-reloader/0.log" Jul 10 18:41:56.455506 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.455482 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/kube-rbac-proxy-web/0.log" Jul 10 18:41:56.654786 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.654713 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/kube-rbac-proxy/0.log" Jul 10 18:41:56.853248 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:56.853218 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/kube-rbac-proxy-metric/0.log" Jul 10 18:41:57.053913 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:57.053887 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c08bae19-3af0-4ced-8e39-f14db4131d63/prom-label-proxy/0.log" Jul 10 18:41:58.054359 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:58.054328 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6db855f7b8-nz4k2_0106afb6-a782-4968-b57c-6858149b8de5/metrics-server/0.log" Jul 10 18:41:58.282296 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:58.282266 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:58.286177 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:58.286149 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6db855f7b8-nz4k2" Jul 10 18:41:59.081490 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:59.081457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/init-textfile/0.log" Jul 10 18:41:59.259210 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:59.259182 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/node-exporter/0.log" Jul 10 18:41:59.456139 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:41:59.456117 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/kube-rbac-proxy/0.log" Jul 10 18:42:04.238602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.238537 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-794fcc69d4-t4ng6" podUID="74642cc4-a414-4a41-9e9a-6d4ad6245492" containerName="console" containerID="cri-o://4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452" gracePeriod=15 Jul 10 18:42:04.484029 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.484003 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:42:04.485999 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.485979 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486118 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486016 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486118 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486045 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486118 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486102 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486278 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486127 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd9hz\" (UniqueName: \"kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486278 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486180 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config\") pod \"74642cc4-a414-4a41-9e9a-6d4ad6245492\" (UID: \"74642cc4-a414-4a41-9e9a-6d4ad6245492\") " Jul 10 18:42:04.486441 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486411 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca" (OuterVolumeSpecName: "service-ca") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:04.486519 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486418 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:04.486626 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.486600 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config" (OuterVolumeSpecName: "console-config") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:04.488388 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.488356 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:04.488545 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.488439 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:04.488545 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.488494 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz" (OuterVolumeSpecName: "kube-api-access-dd9hz") pod "74642cc4-a414-4a41-9e9a-6d4ad6245492" (UID: "74642cc4-a414-4a41-9e9a-6d4ad6245492"). InnerVolumeSpecName "kube-api-access-dd9hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:04.587659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587608 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-oauth-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.587659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587653 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-service-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.587659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587662 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-oauth-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.587659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587670 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.587659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587679 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd9hz\" (UniqueName: \"kubernetes.io/projected/74642cc4-a414-4a41-9e9a-6d4ad6245492-kube-api-access-dd9hz\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.587960 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.587687 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74642cc4-a414-4a41-9e9a-6d4ad6245492-console-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:04.652699 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.652674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-794fcc69d4-t4ng6_74642cc4-a414-4a41-9e9a-6d4ad6245492/console/0.log" Jul 10 18:42:04.853749 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:04.853678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f86c78496-nmrsl_c110e61e-9d1f-4297-88cc-90e888eba8dc/console/0.log" Jul 10 18:42:05.238565 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.238531 2563 generic.go:356] "Generic (PLEG): container finished" podID="74642cc4-a414-4a41-9e9a-6d4ad6245492" containerID="4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452" exitCode=0 Jul 10 18:42:05.238741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.238580 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794fcc69d4-t4ng6" Jul 10 18:42:05.238741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.238605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794fcc69d4-t4ng6" event={"ID":"74642cc4-a414-4a41-9e9a-6d4ad6245492","Type":"ContainerDied","Data":"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452"} Jul 10 18:42:05.238741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.238644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794fcc69d4-t4ng6" event={"ID":"74642cc4-a414-4a41-9e9a-6d4ad6245492","Type":"ContainerDied","Data":"0075f03911bb43745d51a2a57b8c56230c17e0b0adcbdf2daa5d81b5e8508971"} Jul 10 18:42:05.238741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.238663 2563 scope.go:117] "RemoveContainer" containerID="4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452" Jul 10 18:42:05.247357 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.247339 2563 scope.go:117] "RemoveContainer" containerID="4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452" Jul 10 18:42:05.247645 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:05.247625 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452\": container with ID starting with 4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452 not found: ID does not exist" containerID="4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452" Jul 10 18:42:05.247719 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.247653 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452"} err="failed to get container status \"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452\": rpc error: code = NotFound desc = could not find container \"4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452\": container with ID starting with 4a7cc6ebb717339add02d36fd98dc96b9b9894466f2a5b2c978b410d84d96452 not found: ID does not exist" Jul 10 18:42:05.260101 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.260056 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:42:05.261618 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.261597 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794fcc69d4-t4ng6"] Jul 10 18:42:05.708972 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.708938 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74642cc4-a414-4a41-9e9a-6d4ad6245492" path="/var/lib/kubelet/pods/74642cc4-a414-4a41-9e9a-6d4ad6245492/volumes" Jul 10 18:42:05.852780 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:05.852750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssq2f_5cf7faef-3ea2-4891-9cf3-532439315284/serve-healthcheck-canary/0.log" Jul 10 18:42:33.944571 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944535 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944823 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="alertmanager" containerID="cri-o://3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" gracePeriod=120 Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944870 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-metric" containerID="cri-o://ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" gracePeriod=120 Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944952 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="prom-label-proxy" containerID="cri-o://342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" gracePeriod=120 Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944987 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="config-reloader" containerID="cri-o://b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" gracePeriod=120 Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944975 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy" containerID="cri-o://a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" gracePeriod=120 Jul 10 18:42:33.945143 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:33.944955 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-web" containerID="cri-o://a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" gracePeriod=120 Jul 10 18:42:34.347596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347503 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" exitCode=0 Jul 10 18:42:34.347596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347531 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" exitCode=0 Jul 10 18:42:34.347596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347538 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" exitCode=0 Jul 10 18:42:34.347596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347544 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" exitCode=0 Jul 10 18:42:34.347596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83"} Jul 10 18:42:34.347906 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347674 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea"} Jul 10 18:42:34.347906 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e"} Jul 10 18:42:34.347906 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:34.347752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e"} Jul 10 18:42:35.191591 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.191565 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.326592 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326491 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326592 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326533 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326592 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326570 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326592 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326590 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326637 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4nf\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326690 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326727 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326762 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326802 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326829 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326854 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.326931 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326896 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle\") pod \"c08bae19-3af0-4ced-8e39-f14db4131d63\" (UID: \"c08bae19-3af0-4ced-8e39-f14db4131d63\") " Jul 10 18:42:35.327406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.326936 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:42:35.327406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.327185 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-main-db\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.327522 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.327434 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:35.327993 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.327965 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:42:35.329999 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.329964 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.330136 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330063 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out" (OuterVolumeSpecName: "config-out") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:42:35.330355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330304 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf" (OuterVolumeSpecName: "kube-api-access-7q4nf") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "kube-api-access-7q4nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:35.330569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330512 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.330673 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330584 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume" (OuterVolumeSpecName: "config-volume") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.330755 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330730 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.330887 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.330866 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.331035 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.331016 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:35.334610 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.334583 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.340528 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.340504 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config" (OuterVolumeSpecName: "web-config") pod "c08bae19-3af0-4ced-8e39-f14db4131d63" (UID: "c08bae19-3af0-4ced-8e39-f14db4131d63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:35.354981 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.354952 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" exitCode=0 Jul 10 18:42:35.354981 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.354977 2563 generic.go:356] "Generic (PLEG): container finished" podID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerID="a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" exitCode=0 Jul 10 18:42:35.355210 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.355040 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.355210 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.355037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0"} Jul 10 18:42:35.355210 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.355182 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe"} Jul 10 18:42:35.355348 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.355234 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c08bae19-3af0-4ced-8e39-f14db4131d63","Type":"ContainerDied","Data":"f5798b70970e0681e78b654a27484973a1d2d3fcaec71bd4f8a5d35f0de716aa"} Jul 10 18:42:35.355348 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.355253 2563 scope.go:117] "RemoveContainer" containerID="342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" Jul 10 18:42:35.362989 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.362922 2563 scope.go:117] "RemoveContainer" containerID="ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" Jul 10 18:42:35.369822 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.369808 2563 scope.go:117] "RemoveContainer" containerID="a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" Jul 10 18:42:35.376203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.376185 2563 scope.go:117] "RemoveContainer" containerID="a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" Jul 10 18:42:35.378818 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.378798 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:35.382133 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.382110 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:35.383489 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.383473 2563 scope.go:117] "RemoveContainer" containerID="b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" Jul 10 18:42:35.390441 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.390416 2563 scope.go:117] "RemoveContainer" containerID="3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" Jul 10 18:42:35.397567 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.397543 2563 scope.go:117] "RemoveContainer" containerID="b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e" Jul 10 18:42:35.404481 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.404464 2563 scope.go:117] "RemoveContainer" containerID="342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" Jul 10 18:42:35.404769 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.404749 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83\": container with ID starting with 342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83 not found: ID does not exist" containerID="342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" Jul 10 18:42:35.404858 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.404781 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83"} err="failed to get container status \"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83\": rpc error: code = NotFound desc = could not find container \"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83\": container with ID starting with 342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83 not found: ID does not exist" Jul 10 18:42:35.404858 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.404808 2563 scope.go:117] "RemoveContainer" containerID="ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" Jul 10 18:42:35.405049 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.405031 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0\": container with ID starting with ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0 not found: ID does not exist" containerID="ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" Jul 10 18:42:35.405129 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405057 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0"} err="failed to get container status \"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0\": rpc error: code = NotFound desc = could not find container \"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0\": container with ID starting with ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0 not found: ID does not exist" Jul 10 18:42:35.405129 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405072 2563 scope.go:117] "RemoveContainer" containerID="a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" Jul 10 18:42:35.405320 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.405306 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea\": container with ID starting with a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea not found: ID does not exist" containerID="a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" Jul 10 18:42:35.405355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405324 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea"} err="failed to get container status \"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea\": rpc error: code = NotFound desc = could not find container \"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea\": container with ID starting with a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea not found: ID does not exist" Jul 10 18:42:35.405355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405345 2563 scope.go:117] "RemoveContainer" containerID="a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" Jul 10 18:42:35.405600 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.405574 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe\": container with ID starting with a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe not found: ID does not exist" containerID="a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" Jul 10 18:42:35.405667 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405601 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe"} err="failed to get container status \"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe\": rpc error: code = NotFound desc = could not find container \"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe\": container with ID starting with a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe not found: ID does not exist" Jul 10 18:42:35.405667 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405616 2563 scope.go:117] "RemoveContainer" containerID="b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" Jul 10 18:42:35.405838 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.405821 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e\": container with ID starting with b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e not found: ID does not exist" containerID="b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" Jul 10 18:42:35.405881 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405842 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e"} err="failed to get container status \"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e\": rpc error: code = NotFound desc = could not find container \"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e\": container with ID starting with b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e not found: ID does not exist" Jul 10 18:42:35.405881 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.405870 2563 scope.go:117] "RemoveContainer" containerID="3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" Jul 10 18:42:35.406076 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.406060 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e\": container with ID starting with 3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e not found: ID does not exist" containerID="3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" Jul 10 18:42:35.406173 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406114 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e"} err="failed to get container status \"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e\": rpc error: code = NotFound desc = could not find container \"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e\": container with ID starting with 3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e not found: ID does not exist" Jul 10 18:42:35.406173 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406134 2563 scope.go:117] "RemoveContainer" containerID="b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e" Jul 10 18:42:35.406387 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:42:35.406369 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e\": container with ID starting with b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e not found: ID does not exist" containerID="b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e" Jul 10 18:42:35.406446 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406392 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e"} err="failed to get container status \"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e\": rpc error: code = NotFound desc = could not find container \"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e\": container with ID starting with b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e not found: ID does not exist" Jul 10 18:42:35.406446 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406407 2563 scope.go:117] "RemoveContainer" containerID="342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83" Jul 10 18:42:35.406666 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406637 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83"} err="failed to get container status \"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83\": rpc error: code = NotFound desc = could not find container \"342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83\": container with ID starting with 342825c44668271466108813e66d1410bdab23c2e9b1c85b6f9914b6d7027e83 not found: ID does not exist" Jul 10 18:42:35.406666 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406658 2563 scope.go:117] "RemoveContainer" containerID="ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0" Jul 10 18:42:35.406949 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406926 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0"} err="failed to get container status \"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0\": rpc error: code = NotFound desc = could not find container \"ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0\": container with ID starting with ac5079889221f40ac93eaf2fafb68f25863a743ac242efa808f76d82e5e7acc0 not found: ID does not exist" Jul 10 18:42:35.407012 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.406952 2563 scope.go:117] "RemoveContainer" containerID="a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea" Jul 10 18:42:35.407257 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407228 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea"} err="failed to get container status \"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea\": rpc error: code = NotFound desc = could not find container \"a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea\": container with ID starting with a5ce3d48aeabdac1cbf68a6b2c612888c54ce49132e81fd0a32d50b2eff13cea not found: ID does not exist" Jul 10 18:42:35.407257 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407247 2563 scope.go:117] "RemoveContainer" containerID="a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe" Jul 10 18:42:35.407497 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407477 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe"} err="failed to get container status \"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe\": rpc error: code = NotFound desc = could not find container \"a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe\": container with ID starting with a7b59756b43afa91385d3b439f02cebbe962c67f5a4777f2ff5e40fd177adcbe not found: ID does not exist" Jul 10 18:42:35.407569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407499 2563 scope.go:117] "RemoveContainer" containerID="b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e" Jul 10 18:42:35.407746 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407729 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e"} err="failed to get container status \"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e\": rpc error: code = NotFound desc = could not find container \"b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e\": container with ID starting with b90f35b3aa91b8dbaa5637c5d5fb49ff4435d0ae285c8d9d40f613081715217e not found: ID does not exist" Jul 10 18:42:35.407797 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407747 2563 scope.go:117] "RemoveContainer" containerID="3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e" Jul 10 18:42:35.407953 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407925 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e"} err="failed to get container status \"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e\": rpc error: code = NotFound desc = could not find container \"3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e\": container with ID starting with 3840444cac0e4af15bebcb0887238e7a6b98212c2186195abfb03cc7162be88e not found: ID does not exist" Jul 10 18:42:35.407953 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.407943 2563 scope.go:117] "RemoveContainer" containerID="b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e" Jul 10 18:42:35.408163 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.408146 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e"} err="failed to get container status \"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e\": rpc error: code = NotFound desc = could not find container \"b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e\": container with ID starting with b6c29c5d4f77889a48d7ac59af93bdfe3663554f27f12143b831c8d95498892e not found: ID does not exist" Jul 10 18:42:35.415704 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415682 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:35.415928 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415914 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="prom-label-proxy" Jul 10 18:42:35.415964 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415931 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="prom-label-proxy" Jul 10 18:42:35.415964 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415942 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy" Jul 10 18:42:35.415964 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415948 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy" Jul 10 18:42:35.415964 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415954 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-metric" Jul 10 18:42:35.415964 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415960 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-metric" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415972 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="config-reloader" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415978 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="config-reloader" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415983 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74642cc4-a414-4a41-9e9a-6d4ad6245492" containerName="console" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.415988 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74642cc4-a414-4a41-9e9a-6d4ad6245492" containerName="console" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416000 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="alertmanager" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416008 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="alertmanager" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416016 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="init-config-reloader" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416022 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="init-config-reloader" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416027 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-web" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416032 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-web" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416065 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="alertmanager" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416072 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-web" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416080 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="config-reloader" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416101 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416109 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74642cc4-a414-4a41-9e9a-6d4ad6245492" containerName="console" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416115 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="kube-rbac-proxy-metric" Jul 10 18:42:35.416120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.416121 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" containerName="prom-label-proxy" Jul 10 18:42:35.419673 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.419659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.422371 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422349 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rpflm\"" Jul 10 18:42:35.422474 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:42:35.422474 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:42:35.422474 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:42:35.422474 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:42:35.422683 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:42:35.422683 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422664 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:42:35.422787 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422764 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:42:35.422909 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.422894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:42:35.427580 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427562 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-tls-assets\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427580 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427582 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-web-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427594 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-config-volume\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427606 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427620 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427635 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c08bae19-3af0-4ced-8e39-f14db4131d63-config-out\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427647 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-cluster-tls-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427660 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-main-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427673 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4nf\" (UniqueName: \"kubernetes.io/projected/c08bae19-3af0-4ced-8e39-f14db4131d63-kube-api-access-7q4nf\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427708 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427723 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c08bae19-3af0-4ced-8e39-f14db4131d63-metrics-client-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.427742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.427739 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c08bae19-3af0-4ced-8e39-f14db4131d63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:42:35.428076 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.428060 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:42:35.440875 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.440851 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:35.528412 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528412 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-out\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tldb5\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-kube-api-access-tldb5\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-web-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528642 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.528857 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.528743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629268 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-out\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tldb5\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-kube-api-access-tldb5\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-web-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.629991 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.629872 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.630355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.630322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.631509 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.630858 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.631918 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.631889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-out\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.632288 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.632229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.632411 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.632377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.632487 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.632464 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.632553 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.632514 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.632605 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.632554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.633491 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.633471 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.633684 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.633665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-web-config\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.634051 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.634034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.638979 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.638956 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tldb5\" (UniqueName: \"kubernetes.io/projected/9a5feb7a-1509-42ba-a06a-acb6fb36d8ab-kube-api-access-tldb5\") pod \"alertmanager-main-0\" (UID: \"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.708530 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.708499 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c08bae19-3af0-4ced-8e39-f14db4131d63" path="/var/lib/kubelet/pods/c08bae19-3af0-4ced-8e39-f14db4131d63/volumes" Jul 10 18:42:35.729965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.729939 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:42:35.866790 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:35.866766 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:42:35.869173 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:42:35.869148 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5feb7a_1509_42ba_a06a_acb6fb36d8ab.slice/crio-ee9a7324568153be31aab594d02cecb8504764356f05fbcfafd3235c303a4201 WatchSource:0}: Error finding container ee9a7324568153be31aab594d02cecb8504764356f05fbcfafd3235c303a4201: Status 404 returned error can't find the container with id ee9a7324568153be31aab594d02cecb8504764356f05fbcfafd3235c303a4201 Jul 10 18:42:36.363561 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:36.363529 2563 generic.go:356] "Generic (PLEG): container finished" podID="9a5feb7a-1509-42ba-a06a-acb6fb36d8ab" containerID="4bd44827321085ca4bf51e503d870ab46d889e0e4fd05a324d7ee87ca126bd08" exitCode=0 Jul 10 18:42:36.363988 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:36.363610 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerDied","Data":"4bd44827321085ca4bf51e503d870ab46d889e0e4fd05a324d7ee87ca126bd08"} Jul 10 18:42:36.363988 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:36.363690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"ee9a7324568153be31aab594d02cecb8504764356f05fbcfafd3235c303a4201"} Jul 10 18:42:37.372075 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"b2d73425490f76d6c67d19a2759850c378a9a48ba58e7e82dfc5b91b21acf618"} Jul 10 18:42:37.372480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"759ec48ac420026c84533e83e46afd51665c8fd0c0d1f3711e458da06e8e2bc8"} Jul 10 18:42:37.372480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"4d21ef5ece5a82e54236e61c968fe50eb2e1863e817e34e3e80d818f909b507d"} Jul 10 18:42:37.372480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"f6449acbe530eaf84fbf3b178273da482362228047eeff937b068a813cc2532d"} Jul 10 18:42:37.372480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"9dc12671ac6dcd2f1801e86311ed005729004128c49a231cafee1ab21cd99cb6"} Jul 10 18:42:37.372480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.372315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a5feb7a-1509-42ba-a06a-acb6fb36d8ab","Type":"ContainerStarted","Data":"a6a774b550ef72310bb06732adab7557b95de85709140f3880ec7f612f9efbd1"} Jul 10 18:42:37.398947 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.398890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.382675709 podStartE2EDuration="2.398872151s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.196442ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:37.396814336 +0000 UTC m=+144.568967240" watchObservedRunningTime="2026-07-10 18:42:37.398872151 +0000 UTC m=+144.571025036" Jul 10 18:42:37.959996 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.959962 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74b9df7569-b7zr8"] Jul 10 18:42:37.962126 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.962109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:37.964577 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.964546 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 18:42:37.964577 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.964546 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 18:42:37.964757 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.964547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 18:42:37.964757 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.964611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 18:42:37.964906 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.964893 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 18:42:37.965210 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.965194 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m9tkd\"" Jul 10 18:42:37.970841 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.970816 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 18:42:37.979168 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:37.979142 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b9df7569-b7zr8"] Jul 10 18:42:38.047714 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgl6\" (UniqueName: \"kubernetes.io/projected/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-kube-api-access-bdgl6\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.047872 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.047872 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-federate-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.047872 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-metrics-client-ca\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.047872 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.048075 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.048075 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.047962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.048075 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.048006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-serving-certs-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.148987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.148952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.148987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.148993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-serving-certs-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgl6\" (UniqueName: \"kubernetes.io/projected/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-kube-api-access-bdgl6\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-federate-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149279 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-metrics-client-ca\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149525 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.149854 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-serving-certs-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.150070 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.149954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.150070 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.150010 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-metrics-client-ca\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.151742 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.151721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-telemeter-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.151880 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.151860 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.152113 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.152075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-secret-telemeter-client\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.152162 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.152111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-federate-client-tls\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.157411 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.157381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgl6\" (UniqueName: \"kubernetes.io/projected/1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca-kube-api-access-bdgl6\") pod \"telemeter-client-74b9df7569-b7zr8\" (UID: \"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca\") " pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.271617 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.271529 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" Jul 10 18:42:38.409053 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:38.409021 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b9df7569-b7zr8"] Jul 10 18:42:39.381699 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:39.381662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" event={"ID":"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca","Type":"ContainerStarted","Data":"3b791c30cc4ccee12ee5a5ebd148f32520a6b666a7663cf3e7a30d414400344b"} Jul 10 18:42:40.389942 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:40.389912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" event={"ID":"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca","Type":"ContainerStarted","Data":"f579fc9a5153e91ca3c4e107186894ca39a65ddc513d8b7a1cde2521d02e1e99"} Jul 10 18:42:40.390387 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:40.389966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" event={"ID":"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca","Type":"ContainerStarted","Data":"8648331c8e9c7c6cfe6f9f7486f7a5f99ecf7cfae2050a1685e0117ff3e3d89b"} Jul 10 18:42:41.396105 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:41.396058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" event={"ID":"1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca","Type":"ContainerStarted","Data":"6df06396eb552f3a22accaa4eadb28de4d78b4f380788bf24a2f8ac0f9dce029"} Jul 10 18:42:41.434329 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:41.434273 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74b9df7569-b7zr8" podStartSLOduration=2.621129198 podStartE2EDuration="4.434255684s" totalImagesPullingTime="1.813126486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:41.433399864 +0000 UTC m=+148.605552749" watchObservedRunningTime="2026-07-10 18:42:41.434255684 +0000 UTC m=+148.606408574" Jul 10 18:42:42.406602 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.406568 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:42:42.409029 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.409010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.421308 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.421277 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:42:42.488233 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488458 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488458 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488458 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488458 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4w6k\" (UniqueName: \"kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488458 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.488757 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.488480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589496 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4w6k\" (UniqueName: \"kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589648 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.589871 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.589664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.590392 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.590363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.590512 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.590425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.590590 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.590518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.590590 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.590522 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.592079 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.592059 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.592256 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.592237 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.597382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.597359 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4w6k\" (UniqueName: \"kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k\") pod \"console-744bf8476-rmf7n\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.717966 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.717927 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:42.849008 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:42.848977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:42:42.852005 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:42:42.851974 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f129876_34be_4b1e_891d_e794f04bc3cb.slice/crio-1997392d0f63e805bb2330df47bdf257ff858b129e18d1a000a3a69605a5ecc2 WatchSource:0}: Error finding container 1997392d0f63e805bb2330df47bdf257ff858b129e18d1a000a3a69605a5ecc2: Status 404 returned error can't find the container with id 1997392d0f63e805bb2330df47bdf257ff858b129e18d1a000a3a69605a5ecc2 Jul 10 18:42:43.403961 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:43.403923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744bf8476-rmf7n" event={"ID":"3f129876-34be-4b1e-891d-e794f04bc3cb","Type":"ContainerStarted","Data":"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372"} Jul 10 18:42:43.404221 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:43.403977 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744bf8476-rmf7n" event={"ID":"3f129876-34be-4b1e-891d-e794f04bc3cb","Type":"ContainerStarted","Data":"1997392d0f63e805bb2330df47bdf257ff858b129e18d1a000a3a69605a5ecc2"} Jul 10 18:42:43.422714 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:43.422669 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-744bf8476-rmf7n" podStartSLOduration=1.422652893 podStartE2EDuration="1.422652893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:43.421341371 +0000 UTC m=+150.593494258" watchObservedRunningTime="2026-07-10 18:42:43.422652893 +0000 UTC m=+150.594805778" Jul 10 18:42:52.718296 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:52.718250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:52.718793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:52.718349 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:52.722827 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:52.722800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:53.441868 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:53.441839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:42:53.503074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:42:53.503043 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:43:18.523578 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.523535 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f86c78496-nmrsl" podUID="c110e61e-9d1f-4297-88cc-90e888eba8dc" containerName="console" containerID="cri-o://4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658" gracePeriod=15 Jul 10 18:43:18.764655 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.764631 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:43:18.892793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892686 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.892793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8lbx\" (UniqueName: \"kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893020 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892798 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893020 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892820 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893020 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892845 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893020 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892873 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893020 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.892914 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config\") pod \"c110e61e-9d1f-4297-88cc-90e888eba8dc\" (UID: \"c110e61e-9d1f-4297-88cc-90e888eba8dc\") " Jul 10 18:43:18.893361 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.893314 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config" (OuterVolumeSpecName: "console-config") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:18.893361 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.893337 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:18.893493 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.893339 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:18.893493 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.893421 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:43:18.895019 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.894985 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:18.895155 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.895046 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:43:18.895155 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.895102 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx" (OuterVolumeSpecName: "kube-api-access-b8lbx") pod "c110e61e-9d1f-4297-88cc-90e888eba8dc" (UID: "c110e61e-9d1f-4297-88cc-90e888eba8dc"). InnerVolumeSpecName "kube-api-access-b8lbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:43:18.994325 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994284 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-oauth-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994325 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994315 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994325 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994325 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-service-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994325 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994333 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994591 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994343 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-oauth-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994591 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994351 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c110e61e-9d1f-4297-88cc-90e888eba8dc-console-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:18.994591 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:18.994359 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8lbx\" (UniqueName: \"kubernetes.io/projected/c110e61e-9d1f-4297-88cc-90e888eba8dc-kube-api-access-b8lbx\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:43:19.529291 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.529254 2563 generic.go:356] "Generic (PLEG): container finished" podID="c110e61e-9d1f-4297-88cc-90e888eba8dc" containerID="4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658" exitCode=0 Jul 10 18:43:19.529685 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.529305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86c78496-nmrsl" event={"ID":"c110e61e-9d1f-4297-88cc-90e888eba8dc","Type":"ContainerDied","Data":"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658"} Jul 10 18:43:19.529685 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.529318 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86c78496-nmrsl" Jul 10 18:43:19.529685 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.529375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86c78496-nmrsl" event={"ID":"c110e61e-9d1f-4297-88cc-90e888eba8dc","Type":"ContainerDied","Data":"346348dd595d125eed6feecf8bbbab115a55007086a3d4e48971a4862bee762c"} Jul 10 18:43:19.529685 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.529399 2563 scope.go:117] "RemoveContainer" containerID="4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658" Jul 10 18:43:19.537707 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.537687 2563 scope.go:117] "RemoveContainer" containerID="4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658" Jul 10 18:43:19.537989 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:43:19.537971 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658\": container with ID starting with 4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658 not found: ID does not exist" containerID="4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658" Jul 10 18:43:19.538033 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.537997 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658"} err="failed to get container status \"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658\": rpc error: code = NotFound desc = could not find container \"4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658\": container with ID starting with 4ad6af6ab319407c9ca76606a308739460baf0ce8c8924011d78408bdcf89658 not found: ID does not exist" Jul 10 18:43:19.552988 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.552960 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:43:19.555527 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.555505 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f86c78496-nmrsl"] Jul 10 18:43:19.708988 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:19.708954 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c110e61e-9d1f-4297-88cc-90e888eba8dc" path="/var/lib/kubelet/pods/c110e61e-9d1f-4297-88cc-90e888eba8dc/volumes" Jul 10 18:43:48.709421 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.709390 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:43:48.709911 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.709649 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c110e61e-9d1f-4297-88cc-90e888eba8dc" containerName="console" Jul 10 18:43:48.709911 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.709659 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c110e61e-9d1f-4297-88cc-90e888eba8dc" containerName="console" Jul 10 18:43:48.709911 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.709712 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c110e61e-9d1f-4297-88cc-90e888eba8dc" containerName="console" Jul 10 18:43:48.711534 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.711518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.728568 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.728537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:43:48.837771 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.837730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.837944 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.837828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.837944 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.837879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.838034 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.837992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.838113 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.838028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhntj\" (UniqueName: \"kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.838167 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.838141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.838248 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.838230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939142 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939142 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939176 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhntj\" (UniqueName: \"kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.939975 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.939938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.940082 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.940000 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.940082 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.940011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.940082 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.940022 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.942333 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.942310 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.942427 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.942401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:48.961251 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:48.961177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhntj\" (UniqueName: \"kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj\") pod \"console-5d9867dcd-5lpgn\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:49.019985 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:49.019932 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:49.165738 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:49.165706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:43:49.170698 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:43:49.170671 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5eafb8_982b_49c8_87d3_9b70ef8b10fa.slice/crio-f0cac12036334cc675c54d2ead5f1637e78f7fb9a286a46131102382784a3b01 WatchSource:0}: Error finding container f0cac12036334cc675c54d2ead5f1637e78f7fb9a286a46131102382784a3b01: Status 404 returned error can't find the container with id f0cac12036334cc675c54d2ead5f1637e78f7fb9a286a46131102382784a3b01 Jul 10 18:43:49.640558 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:49.640460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9867dcd-5lpgn" event={"ID":"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa","Type":"ContainerStarted","Data":"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043"} Jul 10 18:43:49.640558 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:49.640523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9867dcd-5lpgn" event={"ID":"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa","Type":"ContainerStarted","Data":"f0cac12036334cc675c54d2ead5f1637e78f7fb9a286a46131102382784a3b01"} Jul 10 18:43:49.665381 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:49.665321 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9867dcd-5lpgn" podStartSLOduration=1.665304253 podStartE2EDuration="1.665304253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:43:49.663670717 +0000 UTC m=+216.835823616" watchObservedRunningTime="2026-07-10 18:43:49.665304253 +0000 UTC m=+216.837457138" Jul 10 18:43:59.020795 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:59.020758 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:59.021356 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:59.020811 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:59.025800 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:59.025776 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:59.679871 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:59.679844 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:43:59.724566 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:43:59.724535 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:44:24.745878 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:24.745809 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-744bf8476-rmf7n" podUID="3f129876-34be-4b1e-891d-e794f04bc3cb" containerName="console" containerID="cri-o://55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372" gracePeriod=15 Jul 10 18:44:24.990866 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:24.990841 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:44:25.009965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.009860 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.009965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.009934 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.009965 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.009957 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.010257 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.009985 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.010257 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010054 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.010480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010440 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:25.010480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010464 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config" (OuterVolumeSpecName: "console-config") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:25.010603 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010478 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:25.010884 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010792 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4w6k\" (UniqueName: \"kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.010884 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010871 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config\") pod \"3f129876-34be-4b1e-891d-e794f04bc3cb\" (UID: \"3f129876-34be-4b1e-891d-e794f04bc3cb\") " Jul 10 18:44:25.011063 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.010912 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:44:25.011172 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.011114 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-service-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.011172 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.011130 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.011172 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.011142 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-oauth-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.011172 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.011155 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f129876-34be-4b1e-891d-e794f04bc3cb-console-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.012679 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.012652 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:44:25.013286 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.013263 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:44:25.013391 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.013280 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k" (OuterVolumeSpecName: "kube-api-access-c4w6k") pod "3f129876-34be-4b1e-891d-e794f04bc3cb" (UID: "3f129876-34be-4b1e-891d-e794f04bc3cb"). InnerVolumeSpecName "kube-api-access-c4w6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:44:25.111902 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.111859 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4w6k\" (UniqueName: \"kubernetes.io/projected/3f129876-34be-4b1e-891d-e794f04bc3cb-kube-api-access-c4w6k\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.111902 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.111894 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-oauth-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.111902 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.111902 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f129876-34be-4b1e-891d-e794f04bc3cb-console-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:44:25.768140 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.768106 2563 generic.go:356] "Generic (PLEG): container finished" podID="3f129876-34be-4b1e-891d-e794f04bc3cb" containerID="55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372" exitCode=0 Jul 10 18:44:25.768569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.768148 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744bf8476-rmf7n" Jul 10 18:44:25.768569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.768180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744bf8476-rmf7n" event={"ID":"3f129876-34be-4b1e-891d-e794f04bc3cb","Type":"ContainerDied","Data":"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372"} Jul 10 18:44:25.768569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.768240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744bf8476-rmf7n" event={"ID":"3f129876-34be-4b1e-891d-e794f04bc3cb","Type":"ContainerDied","Data":"1997392d0f63e805bb2330df47bdf257ff858b129e18d1a000a3a69605a5ecc2"} Jul 10 18:44:25.768569 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.768260 2563 scope.go:117] "RemoveContainer" containerID="55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372" Jul 10 18:44:25.776397 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.776381 2563 scope.go:117] "RemoveContainer" containerID="55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372" Jul 10 18:44:25.776698 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:44:25.776680 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372\": container with ID starting with 55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372 not found: ID does not exist" containerID="55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372" Jul 10 18:44:25.776753 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.776708 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372"} err="failed to get container status \"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372\": rpc error: code = NotFound desc = could not find container \"55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372\": container with ID starting with 55f37247749d8157a63277f92fd23fb4859c2986dd21d26769a60e274be9c372 not found: ID does not exist" Jul 10 18:44:25.784166 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.784139 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:44:25.786120 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:25.786078 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-744bf8476-rmf7n"] Jul 10 18:44:27.708893 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:44:27.708860 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f129876-34be-4b1e-891d-e794f04bc3cb" path="/var/lib/kubelet/pods/3f129876-34be-4b1e-891d-e794f04bc3cb/volumes" Jul 10 18:45:13.209073 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:13.209045 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:45:13.213234 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:13.213204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:45:13.213843 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:13.213823 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 18:45:33.216469 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.216436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5"] Jul 10 18:45:33.218770 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.216705 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f129876-34be-4b1e-891d-e794f04bc3cb" containerName="console" Jul 10 18:45:33.218770 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.216715 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f129876-34be-4b1e-891d-e794f04bc3cb" containerName="console" Jul 10 18:45:33.218770 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.216759 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f129876-34be-4b1e-891d-e794f04bc3cb" containerName="console" Jul 10 18:45:33.219614 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.219596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.222235 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.222216 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 18:45:33.222343 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.222234 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 18:45:33.223260 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.223239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w5lg2\"" Jul 10 18:45:33.229078 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.229049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5"] Jul 10 18:45:33.234168 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.234129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.234322 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.234175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.234322 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.234294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mxd\" (UniqueName: \"kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.335272 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.335228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.335454 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.335280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.335454 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.335316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mxd\" (UniqueName: \"kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.335698 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.335672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.335764 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.335749 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.344656 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.344615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mxd\" (UniqueName: \"kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.530107 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.529992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:33.663943 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.663910 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5"] Jul 10 18:45:33.666719 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:45:33.666689 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a672fb_5e3b_4e61_94fd_75cc8ea92625.slice/crio-1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c WatchSource:0}: Error finding container 1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c: Status 404 returned error can't find the container with id 1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c Jul 10 18:45:33.668595 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:33.668577 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:45:34.007345 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:34.007308 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerStarted","Data":"1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c"} Jul 10 18:45:40.032880 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:40.032837 2563 generic.go:356] "Generic (PLEG): container finished" podID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerID="9358f8fa0707df04af04599ed925cb8a6a61b1a3ce7849f035985b54a46e5a64" exitCode=0 Jul 10 18:45:40.033389 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:40.032900 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerDied","Data":"9358f8fa0707df04af04599ed925cb8a6a61b1a3ce7849f035985b54a46e5a64"} Jul 10 18:45:42.042887 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:42.042860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerStarted","Data":"6ecfab5d2fe5efbb4a6852ee48f53b12e9b03314c7131c864a99bf22249658b9"} Jul 10 18:45:43.048367 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:43.048333 2563 generic.go:356] "Generic (PLEG): container finished" podID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerID="6ecfab5d2fe5efbb4a6852ee48f53b12e9b03314c7131c864a99bf22249658b9" exitCode=0 Jul 10 18:45:43.048770 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:43.048374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerDied","Data":"6ecfab5d2fe5efbb4a6852ee48f53b12e9b03314c7131c864a99bf22249658b9"} Jul 10 18:45:50.079316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:50.079273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerStarted","Data":"ccd6579544e0d06cddb18902e0bcd50fc11636cd57f4f128d03fbd5d249a8bb1"} Jul 10 18:45:50.099631 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:50.099570 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" podStartSLOduration=2.6129048040000002 podStartE2EDuration="17.099553308s" totalImagesPullingTime="14.486648504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:45:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:45:50.098037536 +0000 UTC m=+337.270190435" watchObservedRunningTime="2026-07-10 18:45:50.099553308 +0000 UTC m=+337.271706194" Jul 10 18:45:51.085191 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:51.085157 2563 generic.go:356] "Generic (PLEG): container finished" podID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerID="ccd6579544e0d06cddb18902e0bcd50fc11636cd57f4f128d03fbd5d249a8bb1" exitCode=0 Jul 10 18:45:51.085570 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:51.085249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerDied","Data":"ccd6579544e0d06cddb18902e0bcd50fc11636cd57f4f128d03fbd5d249a8bb1"} Jul 10 18:45:52.214771 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.214739 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:52.307984 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.307946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4mxd\" (UniqueName: \"kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd\") pod \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " Jul 10 18:45:52.308203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.308022 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util\") pod \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " Jul 10 18:45:52.308203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.308059 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle\") pod \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\" (UID: \"47a672fb-5e3b-4e61-94fd-75cc8ea92625\") " Jul 10 18:45:52.308881 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.308852 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle" (OuterVolumeSpecName: "bundle") pod "47a672fb-5e3b-4e61-94fd-75cc8ea92625" (UID: "47a672fb-5e3b-4e61-94fd-75cc8ea92625"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:45:52.310285 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.310250 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd" (OuterVolumeSpecName: "kube-api-access-l4mxd") pod "47a672fb-5e3b-4e61-94fd-75cc8ea92625" (UID: "47a672fb-5e3b-4e61-94fd-75cc8ea92625"). InnerVolumeSpecName "kube-api-access-l4mxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:45:52.312524 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.312498 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util" (OuterVolumeSpecName: "util") pod "47a672fb-5e3b-4e61-94fd-75cc8ea92625" (UID: "47a672fb-5e3b-4e61-94fd-75cc8ea92625"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:45:52.409424 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.409334 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4mxd\" (UniqueName: \"kubernetes.io/projected/47a672fb-5e3b-4e61-94fd-75cc8ea92625-kube-api-access-l4mxd\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:45:52.409424 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.409363 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:45:52.409424 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:52.409371 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47a672fb-5e3b-4e61-94fd-75cc8ea92625-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:45:53.095224 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:53.095189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" event={"ID":"47a672fb-5e3b-4e61-94fd-75cc8ea92625","Type":"ContainerDied","Data":"1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c"} Jul 10 18:45:53.095405 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:53.095243 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a8261072bc36eb2aeb2a75838465e8d8bc6a6b1f8269ccc104b52ccd6513a1c" Jul 10 18:45:53.095405 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:53.095201 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589bllt5" Jul 10 18:45:55.631955 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.631923 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx"] Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632232 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="util" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632245 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="util" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632258 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="pull" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632266 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="pull" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632281 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="extract" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632288 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="extract" Jul 10 18:45:55.632382 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.632341 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a672fb-5e3b-4e61-94fd-75cc8ea92625" containerName="extract" Jul 10 18:45:55.654769 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.654733 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx"] Jul 10 18:45:55.654933 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.654835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.657824 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.657794 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 10 18:45:55.658369 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.658350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-fbxh6\"" Jul 10 18:45:55.658501 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.658439 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 10 18:45:55.658575 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.658562 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 10 18:45:55.738917 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.738877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c93464a2-a1c4-4287-a000-04fd460668ae-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.739124 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.738935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgm5\" (UniqueName: \"kubernetes.io/projected/c93464a2-a1c4-4287-a000-04fd460668ae-kube-api-access-5wgm5\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.839741 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.839705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c93464a2-a1c4-4287-a000-04fd460668ae-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.839948 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.839760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgm5\" (UniqueName: \"kubernetes.io/projected/c93464a2-a1c4-4287-a000-04fd460668ae-kube-api-access-5wgm5\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.842144 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.842119 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c93464a2-a1c4-4287-a000-04fd460668ae-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.848632 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.848596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgm5\" (UniqueName: \"kubernetes.io/projected/c93464a2-a1c4-4287-a000-04fd460668ae-kube-api-access-5wgm5\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx\" (UID: \"c93464a2-a1c4-4287-a000-04fd460668ae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:55.966147 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:55.966071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:45:56.131074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:56.131048 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx"] Jul 10 18:45:56.133533 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:45:56.133500 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93464a2_a1c4_4287_a000_04fd460668ae.slice/crio-cd0789e2f1ceba7a19aa0912c27c5d0872ef9c92eacf52beea9188be6a794d63 WatchSource:0}: Error finding container cd0789e2f1ceba7a19aa0912c27c5d0872ef9c92eacf52beea9188be6a794d63: Status 404 returned error can't find the container with id cd0789e2f1ceba7a19aa0912c27c5d0872ef9c92eacf52beea9188be6a794d63 Jul 10 18:45:57.114036 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:45:57.114000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" event={"ID":"c93464a2-a1c4-4287-a000-04fd460668ae","Type":"ContainerStarted","Data":"cd0789e2f1ceba7a19aa0912c27c5d0872ef9c92eacf52beea9188be6a794d63"} Jul 10 18:46:00.128830 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.128787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" event={"ID":"c93464a2-a1c4-4287-a000-04fd460668ae","Type":"ContainerStarted","Data":"4a78f395d3580b4a1ddd06435e1830f65452550f4366cbc014b93ff70e02331c"} Jul 10 18:46:00.129354 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.128943 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:46:00.155517 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.155452 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" podStartSLOduration=1.9997622659999998 podStartE2EDuration="5.155427984s" totalImagesPullingTime="3.155665718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:46:00.153734914 +0000 UTC m=+347.325887830" watchObservedRunningTime="2026-07-10 18:46:00.155427984 +0000 UTC m=+347.327581182" Jul 10 18:46:00.182012 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.181978 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-2fvwx"] Jul 10 18:46:00.207899 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.207865 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-2fvwx"] Jul 10 18:46:00.208105 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.207966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.210560 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.210536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-dqhmh\"" Jul 10 18:46:00.210715 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.210579 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 10 18:46:00.210836 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.210823 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 10 18:46:00.277131 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.277039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-cabundle0\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.277292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.277219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.277292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.277282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfhsx\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-kube-api-access-mfhsx\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.378728 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.378685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.378744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfhsx\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-kube-api-access-mfhsx\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.378795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-cabundle0\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:00.378846 2563 secret.go:281] references non-existent secret key: ca.crt Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:00.378867 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:00.378876 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-2fvwx: references non-existent secret key: ca.crt Jul 10 18:46:00.378947 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:00.378948 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates podName:3b52547e-43c2-4dd7-a2ba-49f84771ffa9 nodeName:}" failed. No retries permitted until 2026-07-10 18:46:00.878929709 +0000 UTC m=+348.051082590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates") pod "keda-operator-68bff59c-2fvwx" (UID: "3b52547e-43c2-4dd7-a2ba-49f84771ffa9") : references non-existent secret key: ca.crt Jul 10 18:46:00.379540 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.379517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-cabundle0\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.397003 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.396967 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfhsx\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-kube-api-access-mfhsx\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.599136 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.599084 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-trf5n"] Jul 10 18:46:00.612295 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.612257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.614160 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.614133 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-trf5n"] Jul 10 18:46:00.615252 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.615225 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 10 18:46:00.681131 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.681066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/11d77e00-484f-4f78-ae2b-272838f2cf45-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.681322 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.681182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-certificates\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.681322 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.681255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvdl\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-kube-api-access-6wvdl\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.782532 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.782491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvdl\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-kube-api-access-6wvdl\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.782735 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.782581 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/11d77e00-484f-4f78-ae2b-272838f2cf45-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.782735 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.782622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-certificates\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.783102 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.783019 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/11d77e00-484f-4f78-ae2b-272838f2cf45-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.785222 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.785201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-certificates\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.799200 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.799167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvdl\" (UniqueName: \"kubernetes.io/projected/11d77e00-484f-4f78-ae2b-272838f2cf45-kube-api-access-6wvdl\") pod \"keda-metrics-apiserver-559f75f947-trf5n\" (UID: \"11d77e00-484f-4f78-ae2b-272838f2cf45\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.855563 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.855526 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dbhq"] Jul 10 18:46:00.870639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.870611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:00.873595 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.873561 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dbhq"] Jul 10 18:46:00.874030 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.874008 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 10 18:46:00.883443 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.883415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.885867 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.885845 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3b52547e-43c2-4dd7-a2ba-49f84771ffa9-certificates\") pod \"keda-operator-68bff59c-2fvwx\" (UID: \"3b52547e-43c2-4dd7-a2ba-49f84771ffa9\") " pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:00.924338 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.924300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:00.984400 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.984367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vdm\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-kube-api-access-78vdm\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:00.984599 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:00.984513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.075711 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.075685 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-trf5n"] Jul 10 18:46:01.078106 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:46:01.078064 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d77e00_484f_4f78_ae2b_272838f2cf45.slice/crio-76c0738a225bac839c31ad61ee1ea39ac223baf764e0a22724e2ca96da09a3d8 WatchSource:0}: Error finding container 76c0738a225bac839c31ad61ee1ea39ac223baf764e0a22724e2ca96da09a3d8: Status 404 returned error can't find the container with id 76c0738a225bac839c31ad61ee1ea39ac223baf764e0a22724e2ca96da09a3d8 Jul 10 18:46:01.085239 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.085207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.085377 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.085264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vdm\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-kube-api-access-78vdm\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.085416 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:01.085392 2563 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 10 18:46:01.085450 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:01.085422 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-8dbhq: secret "keda-admission-webhooks-certs" not found Jul 10 18:46:01.085504 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:46:01.085492 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates podName:511e175e-83e3-46c4-8996-a28af31c7c08 nodeName:}" failed. No retries permitted until 2026-07-10 18:46:01.585469023 +0000 UTC m=+348.757621903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates") pod "keda-admission-5fbd5c4644-8dbhq" (UID: "511e175e-83e3-46c4-8996-a28af31c7c08") : secret "keda-admission-webhooks-certs" not found Jul 10 18:46:01.094164 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.094135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vdm\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-kube-api-access-78vdm\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.120800 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.120767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:01.134136 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.134078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" event={"ID":"11d77e00-484f-4f78-ae2b-272838f2cf45","Type":"ContainerStarted","Data":"76c0738a225bac839c31ad61ee1ea39ac223baf764e0a22724e2ca96da09a3d8"} Jul 10 18:46:01.291852 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.291810 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-2fvwx"] Jul 10 18:46:01.294790 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:46:01.294761 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b52547e_43c2_4dd7_a2ba_49f84771ffa9.slice/crio-d3cbbf22afae97aed53e20e89f165f968c0b0347705552e6bac8c18fe4fc463a WatchSource:0}: Error finding container d3cbbf22afae97aed53e20e89f165f968c0b0347705552e6bac8c18fe4fc463a: Status 404 returned error can't find the container with id d3cbbf22afae97aed53e20e89f165f968c0b0347705552e6bac8c18fe4fc463a Jul 10 18:46:01.589932 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.589836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.592360 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.592333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/511e175e-83e3-46c4-8996-a28af31c7c08-certificates\") pod \"keda-admission-5fbd5c4644-8dbhq\" (UID: \"511e175e-83e3-46c4-8996-a28af31c7c08\") " pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.783414 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.783373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:01.955316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:01.955284 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-8dbhq"] Jul 10 18:46:01.958862 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:46:01.958818 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511e175e_83e3_46c4_8996_a28af31c7c08.slice/crio-2e912a0b6ab7fcfef21e6a2afee739ef337b56727967e0f7eaa3687e9b627dc6 WatchSource:0}: Error finding container 2e912a0b6ab7fcfef21e6a2afee739ef337b56727967e0f7eaa3687e9b627dc6: Status 404 returned error can't find the container with id 2e912a0b6ab7fcfef21e6a2afee739ef337b56727967e0f7eaa3687e9b627dc6 Jul 10 18:46:02.140177 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:02.140066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" event={"ID":"511e175e-83e3-46c4-8996-a28af31c7c08","Type":"ContainerStarted","Data":"2e912a0b6ab7fcfef21e6a2afee739ef337b56727967e0f7eaa3687e9b627dc6"} Jul 10 18:46:02.141596 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:02.141558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-2fvwx" event={"ID":"3b52547e-43c2-4dd7-a2ba-49f84771ffa9","Type":"ContainerStarted","Data":"d3cbbf22afae97aed53e20e89f165f968c0b0347705552e6bac8c18fe4fc463a"} Jul 10 18:46:06.162015 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.161974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" event={"ID":"11d77e00-484f-4f78-ae2b-272838f2cf45","Type":"ContainerStarted","Data":"e6e9e433df5e83455132f9e50e33d3568a96c6d6f970276e069939ae9565b9da"} Jul 10 18:46:06.162483 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.162065 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:06.163603 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.163578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" event={"ID":"511e175e-83e3-46c4-8996-a28af31c7c08","Type":"ContainerStarted","Data":"5309e87b10046cb0fd8d0f90661bcfee49eb3805f34f44b4edec86a34c4a9e92"} Jul 10 18:46:06.163701 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.163638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:46:06.165349 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.165319 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-2fvwx" event={"ID":"3b52547e-43c2-4dd7-a2ba-49f84771ffa9","Type":"ContainerStarted","Data":"ed281e00f7c6e432bf93eb7150dbd4427b65984fd072b7d263b514c95d0c2362"} Jul 10 18:46:06.165537 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.165468 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:06.178467 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.178400 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" podStartSLOduration=1.942923286 podStartE2EDuration="6.178379107s" totalImagesPullingTime="4.235455821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:46:06.178324906 +0000 UTC m=+353.350477795" watchObservedRunningTime="2026-07-10 18:46:06.178379107 +0000 UTC m=+353.350531991" Jul 10 18:46:06.194574 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.194520 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" podStartSLOduration=2.845536042 podStartE2EDuration="6.194502636s" totalImagesPullingTime="3.348966594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:46:06.193243156 +0000 UTC m=+353.365396065" watchObservedRunningTime="2026-07-10 18:46:06.194502636 +0000 UTC m=+353.366655520" Jul 10 18:46:06.209997 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:06.209930 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-2fvwx" podStartSLOduration=2.183997695 podStartE2EDuration="6.209907705s" totalImagesPullingTime="4.02591001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:46:06.209401727 +0000 UTC m=+353.381554614" watchObservedRunningTime="2026-07-10 18:46:06.209907705 +0000 UTC m=+353.382060591" Jul 10 18:46:17.174628 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:17.174599 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-trf5n" Jul 10 18:46:21.136688 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:21.136654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-dq2kx" Jul 10 18:46:27.172587 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:27.172549 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-2fvwx" Jul 10 18:46:27.173100 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:46:27.173051 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-8dbhq" Jul 10 18:47:05.837014 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.836974 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:05.839373 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.839353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:05.841854 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.841832 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 10 18:47:05.842959 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.842942 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-bptb7\"" Jul 10 18:47:05.842959 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.842950 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 10 18:47:05.843231 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.843216 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 10 18:47:05.851638 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.851609 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-vk4xj"] Jul 10 18:47:05.853955 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.853931 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:05.854081 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.854047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:05.856461 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.856443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 10 18:47:05.856581 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.856475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-mlldx\"" Jul 10 18:47:05.866419 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.866390 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-vk4xj"] Jul 10 18:47:05.918021 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.917986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:05.918021 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:05.918026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7ktq\" (UniqueName: \"kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.019225 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.019183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkd7p\" (UniqueName: \"kubernetes.io/projected/2bf7168c-053d-4351-91cc-af3e3aa36505-kube-api-access-jkd7p\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.019429 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.019288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.019429 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.019320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7ktq\" (UniqueName: \"kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.019429 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.019359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bf7168c-053d-4351-91cc-af3e3aa36505-cert\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.021807 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.021786 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.029557 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.029519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7ktq\" (UniqueName: \"kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq\") pod \"kserve-controller-manager-659578d74d-gl4cp\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.120779 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.120682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bf7168c-053d-4351-91cc-af3e3aa36505-cert\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.120779 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.120751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkd7p\" (UniqueName: \"kubernetes.io/projected/2bf7168c-053d-4351-91cc-af3e3aa36505-kube-api-access-jkd7p\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.123109 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.123062 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bf7168c-053d-4351-91cc-af3e3aa36505-cert\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.130480 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.130456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkd7p\" (UniqueName: \"kubernetes.io/projected/2bf7168c-053d-4351-91cc-af3e3aa36505-kube-api-access-jkd7p\") pod \"llmisvc-controller-manager-67d95fdc48-vk4xj\" (UID: \"2bf7168c-053d-4351-91cc-af3e3aa36505\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.149630 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.149598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:06.166840 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.166808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:06.296738 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.296705 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:06.299061 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:47:06.299024 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c906385_17dc_41af_bafe_3483b5d47178.slice/crio-edf04f5265a046aa79020ebc5a19c004186f094e6de02e1f1dce1f330f3e6391 WatchSource:0}: Error finding container edf04f5265a046aa79020ebc5a19c004186f094e6de02e1f1dce1f330f3e6391: Status 404 returned error can't find the container with id edf04f5265a046aa79020ebc5a19c004186f094e6de02e1f1dce1f330f3e6391 Jul 10 18:47:06.322846 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.322814 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-vk4xj"] Jul 10 18:47:06.324873 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:47:06.324840 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bf7168c_053d_4351_91cc_af3e3aa36505.slice/crio-3b775ef2827e0131d2f316d4c592a934ff5bbf88279a5458ffaf16511c1df47f WatchSource:0}: Error finding container 3b775ef2827e0131d2f316d4c592a934ff5bbf88279a5458ffaf16511c1df47f: Status 404 returned error can't find the container with id 3b775ef2827e0131d2f316d4c592a934ff5bbf88279a5458ffaf16511c1df47f Jul 10 18:47:06.405339 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.405229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"3b775ef2827e0131d2f316d4c592a934ff5bbf88279a5458ffaf16511c1df47f"} Jul 10 18:47:06.406318 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:06.406294 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" event={"ID":"2c906385-17dc-41af-bafe-3483b5d47178","Type":"ContainerStarted","Data":"edf04f5265a046aa79020ebc5a19c004186f094e6de02e1f1dce1f330f3e6391"} Jul 10 18:47:10.429661 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.429620 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" event={"ID":"2c906385-17dc-41af-bafe-3483b5d47178","Type":"ContainerStarted","Data":"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b"} Jul 10 18:47:10.430171 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.429737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:10.431304 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.431280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"7a0ec50ab771fe2effad4d7769c87bf9097171b49324f74898014db3b5f932b6"} Jul 10 18:47:10.431423 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.431407 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:10.447575 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.447502 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" podStartSLOduration=2.352531921 podStartE2EDuration="5.447486229s" totalImagesPullingTime="3.094954308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:47:10.446869405 +0000 UTC m=+417.619022297" watchObservedRunningTime="2026-07-10 18:47:10.447486229 +0000 UTC m=+417.619639114" Jul 10 18:47:10.465524 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:10.465468 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podStartSLOduration=2.395795294 podStartE2EDuration="5.465449986s" totalImagesPullingTime="3.069654692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:47:10.464605866 +0000 UTC m=+417.636758751" watchObservedRunningTime="2026-07-10 18:47:10.465449986 +0000 UTC m=+417.637602871" Jul 10 18:47:41.438010 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:41.437916 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:47:41.441184 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:41.441160 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:42.711782 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.711744 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:42.712238 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.711916 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" podUID="2c906385-17dc-41af-bafe-3483b5d47178" containerName="manager" containerID="cri-o://d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b" gracePeriod=10 Jul 10 18:47:42.740196 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.740164 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-659578d74d-dr528"] Jul 10 18:47:42.744796 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.744773 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.753837 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.753806 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-dr528"] Jul 10 18:47:42.820775 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.820737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb9xn\" (UniqueName: \"kubernetes.io/projected/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-kube-api-access-vb9xn\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.821076 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.821047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-cert\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.922659 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.922624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb9xn\" (UniqueName: \"kubernetes.io/projected/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-kube-api-access-vb9xn\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.922790 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.922694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-cert\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.925163 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.925142 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-cert\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:42.932322 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:42.932297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb9xn\" (UniqueName: \"kubernetes.io/projected/9d26d02e-8af8-4bba-9a5d-f0d100e497e4-kube-api-access-vb9xn\") pod \"kserve-controller-manager-659578d74d-dr528\" (UID: \"9d26d02e-8af8-4bba-9a5d-f0d100e497e4\") " pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:43.018103 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.018064 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:43.097808 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.097772 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:43.123636 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.123613 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7ktq\" (UniqueName: \"kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq\") pod \"2c906385-17dc-41af-bafe-3483b5d47178\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " Jul 10 18:47:43.123732 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.123721 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert\") pod \"2c906385-17dc-41af-bafe-3483b5d47178\" (UID: \"2c906385-17dc-41af-bafe-3483b5d47178\") " Jul 10 18:47:43.125866 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.125837 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert" (OuterVolumeSpecName: "cert") pod "2c906385-17dc-41af-bafe-3483b5d47178" (UID: "2c906385-17dc-41af-bafe-3483b5d47178"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:47:43.125979 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.125880 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq" (OuterVolumeSpecName: "kube-api-access-d7ktq") pod "2c906385-17dc-41af-bafe-3483b5d47178" (UID: "2c906385-17dc-41af-bafe-3483b5d47178"). InnerVolumeSpecName "kube-api-access-d7ktq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:47:43.226266 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.225175 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7ktq\" (UniqueName: \"kubernetes.io/projected/2c906385-17dc-41af-bafe-3483b5d47178-kube-api-access-d7ktq\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:47:43.226266 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.225224 2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c906385-17dc-41af-bafe-3483b5d47178-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:47:43.247572 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.247489 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-dr528"] Jul 10 18:47:43.250952 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:47:43.250924 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d26d02e_8af8_4bba_9a5d_f0d100e497e4.slice/crio-1117cc77397c2d92f2353a87eaad9d8c15b6b6340e8bbd8d706aae788fa88362 WatchSource:0}: Error finding container 1117cc77397c2d92f2353a87eaad9d8c15b6b6340e8bbd8d706aae788fa88362: Status 404 returned error can't find the container with id 1117cc77397c2d92f2353a87eaad9d8c15b6b6340e8bbd8d706aae788fa88362 Jul 10 18:47:43.574182 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.574076 2563 generic.go:356] "Generic (PLEG): container finished" podID="2c906385-17dc-41af-bafe-3483b5d47178" containerID="d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b" exitCode=0 Jul 10 18:47:43.574182 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.574168 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" Jul 10 18:47:43.574406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.574159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" event={"ID":"2c906385-17dc-41af-bafe-3483b5d47178","Type":"ContainerDied","Data":"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b"} Jul 10 18:47:43.574406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.574291 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-gl4cp" event={"ID":"2c906385-17dc-41af-bafe-3483b5d47178","Type":"ContainerDied","Data":"edf04f5265a046aa79020ebc5a19c004186f094e6de02e1f1dce1f330f3e6391"} Jul 10 18:47:43.574406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.574324 2563 scope.go:117] "RemoveContainer" containerID="d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b" Jul 10 18:47:43.575521 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.575498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-dr528" event={"ID":"9d26d02e-8af8-4bba-9a5d-f0d100e497e4","Type":"ContainerStarted","Data":"1117cc77397c2d92f2353a87eaad9d8c15b6b6340e8bbd8d706aae788fa88362"} Jul 10 18:47:43.583199 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.583182 2563 scope.go:117] "RemoveContainer" containerID="d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b" Jul 10 18:47:43.583521 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:47:43.583498 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b\": container with ID starting with d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b not found: ID does not exist" containerID="d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b" Jul 10 18:47:43.583584 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.583530 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b"} err="failed to get container status \"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b\": rpc error: code = NotFound desc = could not find container \"d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b\": container with ID starting with d172cf23bb77c1076d1e258b59ea341f47d0fb69667c7d857a42afba64a32f1b not found: ID does not exist" Jul 10 18:47:43.596775 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.596745 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:43.602550 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.602522 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-659578d74d-gl4cp"] Jul 10 18:47:43.709909 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:43.709873 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c906385-17dc-41af-bafe-3483b5d47178" path="/var/lib/kubelet/pods/2c906385-17dc-41af-bafe-3483b5d47178/volumes" Jul 10 18:47:44.582462 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:44.582426 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-659578d74d-dr528" event={"ID":"9d26d02e-8af8-4bba-9a5d-f0d100e497e4","Type":"ContainerStarted","Data":"97f808ce610978802b94c5739a091833513ab1f8c4258fa7d48bf57209ec9771"} Jul 10 18:47:44.582956 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:44.582565 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:47:44.599911 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:44.599859 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-659578d74d-dr528" podStartSLOduration=2.028812197 podStartE2EDuration="2.599812479s" totalImagesPullingTime="571.000282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:47:44.59855442 +0000 UTC m=+451.770707308" watchObservedRunningTime="2026-07-10 18:47:44.599812479 +0000 UTC m=+451.771965365" Jul 10 18:47:59.107858 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.107827 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b5bd57bd-s8gjz"] Jul 10 18:47:59.108315 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.108164 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c906385-17dc-41af-bafe-3483b5d47178" containerName="manager" Jul 10 18:47:59.108315 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.108179 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c906385-17dc-41af-bafe-3483b5d47178" containerName="manager" Jul 10 18:47:59.108315 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.108241 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c906385-17dc-41af-bafe-3483b5d47178" containerName="manager" Jul 10 18:47:59.110269 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.110253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.124316 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.124287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b5bd57bd-s8gjz"] Jul 10 18:47:59.261963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.261928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-trusted-ca-bundle\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.261963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.261967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.262205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.262040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-oauth-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.262205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.262068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-oauth-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.262205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.262108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lct2v\" (UniqueName: \"kubernetes.io/projected/231633be-268a-453f-835a-76d4cf00e45c-kube-api-access-lct2v\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.262205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.262134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-console-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.262205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.262186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-service-ca\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363467 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-trusted-ca-bundle\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363467 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-oauth-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-oauth-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2v\" (UniqueName: \"kubernetes.io/projected/231633be-268a-453f-835a-76d4cf00e45c-kube-api-access-lct2v\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-console-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.363643 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.363640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-service-ca\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.364334 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.364302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-oauth-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.364446 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.364382 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-console-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.364446 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.364414 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-service-ca\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.364536 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.364414 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231633be-268a-453f-835a-76d4cf00e45c-trusted-ca-bundle\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.366013 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.365986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-oauth-config\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.366307 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.366289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231633be-268a-453f-835a-76d4cf00e45c-console-serving-cert\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.372572 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.372541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lct2v\" (UniqueName: \"kubernetes.io/projected/231633be-268a-453f-835a-76d4cf00e45c-kube-api-access-lct2v\") pod \"console-56b5bd57bd-s8gjz\" (UID: \"231633be-268a-453f-835a-76d4cf00e45c\") " pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.419772 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.419740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:47:59.554861 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.554791 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b5bd57bd-s8gjz"] Jul 10 18:47:59.557158 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:47:59.557128 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231633be_268a_453f_835a_76d4cf00e45c.slice/crio-64aa86cceb38e5116d75d63315ce3591a9266b63df0cb0f91e754ce7117918bf WatchSource:0}: Error finding container 64aa86cceb38e5116d75d63315ce3591a9266b63df0cb0f91e754ce7117918bf: Status 404 returned error can't find the container with id 64aa86cceb38e5116d75d63315ce3591a9266b63df0cb0f91e754ce7117918bf Jul 10 18:47:59.646886 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.646798 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5bd57bd-s8gjz" event={"ID":"231633be-268a-453f-835a-76d4cf00e45c","Type":"ContainerStarted","Data":"50ecb7eb369b790a0cdd4794baa4b636ca291553654f64105f284e44a8dbdcd3"} Jul 10 18:47:59.646886 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.646849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5bd57bd-s8gjz" event={"ID":"231633be-268a-453f-835a-76d4cf00e45c","Type":"ContainerStarted","Data":"64aa86cceb38e5116d75d63315ce3591a9266b63df0cb0f91e754ce7117918bf"} Jul 10 18:47:59.665840 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:47:59.665779 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b5bd57bd-s8gjz" podStartSLOduration=0.665762093 podStartE2EDuration="665.762093ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:47:59.664309037 +0000 UTC m=+466.836461955" watchObservedRunningTime="2026-07-10 18:47:59.665762093 +0000 UTC m=+466.837914980" Jul 10 18:48:09.419994 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:09.419946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:48:09.420432 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:09.420023 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:48:09.424889 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:09.424866 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:48:09.700662 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:09.700576 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b5bd57bd-s8gjz" Jul 10 18:48:09.748726 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:09.748691 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:48:15.590809 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:15.590778 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-659578d74d-dr528" Jul 10 18:48:16.596213 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.596162 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-gxbh7"] Jul 10 18:48:16.600687 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.600667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.603972 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.603952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-ktwd6\"" Jul 10 18:48:16.603972 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.603968 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 10 18:48:16.610163 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.610140 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-gxbh7"] Jul 10 18:48:16.615645 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.615621 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pflfk"] Jul 10 18:48:16.618792 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.618774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.621300 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.621268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 10 18:48:16.621490 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.621476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-sbkz5\"" Jul 10 18:48:16.631317 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.631287 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pflfk"] Jul 10 18:48:16.695011 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.694977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfaab2b-482c-4626-941a-c15683f17a1b-tls-certs\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.695220 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.695030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e68ae39-1370-4b57-85bf-9141e69e4a87-cert\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.695220 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.695050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbvr\" (UniqueName: \"kubernetes.io/projected/0e68ae39-1370-4b57-85bf-9141e69e4a87-kube-api-access-5lbvr\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.695220 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.695129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85tq\" (UniqueName: \"kubernetes.io/projected/cbfaab2b-482c-4626-941a-c15683f17a1b-kube-api-access-m85tq\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.795493 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.795454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e68ae39-1370-4b57-85bf-9141e69e4a87-cert\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.795493 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.795497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbvr\" (UniqueName: \"kubernetes.io/projected/0e68ae39-1370-4b57-85bf-9141e69e4a87-kube-api-access-5lbvr\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.795729 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.795525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m85tq\" (UniqueName: \"kubernetes.io/projected/cbfaab2b-482c-4626-941a-c15683f17a1b-kube-api-access-m85tq\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.795729 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.795565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfaab2b-482c-4626-941a-c15683f17a1b-tls-certs\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.798038 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.798008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfaab2b-482c-4626-941a-c15683f17a1b-tls-certs\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.798180 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.798084 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e68ae39-1370-4b57-85bf-9141e69e4a87-cert\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.806987 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.806963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85tq\" (UniqueName: \"kubernetes.io/projected/cbfaab2b-482c-4626-941a-c15683f17a1b-kube-api-access-m85tq\") pod \"model-serving-api-fd65d7d6-gxbh7\" (UID: \"cbfaab2b-482c-4626-941a-c15683f17a1b\") " pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.808925 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.808901 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbvr\" (UniqueName: \"kubernetes.io/projected/0e68ae39-1370-4b57-85bf-9141e69e4a87-kube-api-access-5lbvr\") pod \"odh-model-controller-84b54b7f97-pflfk\" (UID: \"0e68ae39-1370-4b57-85bf-9141e69e4a87\") " pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:16.911150 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.911044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:16.932836 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:16.932796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:17.056384 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:17.056344 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-gxbh7"] Jul 10 18:48:17.058712 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:48:17.058683 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfaab2b_482c_4626_941a_c15683f17a1b.slice/crio-e1211046c64da38ce05672f451a6f970a6a3a2208d52ec5ef821439a71f31d69 WatchSource:0}: Error finding container e1211046c64da38ce05672f451a6f970a6a3a2208d52ec5ef821439a71f31d69: Status 404 returned error can't find the container with id e1211046c64da38ce05672f451a6f970a6a3a2208d52ec5ef821439a71f31d69 Jul 10 18:48:17.077752 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:17.077726 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pflfk"] Jul 10 18:48:17.079326 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:48:17.079304 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e68ae39_1370_4b57_85bf_9141e69e4a87.slice/crio-11ad26c292ee4582e3b600401bf07b83b37ff72c69361778cb1443ead836af55 WatchSource:0}: Error finding container 11ad26c292ee4582e3b600401bf07b83b37ff72c69361778cb1443ead836af55: Status 404 returned error can't find the container with id 11ad26c292ee4582e3b600401bf07b83b37ff72c69361778cb1443ead836af55 Jul 10 18:48:17.738410 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:17.738372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-pflfk" event={"ID":"0e68ae39-1370-4b57-85bf-9141e69e4a87","Type":"ContainerStarted","Data":"11ad26c292ee4582e3b600401bf07b83b37ff72c69361778cb1443ead836af55"} Jul 10 18:48:17.740963 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:17.740888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-gxbh7" event={"ID":"cbfaab2b-482c-4626-941a-c15683f17a1b","Type":"ContainerStarted","Data":"e1211046c64da38ce05672f451a6f970a6a3a2208d52ec5ef821439a71f31d69"} Jul 10 18:48:20.762854 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:20.762814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-pflfk" event={"ID":"0e68ae39-1370-4b57-85bf-9141e69e4a87","Type":"ContainerStarted","Data":"7cd91804e6b1aa27e28431ae8cf5679aa3057394e8f2d061e96a11c30f689fb0"} Jul 10 18:48:20.763372 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:20.762931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:20.764365 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:20.764344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-gxbh7" event={"ID":"cbfaab2b-482c-4626-941a-c15683f17a1b","Type":"ContainerStarted","Data":"e598f55e0b74a8941bf2410addbcb511ef6d278241b0a65345372c9e3e3f8059"} Jul 10 18:48:20.764490 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:20.764473 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:20.789523 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:20.789472 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-pflfk" podStartSLOduration=1.914198801 podStartE2EDuration="4.789455678s" totalImagesPullingTime="2.875256877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:48:20.786354534 +0000 UTC m=+487.958507448" watchObservedRunningTime="2026-07-10 18:48:20.789455678 +0000 UTC m=+487.961608576" Jul 10 18:48:31.772615 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:31.772585 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-pflfk" Jul 10 18:48:31.774400 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:31.774378 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-gxbh7" Jul 10 18:48:31.792840 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:31.792770 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-gxbh7" podStartSLOduration=12.948054937 podStartE2EDuration="15.792747777s" totalImagesPullingTime="2.84469284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:48:20.816853993 +0000 UTC m=+487.989006908" watchObservedRunningTime="2026-07-10 18:48:31.792747777 +0000 UTC m=+498.964900667" Jul 10 18:48:34.773971 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:34.773922 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d9867dcd-5lpgn" podUID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" containerName="console" containerID="cri-o://e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043" gracePeriod=15 Jul 10 18:48:35.020727 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.020700 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:48:35.155793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155692 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhntj\" (UniqueName: \"kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.155793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155744 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.155793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155787 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.156074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155815 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.156074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155860 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.156074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155910 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.156074 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.155938 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert\") pod \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\" (UID: \"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa\") " Jul 10 18:48:35.156313 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.156260 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:35.156373 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.156322 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config" (OuterVolumeSpecName: "console-config") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:35.156487 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.156391 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:35.156638 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.156609 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:48:35.158129 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.158099 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:48:35.158232 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.158131 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:48:35.158292 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.158225 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj" (OuterVolumeSpecName: "kube-api-access-xhntj") pod "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" (UID: "9a5eafb8-982b-49c8-87d3-9b70ef8b10fa"). InnerVolumeSpecName "kube-api-access-xhntj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:48:35.257005 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.256970 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257005 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.256999 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257005 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.257008 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-oauth-serving-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.257017 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhntj\" (UniqueName: \"kubernetes.io/projected/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-kube-api-access-xhntj\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.257027 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-service-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.257037 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-console-oauth-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.257265 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.257044 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:48:35.830220 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.830187 2563 generic.go:356] "Generic (PLEG): container finished" podID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" containerID="e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043" exitCode=0 Jul 10 18:48:35.830681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.830234 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9867dcd-5lpgn" Jul 10 18:48:35.830681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.830257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9867dcd-5lpgn" event={"ID":"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa","Type":"ContainerDied","Data":"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043"} Jul 10 18:48:35.830681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.830296 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9867dcd-5lpgn" event={"ID":"9a5eafb8-982b-49c8-87d3-9b70ef8b10fa","Type":"ContainerDied","Data":"f0cac12036334cc675c54d2ead5f1637e78f7fb9a286a46131102382784a3b01"} Jul 10 18:48:35.830681 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.830315 2563 scope.go:117] "RemoveContainer" containerID="e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043" Jul 10 18:48:35.838995 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.838976 2563 scope.go:117] "RemoveContainer" containerID="e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043" Jul 10 18:48:35.839321 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:48:35.839299 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043\": container with ID starting with e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043 not found: ID does not exist" containerID="e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043" Jul 10 18:48:35.839381 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.839331 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043"} err="failed to get container status \"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043\": rpc error: code = NotFound desc = could not find container \"e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043\": container with ID starting with e7db941af9bb53fc3df87cb7b9839d13dd73714420ea38a882c3e32129b09043 not found: ID does not exist" Jul 10 18:48:35.846771 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.846744 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:48:35.850590 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:35.850565 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9867dcd-5lpgn"] Jul 10 18:48:37.709269 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:37.709227 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" path="/var/lib/kubelet/pods/9a5eafb8-982b-49c8-87d3-9b70ef8b10fa/volumes" Jul 10 18:48:53.282518 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.282483 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:48:53.282999 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.282814 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" containerName="console" Jul 10 18:48:53.282999 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.282829 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" containerName="console" Jul 10 18:48:53.282999 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.282892 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a5eafb8-982b-49c8-87d3-9b70ef8b10fa" containerName="console" Jul 10 18:48:53.289682 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.289658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.295615 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.295582 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 10 18:48:53.295785 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.295594 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 10 18:48:53.296847 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.296819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 10 18:48:53.296847 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.296826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9w5fm\"" Jul 10 18:48:53.297042 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.296857 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 10 18:48:53.301104 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.301062 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:48:53.420967 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.420928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.421203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.420976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mclkm\" (UniqueName: \"kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.421203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.421118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-graph-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.421203 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.421170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.521609 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.521571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mclkm\" (UniqueName: \"kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.521831 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.521635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"isvc-xgboost-graph-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.521831 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.521655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.521831 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.521704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.522214 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.522191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.522379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.522357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-graph-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.524334 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.524307 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.530813 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.530772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mclkm\" (UniqueName: \"kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm\") pod \"isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.606720 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.606633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:48:53.748801 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.748771 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:48:53.751833 ip-10-0-138-0 kubenswrapper[2563]: W0710 18:48:53.751806 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d301fe9_7c08_450e_b392_c3d9bb9c84ca.slice/crio-1b54f75cc4f26ce63ceefd4c86305d715d31c02be45bb60a58537b4e396de099 WatchSource:0}: Error finding container 1b54f75cc4f26ce63ceefd4c86305d715d31c02be45bb60a58537b4e396de099: Status 404 returned error can't find the container with id 1b54f75cc4f26ce63ceefd4c86305d715d31c02be45bb60a58537b4e396de099 Jul 10 18:48:53.910286 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:53.910194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerStarted","Data":"1b54f75cc4f26ce63ceefd4c86305d715d31c02be45bb60a58537b4e396de099"} Jul 10 18:48:57.930629 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:48:57.930595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerStarted","Data":"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c"} Jul 10 18:49:01.951498 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:01.951457 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerID="d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c" exitCode=0 Jul 10 18:49:01.951898 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:01.951502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerDied","Data":"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c"} Jul 10 18:49:11.002055 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:11.002011 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="7a0ec50ab771fe2effad4d7769c87bf9097171b49324f74898014db3b5f932b6" exitCode=1 Jul 10 18:49:11.002540 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:11.002159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"7a0ec50ab771fe2effad4d7769c87bf9097171b49324f74898014db3b5f932b6"} Jul 10 18:49:11.002540 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:11.002510 2563 scope.go:117] "RemoveContainer" containerID="7a0ec50ab771fe2effad4d7769c87bf9097171b49324f74898014db3b5f932b6" Jul 10 18:49:11.435619 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:11.435574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:49:12.009154 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:12.009111 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a"} Jul 10 18:49:12.009605 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:12.009231 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:49:23.063205 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:23.063168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerStarted","Data":"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392"} Jul 10 18:49:26.081951 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:26.081916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerStarted","Data":"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836"} Jul 10 18:49:26.082448 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:26.082114 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:49:26.104313 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:26.104169 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podStartSLOduration=2.485639748 podStartE2EDuration="33.104145087s" totalImagesPullingTime="26.758557306s" totalInitContainerRuntime="3.859948033s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:48:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:49:26.10366137 +0000 UTC m=+553.275814259" watchObservedRunningTime="2026-07-10 18:49:26.104145087 +0000 UTC m=+553.276297975" Jul 10 18:49:27.086977 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:27.086944 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:49:27.088130 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:27.088075 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:49:28.091690 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:28.091647 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:49:33.096484 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:33.096455 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:49:33.097048 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:33.097018 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:49:43.015618 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:43.015588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:49:43.097418 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:43.097380 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:49:53.097462 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:49:53.097421 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:50:03.097832 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:03.097789 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:50:13.097484 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:13.097439 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:50:13.238269 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:13.238232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:50:13.240585 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:13.240564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:50:23.097055 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:23.097014 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Jul 10 18:50:33.098936 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:50:33.098904 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:51:13.145840 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:13.145802 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:51:13.146346 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:13.146124 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" containerID="cri-o://947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392" gracePeriod=30 Jul 10 18:51:13.146346 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:13.146310 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kube-rbac-proxy" containerID="cri-o://b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836" gracePeriod=30 Jul 10 18:51:13.554262 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:13.554221 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerID="b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836" exitCode=2 Jul 10 18:51:13.554450 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:13.554276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerDied","Data":"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836"} Jul 10 18:51:16.890753 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.890726 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:51:16.976067 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976028 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location\") pod \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " Jul 10 18:51:16.976300 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976134 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls\") pod \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " Jul 10 18:51:16.976300 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976167 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mclkm\" (UniqueName: \"kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm\") pod \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " Jul 10 18:51:16.976300 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976196 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-graph-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config\") pod \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\" (UID: \"5d301fe9-7c08-450e-b392-c3d9bb9c84ca\") " Jul 10 18:51:16.976474 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976417 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5d301fe9-7c08-450e-b392-c3d9bb9c84ca" (UID: "5d301fe9-7c08-450e-b392-c3d9bb9c84ca"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:51:16.976636 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.976603 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-graph-kube-rbac-proxy-sar-config") pod "5d301fe9-7c08-450e-b392-c3d9bb9c84ca" (UID: "5d301fe9-7c08-450e-b392-c3d9bb9c84ca"). InnerVolumeSpecName "isvc-xgboost-graph-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:51:16.978518 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.978499 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5d301fe9-7c08-450e-b392-c3d9bb9c84ca" (UID: "5d301fe9-7c08-450e-b392-c3d9bb9c84ca"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:51:16.978518 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:16.978510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm" (OuterVolumeSpecName: "kube-api-access-mclkm") pod "5d301fe9-7c08-450e-b392-c3d9bb9c84ca" (UID: "5d301fe9-7c08-450e-b392-c3d9bb9c84ca"). InnerVolumeSpecName "kube-api-access-mclkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:51:17.077379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.077286 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mclkm\" (UniqueName: \"kubernetes.io/projected/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kube-api-access-mclkm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:51:17.077379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.077319 2563 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-graph-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-isvc-xgboost-graph-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:51:17.077379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.077331 2563 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-kserve-provision-location\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:51:17.077379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.077340 2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d301fe9-7c08-450e-b392-c3d9bb9c84ca-proxy-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 10 18:51:17.573153 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.573118 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerID="947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392" exitCode=0 Jul 10 18:51:17.573358 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.573185 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" Jul 10 18:51:17.573358 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.573193 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerDied","Data":"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392"} Jul 10 18:51:17.573358 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.573241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz" event={"ID":"5d301fe9-7c08-450e-b392-c3d9bb9c84ca","Type":"ContainerDied","Data":"1b54f75cc4f26ce63ceefd4c86305d715d31c02be45bb60a58537b4e396de099"} Jul 10 18:51:17.573358 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.573268 2563 scope.go:117] "RemoveContainer" containerID="b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836" Jul 10 18:51:17.582459 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.582432 2563 scope.go:117] "RemoveContainer" containerID="947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392" Jul 10 18:51:17.590104 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.590066 2563 scope.go:117] "RemoveContainer" containerID="d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c" Jul 10 18:51:17.598334 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.598309 2563 scope.go:117] "RemoveContainer" containerID="b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836" Jul 10 18:51:17.598559 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.598538 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:51:17.598696 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:17.598679 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836\": container with ID starting with b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836 not found: ID does not exist" containerID="b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836" Jul 10 18:51:17.598737 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.598704 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836"} err="failed to get container status \"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836\": rpc error: code = NotFound desc = could not find container \"b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836\": container with ID starting with b0d089b764621de5d404026c3bff476f442d8955ce24b2c3ccfcda5dae999836 not found: ID does not exist" Jul 10 18:51:17.598737 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.598724 2563 scope.go:117] "RemoveContainer" containerID="947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392" Jul 10 18:51:17.599030 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:17.599012 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392\": container with ID starting with 947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392 not found: ID does not exist" containerID="947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392" Jul 10 18:51:17.599079 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.599037 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392"} err="failed to get container status \"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392\": rpc error: code = NotFound desc = could not find container \"947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392\": container with ID starting with 947140f4b901adce0049b7d5dcb19d6c69b7eac94f77698f597db19d5e940392 not found: ID does not exist" Jul 10 18:51:17.599079 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.599052 2563 scope.go:117] "RemoveContainer" containerID="d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c" Jul 10 18:51:17.599346 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:17.599327 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c\": container with ID starting with d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c not found: ID does not exist" containerID="d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c" Jul 10 18:51:17.599406 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.599355 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c"} err="failed to get container status \"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c\": rpc error: code = NotFound desc = could not find container \"d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c\": container with ID starting with d209f49a21aa284318bbbb50eaa03745cb98c4535cc0c6669f0db50c58e9548c not found: ID does not exist" Jul 10 18:51:17.602321 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.602298 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz"] Jul 10 18:51:17.709310 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:17.709279 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" path="/var/lib/kubelet/pods/5d301fe9-7c08-450e-b392-c3d9bb9c84ca/volumes" Jul 10 18:51:30.630401 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:30.630368 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" exitCode=1 Jul 10 18:51:30.630842 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:30.630443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a"} Jul 10 18:51:30.630842 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:30.630512 2563 scope.go:117] "RemoveContainer" containerID="7a0ec50ab771fe2effad4d7769c87bf9097171b49324f74898014db3b5f932b6" Jul 10 18:51:30.630940 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:30.630857 2563 scope.go:117] "RemoveContainer" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" Jul 10 18:51:30.631064 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:30.631045 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:51:33.013899 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:33.013862 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:51:33.014337 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:33.014248 2563 scope.go:117] "RemoveContainer" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" Jul 10 18:51:33.014450 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:33.014431 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:51:36.167730 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:36.167687 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:51:36.168158 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:36.168064 2563 scope.go:117] "RemoveContainer" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" Jul 10 18:51:36.168295 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:51:36.168272 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:51:48.704356 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:48.704323 2563 scope.go:117] "RemoveContainer" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" Jul 10 18:51:48.705028 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:48.704636 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:51:49.713807 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:49.713769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13"} Jul 10 18:51:49.714233 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:51:49.713979 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:52:20.720813 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:52:20.720777 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:54:05.719286 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:05.719239 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.24:8081/readyz\": dial tcp 10.133.0.24:8081: connect: connection refused" Jul 10 18:54:06.167786 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:06.167730 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.24:8081/healthz\": dial tcp 10.133.0.24:8081: connect: connection refused" Jul 10 18:54:06.312209 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:06.312177 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" exitCode=1 Jul 10 18:54:06.312379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:06.312228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13"} Jul 10 18:54:06.312379 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:06.312278 2563 scope.go:117] "RemoveContainer" containerID="ebb022dd7d292c26a39788f8de01aee40d2a6984114dd92ebb35d52f70daf40a" Jul 10 18:54:06.312678 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:06.312657 2563 scope.go:117] "RemoveContainer" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" Jul 10 18:54:06.312930 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:54:06.312905 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:54:10.719376 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:10.719322 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:54:10.719793 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:10.719713 2563 scope.go:117] "RemoveContainer" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" Jul 10 18:54:10.719903 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:54:10.719884 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:54:16.167191 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:16.167147 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:54:16.167666 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:16.167560 2563 scope.go:117] "RemoveContainer" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" Jul 10 18:54:16.167762 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:54:16.167740 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:54:27.704943 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:27.704909 2563 scope.go:117] "RemoveContainer" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" Jul 10 18:54:28.409769 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:28.409683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e"} Jul 10 18:54:28.409912 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:28.409887 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:54:59.416819 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:54:59.416791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:55:13.266355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:55:13.266269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:55:13.266355 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:55:13.266288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 18:56:44.983160 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:44.983123 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" exitCode=1 Jul 10 18:56:44.983639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:44.983202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e"} Jul 10 18:56:44.983639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:44.983272 2563 scope.go:117] "RemoveContainer" containerID="c427c947ba5eddd8a24afac3ab053e7d88675ce4369fba66d523fc127c733f13" Jul 10 18:56:44.983639 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:44.983591 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:56:44.983805 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:56:44.983768 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:56:46.166985 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:46.166940 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:56:46.167425 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:46.167342 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:56:46.167562 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:56:46.167543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:56:49.415047 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:49.415006 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:56:49.415485 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:56:49.415425 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:56:49.415614 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:56:49.415594 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:57:03.709164 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:03.709136 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:57:03.709548 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:57:03.709328 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:57:14.704853 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:14.704809 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:57:14.705279 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:57:14.705003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:57:25.704765 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:25.704725 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:57:25.705388 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:25.705000 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:57:26.163249 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:26.163161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b"} Jul 10 18:57:26.163403 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:26.163370 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:57:57.169946 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:57:57.169908 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:59:42.169610 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:42.169565 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.24:8081/readyz\": dial tcp 10.133.0.24:8081: connect: connection refused" Jul 10 18:59:42.762856 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:42.762822 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" exitCode=1 Jul 10 18:59:42.763036 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:42.762883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b"} Jul 10 18:59:42.763036 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:42.762935 2563 scope.go:117] "RemoveContainer" containerID="6bfe4764f441dd5def4f779c31d618953daa5891141d08de983ca1085593ca7e" Jul 10 18:59:42.763293 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:42.763274 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 18:59:42.763547 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:59:42.763526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:59:46.167936 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:46.167896 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:59:46.168425 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:46.168290 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 18:59:46.168493 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:59:46.168474 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:59:47.168926 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:47.168889 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 18:59:47.169362 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:47.169312 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 18:59:47.169485 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:59:47.169467 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 18:59:59.704516 ip-10-0-138-0 kubenswrapper[2563]: I0710 18:59:59.704480 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 18:59:59.705015 ip-10-0-138-0 kubenswrapper[2563]: E0710 18:59:59.704658 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:00:13.293804 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:13.293774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:00:13.295268 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:13.295249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:00:14.704837 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:14.704805 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:00:14.705242 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:00:14.704991 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:00:26.704709 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:26.704677 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:00:26.705108 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:00:26.704836 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:00:41.704624 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:41.704585 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:00:41.705037 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:00:41.704788 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:00:53.706404 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:00:53.706363 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:00:53.706827 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:00:53.706646 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:01:07.705132 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:01:07.705018 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:01:13.154946 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:01:13.154910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d"} Jul 10 19:01:13.155443 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:01:13.155234 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:01:44.161673 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:01:44.161634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:03:31.745498 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:31.745463 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" exitCode=1 Jul 10 19:03:31.745971 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:31.745529 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d"} Jul 10 19:03:31.745971 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:31.745590 2563 scope.go:117] "RemoveContainer" containerID="75c6c4bf96b6d2162a6c068d8a8fc6e1574b11c7ce8b49d323a76e80c8ac241b" Jul 10 19:03:31.745971 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:31.745878 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:03:31.746128 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:03:31.746067 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:03:34.159048 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:34.158999 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:03:34.159482 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:34.159407 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:03:34.159592 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:03:34.159572 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:03:36.167583 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:36.167540 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:03:36.167961 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:36.167879 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:03:36.168110 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:03:36.168075 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:03:47.704739 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:03:47.704702 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:03:47.705259 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:03:47.704885 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:04:00.704591 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:04:00.704560 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:04:00.704974 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:04:00.704720 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:04:13.706601 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:04:13.706526 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:04:13.707192 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:04:13.706730 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:04:28.704895 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:04:28.704864 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:04:28.705303 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:04:28.705040 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:04:39.705031 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:04:39.704995 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:04:39.705441 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:04:39.705202 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:04:51.705290 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:04:51.705259 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:04:51.705782 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:04:51.705442 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:05:03.710279 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:03.710248 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:05:03.711140 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:05:03.711081 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:05:13.320107 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:13.320066 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:05:13.321811 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:13.321789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:05:15.704977 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:15.704939 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:05:15.705511 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:05:15.705200 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:05:27.705010 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:27.704970 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:05:27.705659 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:05:27.705161 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:05:40.705281 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:40.705187 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:05:40.705715 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:05:40.705378 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:05:53.706601 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:05:53.706567 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:05:53.706992 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:05:53.706821 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:06:08.704602 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:08.704567 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:06:08.705113 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:06:08.704736 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:06:21.704713 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:21.704680 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:06:21.705124 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:21.704963 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:06:22.472188 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:22.472150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb"} Jul 10 19:06:22.472397 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:22.472376 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:06:53.479063 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:06:53.479025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:08:40.058011 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:40.057978 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" exitCode=1 Jul 10 19:08:40.058486 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:40.058050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb"} Jul 10 19:08:40.058486 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:40.058127 2563 scope.go:117] "RemoveContainer" containerID="ebd19b2ae022b83cef4705ac7887b0c95674f92b2cb66bf264f23b4646e9e45d" Jul 10 19:08:40.058486 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:40.058448 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:08:40.058660 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:08:40.058640 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:08:43.476849 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:43.476812 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:08:43.477276 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:43.477216 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:08:43.477408 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:08:43.477387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:08:46.167744 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:46.167701 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:08:46.168172 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:46.168118 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:08:46.168321 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:08:46.168295 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:08:59.704662 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:08:59.704632 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:08:59.705051 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:08:59.704821 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:09:13.706819 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:09:13.706787 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:09:13.707476 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:09:13.706979 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:09:27.705066 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:09:27.705028 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:09:27.705552 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:09:27.705302 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:09:42.704489 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:09:42.704456 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:09:42.704882 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:09:42.704626 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:09:53.707034 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:09:53.707006 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:09:53.707631 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:09:53.707243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:10:07.704449 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:07.704374 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:10:07.704891 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:10:07.704578 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:10:13.344712 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:13.344684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:10:13.347361 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:13.347338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:10:19.704861 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:19.704818 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:10:19.705365 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:10:19.705018 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:10:30.705180 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:30.705141 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:10:30.705743 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:10:30.705330 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:10:43.706441 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:43.706408 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:10:43.706895 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:10:43.706619 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:10:54.704718 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:10:54.704682 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:10:54.705201 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:10:54.704848 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:11:08.704535 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:11:08.704499 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:11:08.705006 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:11:08.704688 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:11:19.705237 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:11:19.705202 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:11:19.705624 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:11:19.705444 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:11:32.704707 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:11:32.704667 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:11:32.705227 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:11:32.704900 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:11:44.704515 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:11:44.704482 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:11:44.704989 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:11:44.704632 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:11:58.704548 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:11:58.704516 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:11:58.706976 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:11:58.704711 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:12:13.708110 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:12:13.708062 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:12:13.708559 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:12:13.708265 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:12:25.704889 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:12:25.704852 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:12:25.705434 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:12:25.705036 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:12:40.704800 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:12:40.704762 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:12:40.705240 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:12:40.704924 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:12:52.704217 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:12:52.704181 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:12:52.704679 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:12:52.704387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:13:05.709256 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:05.709183 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:13:05.709714 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:13:05.709369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:13:19.704766 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:19.704726 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:13:19.705180 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:13:19.704898 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:13:30.705054 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:30.705019 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:13:30.705556 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:13:30.705287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:13:45.705226 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:45.705194 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:13:45.705705 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:45.705478 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:13:46.377610 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:46.377526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716"} Jul 10 19:13:46.377752 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:13:46.377735 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:14:17.384032 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:14:17.383998 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:15:13.369073 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:15:13.369045 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:15:13.371755 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:15:13.371734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:16:02.383416 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:02.383365 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.24:8081/readyz\": dial tcp 10.133.0.24:8081: connect: connection refused" Jul 10 19:16:02.952730 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:02.952694 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" exitCode=1 Jul 10 19:16:02.952875 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:02.952750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716"} Jul 10 19:16:02.952875 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:02.952801 2563 scope.go:117] "RemoveContainer" containerID="8061a443858a54379342bfcc0c0bdaabde843f071242937df4a7b498bc6759fb" Jul 10 19:16:02.953139 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:02.953120 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:02.953363 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:02.953340 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:16:06.167543 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:06.167446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:16:06.167930 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:06.167838 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:06.168047 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:06.168026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:16:07.382800 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:07.382767 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:16:07.383267 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:07.383157 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:07.383348 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:07.383329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:16:20.704691 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:20.704658 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:20.705180 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:20.704854 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:16:35.705268 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:35.705235 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:35.705875 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:35.705413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:16:48.704684 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:16:48.704641 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:16:48.705194 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:16:48.704875 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:17:00.705015 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:17:00.704983 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:17:00.707329 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:17:00.705161 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:17:14.704662 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:17:14.704625 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:17:14.705170 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:17:14.704784 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:17:29.709760 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:17:29.709732 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:17:29.710223 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:17:29.709896 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:17:43.707261 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:17:43.707181 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:17:43.707725 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:17:43.707397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:17:58.704424 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:17:58.704388 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:17:58.704932 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:17:58.704585 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:18:12.704462 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:18:12.704425 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:18:12.704854 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:18:12.704614 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:18:26.704547 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:18:26.704511 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:18:26.704950 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:18:26.704677 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:18:41.704579 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:18:41.704541 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:18:41.705059 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:18:41.704774 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:18:54.705206 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:18:54.705172 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:18:54.705588 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:18:54.705336 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:19:07.704571 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:19:07.704491 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:19:07.704927 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:19:07.704713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:19:20.704368 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:19:20.704337 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:19:20.704871 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:19:20.704537 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:19:32.704603 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:19:32.704567 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:19:32.704984 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:19:32.704742 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:19:47.710515 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:19:47.710483 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:19:47.710897 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:19:47.710679 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:20:00.704583 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:00.704541 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:20:00.705191 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:20:00.704766 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:20:13.393936 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:13.393910 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:20:13.397734 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:13.397713 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:20:15.709569 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:15.709536 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:20:15.709954 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:20:15.709728 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:20:26.709943 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:26.705243 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:20:26.709943 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:20:26.705606 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:20:39.709832 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:39.709761 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:20:39.710295 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:20:39.709941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:20:50.704202 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:20:50.704169 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:20:50.704604 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:20:50.704365 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:21:02.704647 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:21:02.704602 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:21:02.705168 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:21:02.705012 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:21:03.218795 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:21:03.218760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c"} Jul 10 19:21:03.218980 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:21:03.218962 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:21:34.224829 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:21:34.224794 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:23:22.808666 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:22.808625 2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf7168c-053d-4351-91cc-af3e3aa36505" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" exitCode=1 Jul 10 19:23:22.808666 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:22.808669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerDied","Data":"0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c"} Jul 10 19:23:22.809219 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:22.808727 2563 scope.go:117] "RemoveContainer" containerID="a574fa0866a167fd8dcca20c53d5943cd95d0f8a2391603983fdf005bc4e0716" Jul 10 19:23:22.809219 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:22.809044 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:23:22.809325 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:23:22.809303 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:23:24.223111 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:24.223035 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:23:24.223541 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:24.223482 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:23:24.223679 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:23:24.223657 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:23:26.167196 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:26.167146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:23:26.167606 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:26.167564 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:23:26.167761 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:23:26.167740 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:23:40.704701 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:40.704616 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:23:40.705156 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:23:40.704807 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:23:51.705185 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:23:51.705147 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:23:51.705678 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:23:51.705304 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:24:05.705601 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:24:05.705569 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:24:05.706061 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:24:05.705716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:24:17.704683 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:24:17.704648 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:24:17.705068 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:24:17.704856 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:24:29.704389 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:24:29.704356 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:24:29.704776 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:24:29.704554 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:24:42.705258 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:24:42.705228 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:24:42.705744 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:24:42.705412 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:24:55.704646 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:24:55.704612 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:24:55.705130 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:24:55.704795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:25:09.704460 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:09.704379 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:25:09.704891 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:25:09.704593 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:25:13.418196 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:13.418164 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:25:13.423026 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:13.423002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:25:23.706553 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:23.706523 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:25:23.706927 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:25:23.706705 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:25:37.704630 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:37.704591 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:25:37.705148 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:25:37.704778 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:25:49.704708 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:25:49.704679 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:25:49.705198 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:25:49.704862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:26:00.704536 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:26:00.704496 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:26:00.705006 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:26:00.704724 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:26:12.704836 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:26:12.704803 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:26:12.705269 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:26:12.704986 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:26:24.705237 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:26:24.705201 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:26:24.705727 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:26:24.705388 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:26:36.704913 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:26:36.704827 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:26:36.705411 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:26:36.705035 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:26:50.705006 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:26:50.704966 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:26:50.705498 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:26:50.705210 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:27:05.704870 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:27:05.704837 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:27:05.705398 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:27:05.705013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:27:16.704802 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:27:16.704767 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:27:16.705312 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:27:16.704972 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:27:30.705007 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:27:30.704975 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:27:30.707207 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:27:30.705177 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:27:41.704411 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:27:41.704349 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:27:41.704822 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:27:41.704626 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:27:53.706217 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:27:53.706188 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:27:53.706671 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:27:53.706357 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:28:05.704481 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:05.704382 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:28:05.704858 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:28:05.704588 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:28:20.704726 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:20.704693 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:28:20.705163 ip-10-0-138-0 kubenswrapper[2563]: E0710 19:28:20.704868 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-vk4xj_kserve(2bf7168c-053d-4351-91cc-af3e3aa36505)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" podUID="2bf7168c-053d-4351-91cc-af3e3aa36505" Jul 10 19:28:35.705049 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:35.705008 2563 scope.go:117] "RemoveContainer" containerID="0045751eff801569c6f215b1beca84a0d23508ae356e5459677907a7ea65746c" Jul 10 19:28:35.705598 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:35.705443 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:28:36.123957 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:36.123874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" event={"ID":"2bf7168c-053d-4351-91cc-af3e3aa36505","Type":"ContainerStarted","Data":"2fa458efcdc607a720cf81777a3403e254c0702a601a334859558caf532e4f25"} Jul 10 19:28:36.124117 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:36.124079 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:28:56.547289 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:56.547245 2563 ???:1] "http: TLS handshake error from 10.0.129.73:52428: EOF" Jul 10 19:28:56.552811 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:56.552787 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-stdf8_aed8a6c4-2179-42d3-8bf5-d0f93e0f914c/global-pull-secret-syncer/0.log" Jul 10 19:28:56.698311 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:56.698280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vhbqx_0a95f62d-e232-4534-b621-39e3ed634488/konnectivity-agent/0.log" Jul 10 19:28:56.745761 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:28:56.745727 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-0.ec2.internal_6997a03359e3b626c552aedfb5b0c321/haproxy/0.log" Jul 10 19:29:00.587936 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.587904 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/alertmanager/0.log" Jul 10 19:29:00.621917 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.621888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/config-reloader/0.log" Jul 10 19:29:00.661871 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.661838 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/kube-rbac-proxy-web/0.log" Jul 10 19:29:00.701651 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.701623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/kube-rbac-proxy/0.log" Jul 10 19:29:00.769492 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.769465 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/kube-rbac-proxy-metric/0.log" Jul 10 19:29:00.847614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.847530 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/prom-label-proxy/0.log" Jul 10 19:29:00.908169 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:00.908137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a5feb7a-1509-42ba-a06a-acb6fb36d8ab/init-config-reloader/0.log" Jul 10 19:29:01.131060 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.130986 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6db855f7b8-nz4k2_0106afb6-a782-4968-b57c-6858149b8de5/metrics-server/0.log" Jul 10 19:29:01.295299 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.295273 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/node-exporter/0.log" Jul 10 19:29:01.319390 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.319361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/kube-rbac-proxy/0.log" Jul 10 19:29:01.343920 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.343893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4ff7_8af16626-2016-4153-ab82-039d9ce13ab2/init-textfile/0.log" Jul 10 19:29:01.873942 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.873913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b9df7569-b7zr8_1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca/telemeter-client/0.log" Jul 10 19:29:01.897186 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.897160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b9df7569-b7zr8_1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca/reload/0.log" Jul 10 19:29:01.923250 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:01.923226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b9df7569-b7zr8_1ff3dfe9-a7c3-47e7-a6d1-efc07a011fca/kube-rbac-proxy/0.log" Jul 10 19:29:04.386980 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.386956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56b5bd57bd-s8gjz_231633be-268a-453f-835a-76d4cf00e45c/console/0.log" Jul 10 19:29:04.933279 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933244 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w"] Jul 10 19:29:04.933573 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933561 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="storage-initializer" Jul 10 19:29:04.933614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933574 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="storage-initializer" Jul 10 19:29:04.933614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933582 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" Jul 10 19:29:04.933614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933588 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" Jul 10 19:29:04.933614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933595 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kube-rbac-proxy" Jul 10 19:29:04.933614 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933601 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kube-rbac-proxy" Jul 10 19:29:04.933756 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933650 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kube-rbac-proxy" Jul 10 19:29:04.933756 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.933658 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d301fe9-7c08-450e-b392-c3d9bb9c84ca" containerName="kserve-container" Jul 10 19:29:04.936650 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.936629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:04.938904 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.938883 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qxct\"/\"kube-root-ca.crt\"" Jul 10 19:29:04.940026 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.940006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qxct\"/\"openshift-service-ca.crt\"" Jul 10 19:29:04.940124 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.940010 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9qxct\"/\"default-dockercfg-htsxz\"" Jul 10 19:29:04.947145 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:04.947122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w"] Jul 10 19:29:05.025474 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.025434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-sys\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.025474 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.025473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-lib-modules\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.025688 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.025502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-podres\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.025688 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.025559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wjv\" (UniqueName: \"kubernetes.io/projected/4c0e34b5-082e-4e39-b14a-6d003ef8f895-kube-api-access-c7wjv\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.025688 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.025626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-proc\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126567 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-proc\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-sys\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-lib-modules\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-proc\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-podres\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wjv\" (UniqueName: \"kubernetes.io/projected/4c0e34b5-082e-4e39-b14a-6d003ef8f895-kube-api-access-c7wjv\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.126776 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126706 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-sys\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.127013 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126779 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-lib-modules\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.127013 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.126808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c0e34b5-082e-4e39-b14a-6d003ef8f895-podres\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.134373 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.134347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wjv\" (UniqueName: \"kubernetes.io/projected/4c0e34b5-082e-4e39-b14a-6d003ef8f895-kube-api-access-c7wjv\") pod \"perf-node-gather-daemonset-xwq8w\" (UID: \"4c0e34b5-082e-4e39-b14a-6d003ef8f895\") " pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.246377 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.246279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:05.379951 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.379905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w"] Jul 10 19:29:05.383147 ip-10-0-138-0 kubenswrapper[2563]: W0710 19:29:05.383116 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c0e34b5_082e_4e39_b14a_6d003ef8f895.slice/crio-ae6ace39dad5dba73e2e276718c12dc5d0fb0a61420803646ea1e01e91319dc4 WatchSource:0}: Error finding container ae6ace39dad5dba73e2e276718c12dc5d0fb0a61420803646ea1e01e91319dc4: Status 404 returned error can't find the container with id ae6ace39dad5dba73e2e276718c12dc5d0fb0a61420803646ea1e01e91319dc4 Jul 10 19:29:05.915676 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.915644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhnm4_eabf1172-1e21-4615-b400-7f93c4e79486/dns/0.log" Jul 10 19:29:05.941028 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:05.941000 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhnm4_eabf1172-1e21-4615-b400-7f93c4e79486/kube-rbac-proxy/0.log" Jul 10 19:29:06.016756 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.016727 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9t9wr_b98a526a-2939-4ded-863e-b0465789c4f9/dns-node-resolver/0.log" Jul 10 19:29:06.253892 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.253858 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" event={"ID":"4c0e34b5-082e-4e39-b14a-6d003ef8f895","Type":"ContainerStarted","Data":"289963ea02459b78323873f1fd3008c926ae89e5931d2ab3d4da50ca0be245c8"} Jul 10 19:29:06.254117 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.253911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" event={"ID":"4c0e34b5-082e-4e39-b14a-6d003ef8f895","Type":"ContainerStarted","Data":"ae6ace39dad5dba73e2e276718c12dc5d0fb0a61420803646ea1e01e91319dc4"} Jul 10 19:29:06.254117 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.253963 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:06.271451 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.271398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" podStartSLOduration=2.27138029 podStartE2EDuration="2.27138029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:29:06.270102032 +0000 UTC m=+2933.442254908" watchObservedRunningTime="2026-07-10 19:29:06.27138029 +0000 UTC m=+2933.443533174" Jul 10 19:29:06.528778 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.528696 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-fd4d9b8df-8qppk_370b3278-26cc-4bda-b649-427b570d4e08/registry/0.log" Jul 10 19:29:06.601229 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:06.601202 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wp989_d3dd4bb9-5062-4ff8-8595-42b46a63bbb7/node-ca/0.log" Jul 10 19:29:07.129821 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:07.129791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-vk4xj" Jul 10 19:29:07.808472 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:07.808434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssq2f_5cf7faef-3ea2-4891-9cf3-532439315284/serve-healthcheck-canary/0.log" Jul 10 19:29:08.326538 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:08.326511 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9scc_7a239d7e-0128-466d-a83d-0c4f4b52d8dd/kube-rbac-proxy/0.log" Jul 10 19:29:08.345729 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:08.345697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9scc_7a239d7e-0128-466d-a83d-0c4f4b52d8dd/exporter/0.log" Jul 10 19:29:08.367022 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:08.366984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9scc_7a239d7e-0128-466d-a83d-0c4f4b52d8dd/extractor/0.log" Jul 10 19:29:10.383538 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:10.383486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-659578d74d-dr528_9d26d02e-8af8-4bba-9a5d-f0d100e497e4/manager/0.log" Jul 10 19:29:10.405271 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:10.405241 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-vk4xj_2bf7168c-053d-4351-91cc-af3e3aa36505/manager/9.log" Jul 10 19:29:10.405597 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:10.405582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-vk4xj_2bf7168c-053d-4351-91cc-af3e3aa36505/manager/8.log" Jul 10 19:29:10.427404 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:10.427382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-gxbh7_cbfaab2b-482c-4626-941a-c15683f17a1b/server/0.log" Jul 10 19:29:10.518834 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:10.518805 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-pflfk_0e68ae39-1370-4b57-85bf-9141e69e4a87/manager/0.log" Jul 10 19:29:12.268591 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:12.268565 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9qxct/perf-node-gather-daemonset-xwq8w" Jul 10 19:29:15.969922 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:15.969888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/kube-multus-additional-cni-plugins/0.log" Jul 10 19:29:15.992386 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:15.992357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/egress-router-binary-copy/0.log" Jul 10 19:29:16.014582 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.014552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/cni-plugins/0.log" Jul 10 19:29:16.035947 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.035918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/bond-cni-plugin/0.log" Jul 10 19:29:16.062380 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.062308 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/routeoverride-cni/0.log" Jul 10 19:29:16.087738 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.087710 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/whereabouts-cni-bincopy/0.log" Jul 10 19:29:16.112072 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.112044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n2zzn_1a759fa5-5a0f-49ec-b327-a578419c882b/whereabouts-cni/0.log" Jul 10 19:29:16.340733 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.340664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j9r96_482b3da1-5851-4e2f-8f79-2af8a537cc7b/kube-multus/0.log" Jul 10 19:29:16.455805 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.455780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xrpg8_79ef32f7-0a7f-460d-a902-89dc172b2c9e/network-metrics-daemon/0.log" Jul 10 19:29:16.476650 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:16.476620 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xrpg8_79ef32f7-0a7f-460d-a902-89dc172b2c9e/kube-rbac-proxy/0.log" Jul 10 19:29:17.489342 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.489307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-controller/0.log" Jul 10 19:29:17.509305 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.509270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/1.log" Jul 10 19:29:17.509305 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.509278 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovn-acl-logging/0.log" Jul 10 19:29:17.526796 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.526768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/kube-rbac-proxy-node/0.log" Jul 10 19:29:17.550544 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.550514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 19:29:17.572246 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.572220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/northd/0.log" Jul 10 19:29:17.594066 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.594042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/nbdb/0.log" Jul 10 19:29:17.617026 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.617003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/sbdb/0.log" Jul 10 19:29:17.660297 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:17.660269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7p7g_0f09e463-c794-44b5-ae39-0fac266bd33c/ovnkube-controller/0.log" Jul 10 19:29:18.931373 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:18.931288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-m7sk2_8e75bc25-8bc8-4ad8-a534-73b6484d6ce5/network-check-target-container/0.log" Jul 10 19:29:19.938160 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:19.938133 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sgbsf_1ba34355-e094-4969-951e-e177ad8b4c5a/iptables-alerter/0.log" Jul 10 19:29:20.524202 ip-10-0-138-0 kubenswrapper[2563]: I0710 19:29:20.524169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gzrqm_02642297-0565-4067-99b6-f1cf7f71b81c/tuned/0.log"